00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2383 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3644 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.117 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.117 The recommended git tool is: git 00:00:00.117 using credential 00000000-0000-0000-0000-000000000002 00:00:00.122 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.149 Fetching changes from the remote Git repository 00:00:00.151 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.177 Using shallow fetch with depth 1 00:00:00.177 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.177 > git --version # timeout=10 00:00:00.213 > git --version # 'git version 2.39.2' 00:00:00.213 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.249 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.249 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.017 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.027 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.038 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.038 > git config core.sparsecheckout # timeout=10 00:00:05.049 > git read-tree -mu HEAD # timeout=10 00:00:05.065 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.083 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.084 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.187 [Pipeline] Start of Pipeline 00:00:05.197 [Pipeline] library 00:00:05.201 Loading library shm_lib@master 00:00:05.201 Library shm_lib@master is cached. Copying from home. 00:00:05.214 [Pipeline] node 00:00:05.224 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.225 [Pipeline] { 00:00:05.234 [Pipeline] catchError 00:00:05.235 [Pipeline] { 00:00:05.247 [Pipeline] wrap 00:00:05.256 [Pipeline] { 00:00:05.264 [Pipeline] stage 00:00:05.266 [Pipeline] { (Prologue) 00:00:05.471 [Pipeline] sh 00:00:05.756 + logger -p user.info -t JENKINS-CI 00:00:05.778 [Pipeline] echo 00:00:05.780 Node: GP11 00:00:05.785 [Pipeline] sh 00:00:06.085 [Pipeline] setCustomBuildProperty 00:00:06.100 [Pipeline] echo 00:00:06.103 Cleanup processes 00:00:06.108 [Pipeline] sh 00:00:06.400 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.400 3244576 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.411 [Pipeline] sh 00:00:06.695 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.695 ++ grep -v 'sudo pgrep' 00:00:06.695 ++ awk '{print $1}' 00:00:06.695 + sudo kill -9 00:00:06.695 + true 00:00:06.708 [Pipeline] cleanWs 00:00:06.716 [WS-CLEANUP] Deleting project workspace... 00:00:06.716 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.722 [WS-CLEANUP] done 00:00:06.725 [Pipeline] setCustomBuildProperty 00:00:06.739 [Pipeline] sh 00:00:07.021 + sudo git config --global --replace-all safe.directory '*' 00:00:07.102 [Pipeline] httpRequest 00:00:07.476 [Pipeline] echo 00:00:07.478 Sorcerer 10.211.164.20 is alive 00:00:07.484 [Pipeline] retry 00:00:07.486 [Pipeline] { 00:00:07.497 [Pipeline] httpRequest 00:00:07.502 HttpMethod: GET 00:00:07.502 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.503 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.516 Response Code: HTTP/1.1 200 OK 00:00:07.516 Success: Status code 200 is in the accepted range: 200,404 00:00:07.516 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.714 [Pipeline] } 00:00:09.729 [Pipeline] // retry 00:00:09.735 [Pipeline] sh 00:00:10.021 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.036 [Pipeline] httpRequest 00:00:10.434 [Pipeline] echo 00:00:10.436 Sorcerer 10.211.164.20 is alive 00:00:10.447 [Pipeline] retry 00:00:10.450 [Pipeline] { 00:00:10.466 [Pipeline] httpRequest 00:00:10.470 HttpMethod: GET 00:00:10.470 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:10.471 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:10.496 Response Code: HTTP/1.1 200 OK 00:00:10.496 Success: Status code 200 is in the accepted range: 200,404 00:00:10.496 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:21.901 [Pipeline] } 00:01:21.919 [Pipeline] // retry 00:01:21.928 [Pipeline] sh 00:01:22.218 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:24.768 [Pipeline] sh 00:01:25.052 + git -C spdk log --oneline -n5 00:01:25.052 c13c99a5e test: Various fixes for Fedora40 00:01:25.052 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:25.052 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:25.052 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:25.052 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:25.063 [Pipeline] } 00:01:25.076 [Pipeline] // stage 00:01:25.084 [Pipeline] stage 00:01:25.086 [Pipeline] { (Prepare) 00:01:25.102 [Pipeline] writeFile 00:01:25.117 [Pipeline] sh 00:01:25.401 + logger -p user.info -t JENKINS-CI 00:01:25.415 [Pipeline] sh 00:01:25.699 + logger -p user.info -t JENKINS-CI 00:01:25.712 [Pipeline] sh 00:01:25.998 + cat autorun-spdk.conf 00:01:25.998 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.998 SPDK_TEST_NVMF=1 00:01:25.998 SPDK_TEST_NVME_CLI=1 00:01:25.998 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.998 SPDK_TEST_NVMF_NICS=e810 00:01:25.998 SPDK_RUN_UBSAN=1 00:01:25.998 NET_TYPE=phy 00:01:26.006 RUN_NIGHTLY=1 00:01:26.011 [Pipeline] readFile 00:01:26.036 [Pipeline] withEnv 00:01:26.039 [Pipeline] { 00:01:26.051 [Pipeline] sh 00:01:26.338 + set -ex 00:01:26.338 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:26.338 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:26.338 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:26.338 ++ SPDK_TEST_NVMF=1 00:01:26.338 ++ SPDK_TEST_NVME_CLI=1 00:01:26.338 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:26.338 ++ SPDK_TEST_NVMF_NICS=e810 00:01:26.338 ++ SPDK_RUN_UBSAN=1 00:01:26.338 ++ NET_TYPE=phy 00:01:26.338 ++ RUN_NIGHTLY=1 00:01:26.338 + case $SPDK_TEST_NVMF_NICS in 00:01:26.338 + DRIVERS=ice 00:01:26.338 + [[ tcp == \r\d\m\a ]] 00:01:26.338 + [[ -n ice ]] 00:01:26.338 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:26.338 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:26.338 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:26.338 rmmod: ERROR: Module irdma is not currently loaded 00:01:26.338 rmmod: ERROR: Module i40iw is not currently loaded 00:01:26.338 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:26.338 + true 00:01:26.338 + for D in $DRIVERS 00:01:26.338 + sudo modprobe ice 00:01:26.338 + exit 0 00:01:26.349 [Pipeline] } 00:01:26.364 [Pipeline] // withEnv 00:01:26.370 [Pipeline] } 00:01:26.383 [Pipeline] // stage 00:01:26.393 [Pipeline] catchError 00:01:26.395 [Pipeline] { 00:01:26.408 [Pipeline] timeout 00:01:26.409 Timeout set to expire in 1 hr 0 min 00:01:26.411 [Pipeline] { 00:01:26.425 [Pipeline] stage 00:01:26.427 [Pipeline] { (Tests) 00:01:26.440 [Pipeline] sh 00:01:26.726 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:26.726 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:26.726 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:26.726 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:26.726 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:26.726 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:26.726 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:26.726 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:26.726 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:26.726 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:26.726 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:26.726 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:26.726 + source /etc/os-release 00:01:26.726 ++ NAME='Fedora Linux' 00:01:26.726 ++ VERSION='39 (Cloud Edition)' 00:01:26.726 ++ ID=fedora 00:01:26.726 ++ VERSION_ID=39 00:01:26.726 ++ VERSION_CODENAME= 00:01:26.726 ++ PLATFORM_ID=platform:f39 00:01:26.726 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:26.726 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:26.726 ++ LOGO=fedora-logo-icon 00:01:26.726 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:26.726 ++ HOME_URL=https://fedoraproject.org/ 00:01:26.726 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:26.726 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:26.726 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:26.726 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:26.726 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:26.726 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:26.726 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:26.726 ++ SUPPORT_END=2024-11-12 00:01:26.726 ++ VARIANT='Cloud Edition' 00:01:26.726 ++ VARIANT_ID=cloud 00:01:26.726 + uname -a 00:01:26.726 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:26.726 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:27.663 Hugepages 00:01:27.663 node hugesize free / total 00:01:27.663 node0 1048576kB 0 / 0 00:01:27.663 node0 2048kB 0 / 0 00:01:27.663 node1 1048576kB 0 / 0 00:01:27.663 node1 2048kB 0 / 0 00:01:27.663 00:01:27.663 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:27.663 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:27.663 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:27.663 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:27.663 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:27.663 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:27.663 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:27.663 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:27.663 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:27.663 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:27.663 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:27.663 + rm -f /tmp/spdk-ld-path 00:01:27.663 + source autorun-spdk.conf 00:01:27.663 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:27.663 ++ SPDK_TEST_NVMF=1 00:01:27.663 ++ SPDK_TEST_NVME_CLI=1 00:01:27.663 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:27.663 ++ SPDK_TEST_NVMF_NICS=e810 00:01:27.663 ++ SPDK_RUN_UBSAN=1 00:01:27.663 ++ NET_TYPE=phy 00:01:27.663 ++ RUN_NIGHTLY=1 00:01:27.663 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:27.663 + [[ -n '' ]] 00:01:27.663 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:27.663 + for M in /var/spdk/build-*-manifest.txt 00:01:27.663 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:27.663 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:27.663 + for M in /var/spdk/build-*-manifest.txt 00:01:27.663 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:27.663 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:27.663 + for M in /var/spdk/build-*-manifest.txt 00:01:27.664 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:27.664 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:27.664 ++ uname 00:01:27.664 + [[ Linux == \L\i\n\u\x ]] 00:01:27.664 + sudo dmesg -T 00:01:27.923 + sudo dmesg --clear 00:01:27.923 + dmesg_pid=3245861 00:01:27.923 + [[ Fedora Linux == FreeBSD ]] 00:01:27.923 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:27.923 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:27.923 + sudo dmesg -Tw 00:01:27.923 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:27.923 + [[ -x /usr/src/fio-static/fio ]] 00:01:27.923 + export FIO_BIN=/usr/src/fio-static/fio 00:01:27.923 + FIO_BIN=/usr/src/fio-static/fio 00:01:27.923 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:27.923 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:27.923 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:27.923 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:27.923 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:27.923 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:27.923 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:27.923 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:27.923 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:27.923 Test configuration: 00:01:27.923 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:27.923 SPDK_TEST_NVMF=1 00:01:27.923 SPDK_TEST_NVME_CLI=1 00:01:27.923 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:27.923 SPDK_TEST_NVMF_NICS=e810 00:01:27.923 SPDK_RUN_UBSAN=1 00:01:27.923 NET_TYPE=phy 00:01:27.923 RUN_NIGHTLY=1 01:37:16 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:27.923 01:37:16 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:27.923 01:37:16 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:27.923 01:37:16 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:27.923 01:37:16 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:27.923 01:37:16 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.923 01:37:16 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.923 01:37:16 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.923 01:37:16 -- paths/export.sh@5 -- $ export PATH 00:01:27.923 01:37:16 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:27.923 01:37:16 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:27.923 01:37:16 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:27.923 01:37:16 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731976636.XXXXXX 00:01:27.923 01:37:16 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731976636.pQuElx 00:01:27.923 01:37:16 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:27.923 01:37:16 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:27.923 01:37:16 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:27.923 01:37:16 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:27.924 01:37:16 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:27.924 01:37:16 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:27.924 01:37:16 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:27.924 01:37:16 -- common/autotest_common.sh@10 -- $ set +x 00:01:27.924 01:37:16 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:27.924 01:37:16 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:27.924 01:37:16 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:27.924 01:37:16 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:27.924 01:37:16 -- spdk/autobuild.sh@16 -- $ date -u 00:01:27.924 Tue Nov 19 12:37:16 AM UTC 2024 00:01:27.924 01:37:16 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:27.924 LTS-67-gc13c99a5e 00:01:27.924 01:37:16 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:27.924 01:37:16 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:27.924 01:37:16 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:27.924 01:37:16 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:27.924 01:37:16 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:27.924 01:37:16 -- common/autotest_common.sh@10 -- $ set +x 00:01:27.924 ************************************ 00:01:27.924 START TEST ubsan 00:01:27.924 ************************************ 00:01:27.924 01:37:16 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:27.924 using ubsan 00:01:27.924 00:01:27.924 real 0m0.000s 00:01:27.924 user 0m0.000s 00:01:27.924 sys 0m0.000s 00:01:27.924 01:37:16 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:27.924 01:37:16 -- common/autotest_common.sh@10 -- $ set +x 00:01:27.924 ************************************ 00:01:27.924 END TEST ubsan 00:01:27.924 ************************************ 00:01:27.924 01:37:16 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:27.924 01:37:16 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:27.924 01:37:16 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:27.924 01:37:16 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:27.924 01:37:16 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:27.924 01:37:16 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:27.924 01:37:16 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:27.924 01:37:16 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:27.924 01:37:16 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:27.924 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:27.924 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:28.183 Using 'verbs' RDMA provider 00:01:38.743 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:48.724 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:48.724 Creating mk/config.mk...done. 00:01:48.724 Creating mk/cc.flags.mk...done. 00:01:48.724 Type 'make' to build. 00:01:48.724 01:37:36 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:48.724 01:37:36 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:48.724 01:37:36 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:48.724 01:37:36 -- common/autotest_common.sh@10 -- $ set +x 00:01:48.724 ************************************ 00:01:48.724 START TEST make 00:01:48.725 ************************************ 00:01:48.725 01:37:36 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:48.725 make[1]: Nothing to be done for 'all'. 00:01:56.872 The Meson build system 00:01:56.873 Version: 1.5.0 00:01:56.873 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:56.873 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:56.873 Build type: native build 00:01:56.873 Program cat found: YES (/usr/bin/cat) 00:01:56.873 Project name: DPDK 00:01:56.873 Project version: 23.11.0 00:01:56.873 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:56.873 C linker for the host machine: cc ld.bfd 2.40-14 00:01:56.873 Host machine cpu family: x86_64 00:01:56.873 Host machine cpu: x86_64 00:01:56.873 Message: ## Building in Developer Mode ## 00:01:56.873 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:56.873 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:56.873 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:56.873 Program python3 found: YES (/usr/bin/python3) 00:01:56.873 Program cat found: YES (/usr/bin/cat) 00:01:56.873 Compiler for C supports arguments -march=native: YES 00:01:56.873 Checking for size of "void *" : 8 00:01:56.873 Checking for size of "void *" : 8 (cached) 00:01:56.873 Library m found: YES 00:01:56.873 Library numa found: YES 00:01:56.873 Has header "numaif.h" : YES 00:01:56.873 Library fdt found: NO 00:01:56.873 Library execinfo found: NO 00:01:56.873 Has header "execinfo.h" : YES 00:01:56.873 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:56.873 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:56.873 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:56.873 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:56.873 Run-time dependency openssl found: YES 3.1.1 00:01:56.873 Run-time dependency libpcap found: YES 1.10.4 00:01:56.873 Has header "pcap.h" with dependency libpcap: YES 00:01:56.873 Compiler for C supports arguments -Wcast-qual: YES 00:01:56.873 Compiler for C supports arguments -Wdeprecated: YES 00:01:56.873 Compiler for C supports arguments -Wformat: YES 00:01:56.873 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:56.873 Compiler for C supports arguments -Wformat-security: NO 00:01:56.873 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:56.873 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:56.873 Compiler for C supports arguments -Wnested-externs: YES 00:01:56.873 Compiler for C supports arguments -Wold-style-definition: YES 00:01:56.873 Compiler for C supports arguments -Wpointer-arith: YES 00:01:56.873 Compiler for C supports arguments -Wsign-compare: YES 00:01:56.873 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:56.873 Compiler for C supports arguments -Wundef: YES 00:01:56.873 Compiler for C supports arguments -Wwrite-strings: YES 00:01:56.873 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:56.873 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:56.873 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:56.873 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:56.873 Program objdump found: YES (/usr/bin/objdump) 00:01:56.873 Compiler for C supports arguments -mavx512f: YES 00:01:56.873 Checking if "AVX512 checking" compiles: YES 00:01:56.873 Fetching value of define "__SSE4_2__" : 1 00:01:56.873 Fetching value of define "__AES__" : 1 00:01:56.873 Fetching value of define "__AVX__" : 1 00:01:56.873 Fetching value of define "__AVX2__" : (undefined) 00:01:56.873 Fetching value of define "__AVX512BW__" : (undefined) 00:01:56.873 Fetching value of define "__AVX512CD__" : (undefined) 00:01:56.873 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:56.873 Fetching value of define "__AVX512F__" : (undefined) 00:01:56.873 Fetching value of define "__AVX512VL__" : (undefined) 00:01:56.873 Fetching value of define "__PCLMUL__" : 1 00:01:56.873 Fetching value of define "__RDRND__" : 1 00:01:56.873 Fetching value of define "__RDSEED__" : (undefined) 00:01:56.873 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:56.873 Fetching value of define "__znver1__" : (undefined) 00:01:56.873 Fetching value of define "__znver2__" : (undefined) 00:01:56.873 Fetching value of define "__znver3__" : (undefined) 00:01:56.873 Fetching value of define "__znver4__" : (undefined) 00:01:56.873 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:56.873 Message: lib/log: Defining dependency "log" 00:01:56.873 Message: lib/kvargs: Defining dependency "kvargs" 00:01:56.873 Message: lib/telemetry: Defining dependency "telemetry" 00:01:56.873 Checking for function "getentropy" : NO 00:01:56.873 Message: lib/eal: Defining dependency "eal" 00:01:56.873 Message: lib/ring: Defining dependency "ring" 00:01:56.873 Message: lib/rcu: Defining dependency "rcu" 00:01:56.873 Message: lib/mempool: Defining dependency "mempool" 00:01:56.873 Message: lib/mbuf: Defining dependency "mbuf" 00:01:56.873 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:56.873 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:56.873 Compiler for C supports arguments -mpclmul: YES 00:01:56.873 Compiler for C supports arguments -maes: YES 00:01:56.873 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:56.873 Compiler for C supports arguments -mavx512bw: YES 00:01:56.873 Compiler for C supports arguments -mavx512dq: YES 00:01:56.873 Compiler for C supports arguments -mavx512vl: YES 00:01:56.873 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:56.873 Compiler for C supports arguments -mavx2: YES 00:01:56.873 Compiler for C supports arguments -mavx: YES 00:01:56.873 Message: lib/net: Defining dependency "net" 00:01:56.873 Message: lib/meter: Defining dependency "meter" 00:01:56.873 Message: lib/ethdev: Defining dependency "ethdev" 00:01:56.873 Message: lib/pci: Defining dependency "pci" 00:01:56.873 Message: lib/cmdline: Defining dependency "cmdline" 00:01:56.873 Message: lib/hash: Defining dependency "hash" 00:01:56.873 Message: lib/timer: Defining dependency "timer" 00:01:56.873 Message: lib/compressdev: Defining dependency "compressdev" 00:01:56.873 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:56.873 Message: lib/dmadev: Defining dependency "dmadev" 00:01:56.873 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:56.873 Message: lib/power: Defining dependency "power" 00:01:56.873 Message: lib/reorder: Defining dependency "reorder" 00:01:56.873 Message: lib/security: Defining dependency "security" 00:01:56.873 Has header "linux/userfaultfd.h" : YES 00:01:56.873 Has header "linux/vduse.h" : YES 00:01:56.873 Message: lib/vhost: Defining dependency "vhost" 00:01:56.873 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:56.873 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:56.873 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:56.873 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:56.873 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:56.873 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:56.873 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:56.873 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:56.873 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:56.873 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:56.873 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:56.873 Configuring doxy-api-html.conf using configuration 00:01:56.873 Configuring doxy-api-man.conf using configuration 00:01:56.873 Program mandb found: YES (/usr/bin/mandb) 00:01:56.873 Program sphinx-build found: NO 00:01:56.873 Configuring rte_build_config.h using configuration 00:01:56.873 Message: 00:01:56.873 ================= 00:01:56.873 Applications Enabled 00:01:56.873 ================= 00:01:56.873 00:01:56.873 apps: 00:01:56.873 00:01:56.873 00:01:56.873 Message: 00:01:56.873 ================= 00:01:56.873 Libraries Enabled 00:01:56.873 ================= 00:01:56.873 00:01:56.873 libs: 00:01:56.873 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:56.873 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:56.873 cryptodev, dmadev, power, reorder, security, vhost, 00:01:56.873 00:01:56.873 Message: 00:01:56.873 =============== 00:01:56.873 Drivers Enabled 00:01:56.873 =============== 00:01:56.873 00:01:56.873 common: 00:01:56.873 00:01:56.873 bus: 00:01:56.873 pci, vdev, 00:01:56.873 mempool: 00:01:56.873 ring, 00:01:56.873 dma: 00:01:56.873 00:01:56.873 net: 00:01:56.873 00:01:56.873 crypto: 00:01:56.873 00:01:56.873 compress: 00:01:56.873 00:01:56.873 vdpa: 00:01:56.873 00:01:56.873 00:01:56.873 Message: 00:01:56.873 ================= 00:01:56.873 Content Skipped 00:01:56.873 ================= 00:01:56.873 00:01:56.873 apps: 00:01:56.873 dumpcap: explicitly disabled via build config 00:01:56.873 graph: explicitly disabled via build config 00:01:56.873 pdump: explicitly disabled via build config 00:01:56.873 proc-info: explicitly disabled via build config 00:01:56.873 test-acl: explicitly disabled via build config 00:01:56.873 test-bbdev: explicitly disabled via build config 00:01:56.873 test-cmdline: explicitly disabled via build config 00:01:56.873 test-compress-perf: explicitly disabled via build config 00:01:56.873 test-crypto-perf: explicitly disabled via build config 00:01:56.873 test-dma-perf: explicitly disabled via build config 00:01:56.873 test-eventdev: explicitly disabled via build config 00:01:56.873 test-fib: explicitly disabled via build config 00:01:56.873 test-flow-perf: explicitly disabled via build config 00:01:56.873 test-gpudev: explicitly disabled via build config 00:01:56.873 test-mldev: explicitly disabled via build config 00:01:56.873 test-pipeline: explicitly disabled via build config 00:01:56.873 test-pmd: explicitly disabled via build config 00:01:56.873 test-regex: explicitly disabled via build config 00:01:56.873 test-sad: explicitly disabled via build config 00:01:56.873 test-security-perf: explicitly disabled via build config 00:01:56.874 00:01:56.874 libs: 00:01:56.874 metrics: explicitly disabled via build config 00:01:56.874 acl: explicitly disabled via build config 00:01:56.874 bbdev: explicitly disabled via build config 00:01:56.874 bitratestats: explicitly disabled via build config 00:01:56.874 bpf: explicitly disabled via build config 00:01:56.874 cfgfile: explicitly disabled via build config 00:01:56.874 distributor: explicitly disabled via build config 00:01:56.874 efd: explicitly disabled via build config 00:01:56.874 eventdev: explicitly disabled via build config 00:01:56.874 dispatcher: explicitly disabled via build config 00:01:56.874 gpudev: explicitly disabled via build config 00:01:56.874 gro: explicitly disabled via build config 00:01:56.874 gso: explicitly disabled via build config 00:01:56.874 ip_frag: explicitly disabled via build config 00:01:56.874 jobstats: explicitly disabled via build config 00:01:56.874 latencystats: explicitly disabled via build config 00:01:56.874 lpm: explicitly disabled via build config 00:01:56.874 member: explicitly disabled via build config 00:01:56.874 pcapng: explicitly disabled via build config 00:01:56.874 rawdev: explicitly disabled via build config 00:01:56.874 regexdev: explicitly disabled via build config 00:01:56.874 mldev: explicitly disabled via build config 00:01:56.874 rib: explicitly disabled via build config 00:01:56.874 sched: explicitly disabled via build config 00:01:56.874 stack: explicitly disabled via build config 00:01:56.874 ipsec: explicitly disabled via build config 00:01:56.874 pdcp: explicitly disabled via build config 00:01:56.874 fib: explicitly disabled via build config 00:01:56.874 port: explicitly disabled via build config 00:01:56.874 pdump: explicitly disabled via build config 00:01:56.874 table: explicitly disabled via build config 00:01:56.874 pipeline: explicitly disabled via build config 00:01:56.874 graph: explicitly disabled via build config 00:01:56.874 node: explicitly disabled via build config 00:01:56.874 00:01:56.874 drivers: 00:01:56.874 common/cpt: not in enabled drivers build config 00:01:56.874 common/dpaax: not in enabled drivers build config 00:01:56.874 common/iavf: not in enabled drivers build config 00:01:56.874 common/idpf: not in enabled drivers build config 00:01:56.874 common/mvep: not in enabled drivers build config 00:01:56.874 common/octeontx: not in enabled drivers build config 00:01:56.874 bus/auxiliary: not in enabled drivers build config 00:01:56.874 bus/cdx: not in enabled drivers build config 00:01:56.874 bus/dpaa: not in enabled drivers build config 00:01:56.874 bus/fslmc: not in enabled drivers build config 00:01:56.874 bus/ifpga: not in enabled drivers build config 00:01:56.874 bus/platform: not in enabled drivers build config 00:01:56.874 bus/vmbus: not in enabled drivers build config 00:01:56.874 common/cnxk: not in enabled drivers build config 00:01:56.874 common/mlx5: not in enabled drivers build config 00:01:56.874 common/nfp: not in enabled drivers build config 00:01:56.874 common/qat: not in enabled drivers build config 00:01:56.874 common/sfc_efx: not in enabled drivers build config 00:01:56.874 mempool/bucket: not in enabled drivers build config 00:01:56.874 mempool/cnxk: not in enabled drivers build config 00:01:56.874 mempool/dpaa: not in enabled drivers build config 00:01:56.874 mempool/dpaa2: not in enabled drivers build config 00:01:56.874 mempool/octeontx: not in enabled drivers build config 00:01:56.874 mempool/stack: not in enabled drivers build config 00:01:56.874 dma/cnxk: not in enabled drivers build config 00:01:56.874 dma/dpaa: not in enabled drivers build config 00:01:56.874 dma/dpaa2: not in enabled drivers build config 00:01:56.874 dma/hisilicon: not in enabled drivers build config 00:01:56.874 dma/idxd: not in enabled drivers build config 00:01:56.874 dma/ioat: not in enabled drivers build config 00:01:56.874 dma/skeleton: not in enabled drivers build config 00:01:56.874 net/af_packet: not in enabled drivers build config 00:01:56.874 net/af_xdp: not in enabled drivers build config 00:01:56.874 net/ark: not in enabled drivers build config 00:01:56.874 net/atlantic: not in enabled drivers build config 00:01:56.874 net/avp: not in enabled drivers build config 00:01:56.874 net/axgbe: not in enabled drivers build config 00:01:56.874 net/bnx2x: not in enabled drivers build config 00:01:56.874 net/bnxt: not in enabled drivers build config 00:01:56.874 net/bonding: not in enabled drivers build config 00:01:56.874 net/cnxk: not in enabled drivers build config 00:01:56.874 net/cpfl: not in enabled drivers build config 00:01:56.874 net/cxgbe: not in enabled drivers build config 00:01:56.874 net/dpaa: not in enabled drivers build config 00:01:56.874 net/dpaa2: not in enabled drivers build config 00:01:56.874 net/e1000: not in enabled drivers build config 00:01:56.874 net/ena: not in enabled drivers build config 00:01:56.874 net/enetc: not in enabled drivers build config 00:01:56.874 net/enetfec: not in enabled drivers build config 00:01:56.874 net/enic: not in enabled drivers build config 00:01:56.874 net/failsafe: not in enabled drivers build config 00:01:56.874 net/fm10k: not in enabled drivers build config 00:01:56.874 net/gve: not in enabled drivers build config 00:01:56.874 net/hinic: not in enabled drivers build config 00:01:56.874 net/hns3: not in enabled drivers build config 00:01:56.874 net/i40e: not in enabled drivers build config 00:01:56.874 net/iavf: not in enabled drivers build config 00:01:56.874 net/ice: not in enabled drivers build config 00:01:56.874 net/idpf: not in enabled drivers build config 00:01:56.874 net/igc: not in enabled drivers build config 00:01:56.874 net/ionic: not in enabled drivers build config 00:01:56.874 net/ipn3ke: not in enabled drivers build config 00:01:56.874 net/ixgbe: not in enabled drivers build config 00:01:56.874 net/mana: not in enabled drivers build config 00:01:56.874 net/memif: not in enabled drivers build config 00:01:56.874 net/mlx4: not in enabled drivers build config 00:01:56.874 net/mlx5: not in enabled drivers build config 00:01:56.874 net/mvneta: not in enabled drivers build config 00:01:56.874 net/mvpp2: not in enabled drivers build config 00:01:56.874 net/netvsc: not in enabled drivers build config 00:01:56.874 net/nfb: not in enabled drivers build config 00:01:56.874 net/nfp: not in enabled drivers build config 00:01:56.874 net/ngbe: not in enabled drivers build config 00:01:56.874 net/null: not in enabled drivers build config 00:01:56.874 net/octeontx: not in enabled drivers build config 00:01:56.874 net/octeon_ep: not in enabled drivers build config 00:01:56.874 net/pcap: not in enabled drivers build config 00:01:56.874 net/pfe: not in enabled drivers build config 00:01:56.874 net/qede: not in enabled drivers build config 00:01:56.874 net/ring: not in enabled drivers build config 00:01:56.874 net/sfc: not in enabled drivers build config 00:01:56.874 net/softnic: not in enabled drivers build config 00:01:56.874 net/tap: not in enabled drivers build config 00:01:56.874 net/thunderx: not in enabled drivers build config 00:01:56.874 net/txgbe: not in enabled drivers build config 00:01:56.874 net/vdev_netvsc: not in enabled drivers build config 00:01:56.874 net/vhost: not in enabled drivers build config 00:01:56.874 net/virtio: not in enabled drivers build config 00:01:56.874 net/vmxnet3: not in enabled drivers build config 00:01:56.874 raw/*: missing internal dependency, "rawdev" 00:01:56.874 crypto/armv8: not in enabled drivers build config 00:01:56.874 crypto/bcmfs: not in enabled drivers build config 00:01:56.874 crypto/caam_jr: not in enabled drivers build config 00:01:56.874 crypto/ccp: not in enabled drivers build config 00:01:56.874 crypto/cnxk: not in enabled drivers build config 00:01:56.874 crypto/dpaa_sec: not in enabled drivers build config 00:01:56.874 crypto/dpaa2_sec: not in enabled drivers build config 00:01:56.874 crypto/ipsec_mb: not in enabled drivers build config 00:01:56.874 crypto/mlx5: not in enabled drivers build config 00:01:56.874 crypto/mvsam: not in enabled drivers build config 00:01:56.874 crypto/nitrox: not in enabled drivers build config 00:01:56.874 crypto/null: not in enabled drivers build config 00:01:56.874 crypto/octeontx: not in enabled drivers build config 00:01:56.874 crypto/openssl: not in enabled drivers build config 00:01:56.874 crypto/scheduler: not in enabled drivers build config 00:01:56.874 crypto/uadk: not in enabled drivers build config 00:01:56.874 crypto/virtio: not in enabled drivers build config 00:01:56.874 compress/isal: not in enabled drivers build config 00:01:56.874 compress/mlx5: not in enabled drivers build config 00:01:56.874 compress/octeontx: not in enabled drivers build config 00:01:56.874 compress/zlib: not in enabled drivers build config 00:01:56.874 regex/*: missing internal dependency, "regexdev" 00:01:56.874 ml/*: missing internal dependency, "mldev" 00:01:56.874 vdpa/ifc: not in enabled drivers build config 00:01:56.874 vdpa/mlx5: not in enabled drivers build config 00:01:56.874 vdpa/nfp: not in enabled drivers build config 00:01:56.874 vdpa/sfc: not in enabled drivers build config 00:01:56.874 event/*: missing internal dependency, "eventdev" 00:01:56.874 baseband/*: missing internal dependency, "bbdev" 00:01:56.874 gpu/*: missing internal dependency, "gpudev" 00:01:56.874 00:01:56.874 00:01:57.133 Build targets in project: 85 00:01:57.133 00:01:57.133 DPDK 23.11.0 00:01:57.133 00:01:57.133 User defined options 00:01:57.133 buildtype : debug 00:01:57.133 default_library : shared 00:01:57.133 libdir : lib 00:01:57.133 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:57.133 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:57.133 c_link_args : 00:01:57.133 cpu_instruction_set: native 00:01:57.133 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:57.133 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:57.133 enable_docs : false 00:01:57.133 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:57.133 enable_kmods : false 00:01:57.133 tests : false 00:01:57.133 00:01:57.133 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:57.706 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:57.706 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:57.706 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:57.706 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:57.706 [4/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:57.706 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:57.706 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:57.706 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:57.706 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:57.706 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:57.706 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:57.706 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:57.706 [12/265] Linking static target lib/librte_kvargs.a 00:01:57.706 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:57.706 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:57.706 [15/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:57.706 [16/265] Linking static target lib/librte_log.a 00:01:57.706 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:57.706 [18/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:57.706 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:57.706 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:57.965 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:58.229 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.492 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:58.492 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:58.492 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:58.492 [26/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:58.492 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:58.492 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:58.492 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:58.492 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:58.492 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:58.492 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:58.492 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:58.492 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:58.492 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:58.492 [36/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:58.492 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:58.492 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:58.492 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:58.492 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:58.492 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:58.492 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:58.493 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:58.493 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:58.493 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:58.493 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:58.493 [47/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:58.493 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:58.493 [49/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:58.763 [50/265] Linking static target lib/librte_telemetry.a 00:01:58.763 [51/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:58.763 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:58.763 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:58.763 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:58.763 [55/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:58.763 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:58.763 [57/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:58.763 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:58.763 [59/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:58.763 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:58.763 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:58.763 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:58.763 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:58.763 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:58.763 [65/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:58.763 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:58.763 [67/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:58.763 [68/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.763 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:59.048 [70/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:59.048 [71/265] Linking static target lib/librte_pci.a 00:01:59.048 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:59.049 [73/265] Linking target lib/librte_log.so.24.0 00:01:59.049 [74/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:59.049 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:59.049 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:59.049 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:59.049 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:59.049 [79/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:59.049 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:59.049 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:59.327 [82/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:59.327 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:59.327 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:59.327 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:59.327 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:59.327 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:59.327 [88/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:59.327 [89/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:59.327 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:59.327 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:59.327 [92/265] Linking target lib/librte_kvargs.so.24.0 00:01:59.327 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:59.603 [94/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.603 [95/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:59.603 [96/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.603 [97/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:59.603 [98/265] Linking static target lib/librte_eal.a 00:01:59.603 [99/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:59.603 [100/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:59.603 [101/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:59.603 [102/265] Linking static target lib/librte_ring.a 00:01:59.603 [103/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:59.603 [104/265] Linking static target lib/librte_meter.a 00:01:59.603 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:59.603 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:59.603 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:59.603 [108/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:59.603 [109/265] Linking target lib/librte_telemetry.so.24.0 00:01:59.603 [110/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:59.603 [111/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:59.603 [112/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:59.603 [113/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:59.603 [114/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:59.868 [115/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:59.868 [116/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:59.868 [117/265] Linking static target lib/librte_rcu.a 00:01:59.868 [118/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:59.868 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:59.868 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:59.868 [121/265] Linking static target lib/librte_mempool.a 00:01:59.868 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:59.868 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:59.868 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:59.868 [125/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:59.868 [126/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:59.868 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:59.868 [128/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:59.868 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:59.868 [130/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:59.868 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:00.130 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:00.130 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:00.130 [134/265] Linking static target lib/librte_cmdline.a 00:02:00.130 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:00.130 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:00.130 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.130 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:00.130 [139/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:00.130 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:00.393 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:00.393 [142/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:00.393 [143/265] Linking static target lib/librte_net.a 00:02:00.393 [144/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:00.393 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:00.393 [146/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.393 [147/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:00.393 [148/265] Linking static target lib/librte_timer.a 00:02:00.393 [149/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:00.393 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.393 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:00.651 [152/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:00.651 [153/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:00.651 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:00.651 [155/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:00.651 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:00.651 [157/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:00.651 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:00.651 [159/265] Linking static target lib/librte_dmadev.a 00:02:00.651 [160/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.651 [161/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:00.651 [162/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.909 [163/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:00.909 [164/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:00.909 [165/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.909 [166/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:00.909 [167/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:00.909 [168/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:00.909 [169/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:00.909 [170/265] Linking static target lib/librte_hash.a 00:02:00.909 [171/265] Linking static target lib/librte_power.a 00:02:00.909 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:00.910 [173/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:00.910 [174/265] Linking static target lib/librte_compressdev.a 00:02:00.910 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:00.910 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:00.910 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:00.910 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:00.910 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:01.168 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:01.168 [181/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.168 [182/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.168 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:01.168 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:01.168 [185/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:01.168 [186/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:01.168 [187/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:01.168 [188/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:01.168 [189/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:01.168 [190/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:01.168 [191/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:01.168 [192/265] Linking static target lib/librte_reorder.a 00:02:01.426 [193/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:01.426 [194/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:01.426 [195/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:01.426 [196/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.426 [197/265] Linking static target lib/librte_mbuf.a 00:02:01.426 [198/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.426 [199/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.426 [200/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:01.426 [201/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:01.426 [202/265] Linking static target lib/librte_security.a 00:02:01.426 [203/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:01.426 [204/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:01.426 [205/265] Linking static target drivers/librte_bus_vdev.a 00:02:01.426 [206/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:01.426 [207/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:01.426 [208/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:01.426 [209/265] Linking static target drivers/librte_mempool_ring.a 00:02:01.426 [210/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:01.426 [211/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:01.426 [212/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:01.426 [213/265] Linking static target drivers/librte_bus_pci.a 00:02:01.685 [214/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.685 [215/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:01.685 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:01.685 [217/265] Linking static target lib/librte_ethdev.a 00:02:01.685 [218/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.685 [219/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:01.685 [220/265] Linking static target lib/librte_cryptodev.a 00:02:01.685 [221/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.685 [222/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.943 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.877 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.253 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:05.629 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.629 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.629 [228/265] Linking target lib/librte_eal.so.24.0 00:02:05.888 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:05.888 [230/265] Linking target lib/librte_meter.so.24.0 00:02:05.888 [231/265] Linking target lib/librte_timer.so.24.0 00:02:05.888 [232/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:05.888 [233/265] Linking target lib/librte_ring.so.24.0 00:02:05.888 [234/265] Linking target lib/librte_pci.so.24.0 00:02:05.888 [235/265] Linking target lib/librte_dmadev.so.24.0 00:02:05.888 [236/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:05.888 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:05.888 [238/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:05.888 [239/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:05.888 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:05.888 [241/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:05.888 [242/265] Linking target lib/librte_rcu.so.24.0 00:02:05.888 [243/265] Linking target lib/librte_mempool.so.24.0 00:02:06.146 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:06.146 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:06.146 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:06.146 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:06.404 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:06.404 [249/265] Linking target lib/librte_reorder.so.24.0 00:02:06.404 [250/265] Linking target lib/librte_compressdev.so.24.0 00:02:06.404 [251/265] Linking target lib/librte_net.so.24.0 00:02:06.404 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:06.404 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:06.404 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:06.404 [255/265] Linking target lib/librte_hash.so.24.0 00:02:06.404 [256/265] Linking target lib/librte_security.so.24.0 00:02:06.404 [257/265] Linking target lib/librte_cmdline.so.24.0 00:02:06.404 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:06.663 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:06.663 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:06.663 [261/265] Linking target lib/librte_power.so.24.0 00:02:09.950 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:09.950 [263/265] Linking static target lib/librte_vhost.a 00:02:10.517 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:10.517 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:10.517 INFO: autodetecting backend as ninja 00:02:10.517 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:11.450 CC lib/log/log.o 00:02:11.450 CC lib/ut_mock/mock.o 00:02:11.450 CC lib/log/log_flags.o 00:02:11.450 CC lib/log/log_deprecated.o 00:02:11.450 CC lib/ut/ut.o 00:02:11.450 LIB libspdk_ut_mock.a 00:02:11.450 SO libspdk_ut_mock.so.5.0 00:02:11.709 LIB libspdk_log.a 00:02:11.709 LIB libspdk_ut.a 00:02:11.709 SO libspdk_log.so.6.1 00:02:11.709 SO libspdk_ut.so.1.0 00:02:11.709 SYMLINK libspdk_ut_mock.so 00:02:11.709 SYMLINK libspdk_ut.so 00:02:11.709 SYMLINK libspdk_log.so 00:02:11.709 CC lib/dma/dma.o 00:02:11.709 CXX lib/trace_parser/trace.o 00:02:11.709 CC lib/ioat/ioat.o 00:02:11.709 CC lib/util/base64.o 00:02:11.709 CC lib/util/bit_array.o 00:02:11.709 CC lib/util/cpuset.o 00:02:11.709 CC lib/util/crc16.o 00:02:11.709 CC lib/util/crc32.o 00:02:11.709 CC lib/util/crc32c.o 00:02:11.709 CC lib/util/crc32_ieee.o 00:02:11.709 CC lib/util/crc64.o 00:02:11.709 CC lib/util/dif.o 00:02:11.709 CC lib/util/fd.o 00:02:11.709 CC lib/util/file.o 00:02:11.709 CC lib/util/hexlify.o 00:02:11.709 CC lib/util/iov.o 00:02:11.709 CC lib/util/math.o 00:02:11.709 CC lib/util/pipe.o 00:02:11.709 CC lib/util/strerror_tls.o 00:02:11.709 CC lib/util/string.o 00:02:11.709 CC lib/util/uuid.o 00:02:11.709 CC lib/util/fd_group.o 00:02:11.709 CC lib/util/xor.o 00:02:11.709 CC lib/util/zipf.o 00:02:11.709 CC lib/vfio_user/host/vfio_user_pci.o 00:02:11.709 CC lib/vfio_user/host/vfio_user.o 00:02:11.967 LIB libspdk_dma.a 00:02:11.967 SO libspdk_dma.so.3.0 00:02:11.967 SYMLINK libspdk_dma.so 00:02:11.967 LIB libspdk_ioat.a 00:02:11.967 SO libspdk_ioat.so.6.0 00:02:12.226 SYMLINK libspdk_ioat.so 00:02:12.226 LIB libspdk_vfio_user.a 00:02:12.226 SO libspdk_vfio_user.so.4.0 00:02:12.226 SYMLINK libspdk_vfio_user.so 00:02:12.226 LIB libspdk_util.a 00:02:12.485 SO libspdk_util.so.8.0 00:02:12.485 SYMLINK libspdk_util.so 00:02:12.485 CC lib/json/json_parse.o 00:02:12.485 CC lib/rdma/common.o 00:02:12.485 CC lib/json/json_util.o 00:02:12.485 CC lib/env_dpdk/env.o 00:02:12.485 CC lib/rdma/rdma_verbs.o 00:02:12.485 CC lib/idxd/idxd.o 00:02:12.485 CC lib/vmd/vmd.o 00:02:12.485 CC lib/json/json_write.o 00:02:12.485 CC lib/conf/conf.o 00:02:12.485 CC lib/env_dpdk/memory.o 00:02:12.485 CC lib/idxd/idxd_user.o 00:02:12.485 CC lib/vmd/led.o 00:02:12.485 CC lib/env_dpdk/pci.o 00:02:12.485 CC lib/idxd/idxd_kernel.o 00:02:12.485 CC lib/env_dpdk/init.o 00:02:12.485 CC lib/env_dpdk/threads.o 00:02:12.485 CC lib/env_dpdk/pci_ioat.o 00:02:12.485 CC lib/env_dpdk/pci_virtio.o 00:02:12.485 CC lib/env_dpdk/pci_vmd.o 00:02:12.485 CC lib/env_dpdk/pci_idxd.o 00:02:12.485 CC lib/env_dpdk/pci_event.o 00:02:12.485 CC lib/env_dpdk/sigbus_handler.o 00:02:12.485 CC lib/env_dpdk/pci_dpdk.o 00:02:12.485 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:12.485 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:12.743 LIB libspdk_trace_parser.a 00:02:12.743 SO libspdk_trace_parser.so.4.0 00:02:12.743 SYMLINK libspdk_trace_parser.so 00:02:12.743 LIB libspdk_conf.a 00:02:12.743 SO libspdk_conf.so.5.0 00:02:13.001 LIB libspdk_rdma.a 00:02:13.001 SYMLINK libspdk_conf.so 00:02:13.001 SO libspdk_rdma.so.5.0 00:02:13.001 LIB libspdk_json.a 00:02:13.001 SYMLINK libspdk_rdma.so 00:02:13.001 SO libspdk_json.so.5.1 00:02:13.001 SYMLINK libspdk_json.so 00:02:13.259 CC lib/jsonrpc/jsonrpc_server.o 00:02:13.259 LIB libspdk_idxd.a 00:02:13.259 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:13.259 CC lib/jsonrpc/jsonrpc_client.o 00:02:13.259 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:13.259 SO libspdk_idxd.so.11.0 00:02:13.259 SYMLINK libspdk_idxd.so 00:02:13.259 LIB libspdk_vmd.a 00:02:13.259 SO libspdk_vmd.so.5.0 00:02:13.259 SYMLINK libspdk_vmd.so 00:02:13.517 LIB libspdk_jsonrpc.a 00:02:13.517 SO libspdk_jsonrpc.so.5.1 00:02:13.517 SYMLINK libspdk_jsonrpc.so 00:02:13.517 CC lib/rpc/rpc.o 00:02:13.776 LIB libspdk_rpc.a 00:02:13.776 SO libspdk_rpc.so.5.0 00:02:13.776 SYMLINK libspdk_rpc.so 00:02:14.034 CC lib/trace/trace.o 00:02:14.034 CC lib/sock/sock.o 00:02:14.034 CC lib/sock/sock_rpc.o 00:02:14.034 CC lib/trace/trace_flags.o 00:02:14.034 CC lib/trace/trace_rpc.o 00:02:14.034 CC lib/notify/notify.o 00:02:14.034 CC lib/notify/notify_rpc.o 00:02:14.034 LIB libspdk_notify.a 00:02:14.292 SO libspdk_notify.so.5.0 00:02:14.292 SYMLINK libspdk_notify.so 00:02:14.292 LIB libspdk_trace.a 00:02:14.292 SO libspdk_trace.so.9.0 00:02:14.292 SYMLINK libspdk_trace.so 00:02:14.292 LIB libspdk_sock.a 00:02:14.292 SO libspdk_sock.so.8.0 00:02:14.292 CC lib/thread/thread.o 00:02:14.292 CC lib/thread/iobuf.o 00:02:14.551 SYMLINK libspdk_sock.so 00:02:14.551 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:14.551 CC lib/nvme/nvme_ctrlr.o 00:02:14.551 CC lib/nvme/nvme_fabric.o 00:02:14.551 CC lib/nvme/nvme_ns_cmd.o 00:02:14.551 CC lib/nvme/nvme_ns.o 00:02:14.551 CC lib/nvme/nvme_pcie_common.o 00:02:14.551 CC lib/nvme/nvme_pcie.o 00:02:14.551 CC lib/nvme/nvme_qpair.o 00:02:14.551 CC lib/nvme/nvme.o 00:02:14.551 CC lib/nvme/nvme_quirks.o 00:02:14.551 CC lib/nvme/nvme_transport.o 00:02:14.551 CC lib/nvme/nvme_discovery.o 00:02:14.551 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:14.551 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:14.551 CC lib/nvme/nvme_tcp.o 00:02:14.551 CC lib/nvme/nvme_opal.o 00:02:14.551 CC lib/nvme/nvme_io_msg.o 00:02:14.551 CC lib/nvme/nvme_poll_group.o 00:02:14.551 CC lib/nvme/nvme_zns.o 00:02:14.551 CC lib/nvme/nvme_cuse.o 00:02:14.551 CC lib/nvme/nvme_vfio_user.o 00:02:14.551 CC lib/nvme/nvme_rdma.o 00:02:14.551 LIB libspdk_env_dpdk.a 00:02:14.809 SO libspdk_env_dpdk.so.13.0 00:02:14.810 SYMLINK libspdk_env_dpdk.so 00:02:16.185 LIB libspdk_thread.a 00:02:16.185 SO libspdk_thread.so.9.0 00:02:16.185 SYMLINK libspdk_thread.so 00:02:16.185 CC lib/virtio/virtio.o 00:02:16.185 CC lib/accel/accel.o 00:02:16.185 CC lib/accel/accel_rpc.o 00:02:16.185 CC lib/virtio/virtio_vhost_user.o 00:02:16.185 CC lib/accel/accel_sw.o 00:02:16.185 CC lib/virtio/virtio_vfio_user.o 00:02:16.185 CC lib/virtio/virtio_pci.o 00:02:16.185 CC lib/init/json_config.o 00:02:16.185 CC lib/blob/blobstore.o 00:02:16.185 CC lib/init/subsystem.o 00:02:16.185 CC lib/blob/request.o 00:02:16.185 CC lib/init/subsystem_rpc.o 00:02:16.185 CC lib/blob/zeroes.o 00:02:16.185 CC lib/init/rpc.o 00:02:16.185 CC lib/blob/blob_bs_dev.o 00:02:16.444 LIB libspdk_init.a 00:02:16.444 SO libspdk_init.so.4.0 00:02:16.444 SYMLINK libspdk_init.so 00:02:16.444 LIB libspdk_virtio.a 00:02:16.444 SO libspdk_virtio.so.6.0 00:02:16.702 SYMLINK libspdk_virtio.so 00:02:16.702 CC lib/event/app.o 00:02:16.702 CC lib/event/reactor.o 00:02:16.702 CC lib/event/log_rpc.o 00:02:16.702 CC lib/event/app_rpc.o 00:02:16.702 CC lib/event/scheduler_static.o 00:02:16.960 LIB libspdk_nvme.a 00:02:16.960 SO libspdk_nvme.so.12.0 00:02:16.960 LIB libspdk_event.a 00:02:16.960 SO libspdk_event.so.12.0 00:02:17.218 SYMLINK libspdk_event.so 00:02:17.218 SYMLINK libspdk_nvme.so 00:02:17.218 LIB libspdk_accel.a 00:02:17.218 SO libspdk_accel.so.14.0 00:02:17.218 SYMLINK libspdk_accel.so 00:02:17.476 CC lib/bdev/bdev.o 00:02:17.476 CC lib/bdev/bdev_rpc.o 00:02:17.476 CC lib/bdev/bdev_zone.o 00:02:17.476 CC lib/bdev/part.o 00:02:17.476 CC lib/bdev/scsi_nvme.o 00:02:18.847 LIB libspdk_blob.a 00:02:18.847 SO libspdk_blob.so.10.1 00:02:19.105 SYMLINK libspdk_blob.so 00:02:19.105 CC lib/blobfs/blobfs.o 00:02:19.105 CC lib/blobfs/tree.o 00:02:19.105 CC lib/lvol/lvol.o 00:02:20.040 LIB libspdk_blobfs.a 00:02:20.040 SO libspdk_blobfs.so.9.0 00:02:20.040 LIB libspdk_lvol.a 00:02:20.040 SYMLINK libspdk_blobfs.so 00:02:20.040 SO libspdk_lvol.so.9.1 00:02:20.040 LIB libspdk_bdev.a 00:02:20.040 SYMLINK libspdk_lvol.so 00:02:20.040 SO libspdk_bdev.so.14.0 00:02:20.040 SYMLINK libspdk_bdev.so 00:02:20.306 CC lib/ublk/ublk.o 00:02:20.306 CC lib/nvmf/ctrlr.o 00:02:20.306 CC lib/ublk/ublk_rpc.o 00:02:20.306 CC lib/nvmf/ctrlr_discovery.o 00:02:20.306 CC lib/ftl/ftl_core.o 00:02:20.306 CC lib/nbd/nbd.o 00:02:20.306 CC lib/nvmf/ctrlr_bdev.o 00:02:20.306 CC lib/ftl/ftl_init.o 00:02:20.306 CC lib/scsi/dev.o 00:02:20.306 CC lib/nvmf/subsystem.o 00:02:20.306 CC lib/nbd/nbd_rpc.o 00:02:20.306 CC lib/scsi/lun.o 00:02:20.306 CC lib/nvmf/nvmf.o 00:02:20.306 CC lib/ftl/ftl_layout.o 00:02:20.306 CC lib/nvmf/nvmf_rpc.o 00:02:20.306 CC lib/scsi/port.o 00:02:20.306 CC lib/ftl/ftl_debug.o 00:02:20.306 CC lib/nvmf/transport.o 00:02:20.306 CC lib/ftl/ftl_io.o 00:02:20.306 CC lib/scsi/scsi.o 00:02:20.306 CC lib/nvmf/tcp.o 00:02:20.306 CC lib/scsi/scsi_bdev.o 00:02:20.306 CC lib/ftl/ftl_sb.o 00:02:20.306 CC lib/nvmf/rdma.o 00:02:20.306 CC lib/scsi/scsi_pr.o 00:02:20.306 CC lib/ftl/ftl_l2p.o 00:02:20.306 CC lib/ftl/ftl_l2p_flat.o 00:02:20.306 CC lib/scsi/scsi_rpc.o 00:02:20.306 CC lib/ftl/ftl_nv_cache.o 00:02:20.306 CC lib/scsi/task.o 00:02:20.306 CC lib/ftl/ftl_band.o 00:02:20.306 CC lib/ftl/ftl_band_ops.o 00:02:20.306 CC lib/ftl/ftl_writer.o 00:02:20.306 CC lib/ftl/ftl_rq.o 00:02:20.306 CC lib/ftl/ftl_reloc.o 00:02:20.306 CC lib/ftl/ftl_l2p_cache.o 00:02:20.306 CC lib/ftl/ftl_p2l.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:20.306 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:20.573 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:20.573 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:20.573 CC lib/ftl/utils/ftl_conf.o 00:02:20.573 CC lib/ftl/utils/ftl_md.o 00:02:20.573 CC lib/ftl/utils/ftl_mempool.o 00:02:20.573 CC lib/ftl/utils/ftl_bitmap.o 00:02:20.573 CC lib/ftl/utils/ftl_property.o 00:02:20.573 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:20.573 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:20.573 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:20.573 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:20.573 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:20.573 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:20.573 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:20.573 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:20.573 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:20.573 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:20.573 CC lib/ftl/base/ftl_base_dev.o 00:02:20.573 CC lib/ftl/base/ftl_base_bdev.o 00:02:20.831 CC lib/ftl/ftl_trace.o 00:02:21.089 LIB libspdk_nbd.a 00:02:21.089 SO libspdk_nbd.so.6.0 00:02:21.089 LIB libspdk_scsi.a 00:02:21.089 SYMLINK libspdk_nbd.so 00:02:21.089 SO libspdk_scsi.so.8.0 00:02:21.089 SYMLINK libspdk_scsi.so 00:02:21.347 LIB libspdk_ublk.a 00:02:21.347 SO libspdk_ublk.so.2.0 00:02:21.347 CC lib/vhost/vhost.o 00:02:21.347 CC lib/iscsi/conn.o 00:02:21.347 CC lib/iscsi/init_grp.o 00:02:21.347 CC lib/vhost/vhost_rpc.o 00:02:21.347 CC lib/iscsi/iscsi.o 00:02:21.347 CC lib/vhost/vhost_scsi.o 00:02:21.347 CC lib/iscsi/md5.o 00:02:21.347 CC lib/vhost/vhost_blk.o 00:02:21.347 CC lib/iscsi/param.o 00:02:21.347 CC lib/iscsi/portal_grp.o 00:02:21.347 CC lib/vhost/rte_vhost_user.o 00:02:21.347 CC lib/iscsi/tgt_node.o 00:02:21.347 CC lib/iscsi/iscsi_subsystem.o 00:02:21.347 CC lib/iscsi/iscsi_rpc.o 00:02:21.347 CC lib/iscsi/task.o 00:02:21.347 SYMLINK libspdk_ublk.so 00:02:21.605 LIB libspdk_ftl.a 00:02:21.863 SO libspdk_ftl.so.8.0 00:02:21.863 SYMLINK libspdk_ftl.so 00:02:22.429 LIB libspdk_vhost.a 00:02:22.429 SO libspdk_vhost.so.7.1 00:02:22.688 SYMLINK libspdk_vhost.so 00:02:22.688 LIB libspdk_nvmf.a 00:02:22.688 LIB libspdk_iscsi.a 00:02:22.688 SO libspdk_nvmf.so.17.0 00:02:22.688 SO libspdk_iscsi.so.7.0 00:02:22.946 SYMLINK libspdk_nvmf.so 00:02:22.946 SYMLINK libspdk_iscsi.so 00:02:23.205 CC module/env_dpdk/env_dpdk_rpc.o 00:02:23.205 CC module/blob/bdev/blob_bdev.o 00:02:23.205 CC module/sock/posix/posix.o 00:02:23.205 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:23.205 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:23.205 CC module/accel/ioat/accel_ioat.o 00:02:23.205 CC module/accel/error/accel_error.o 00:02:23.205 CC module/accel/dsa/accel_dsa.o 00:02:23.205 CC module/scheduler/gscheduler/gscheduler.o 00:02:23.205 CC module/accel/iaa/accel_iaa.o 00:02:23.205 CC module/accel/ioat/accel_ioat_rpc.o 00:02:23.205 CC module/accel/error/accel_error_rpc.o 00:02:23.205 CC module/accel/iaa/accel_iaa_rpc.o 00:02:23.205 CC module/accel/dsa/accel_dsa_rpc.o 00:02:23.205 LIB libspdk_env_dpdk_rpc.a 00:02:23.205 SO libspdk_env_dpdk_rpc.so.5.0 00:02:23.205 SYMLINK libspdk_env_dpdk_rpc.so 00:02:23.205 LIB libspdk_scheduler_gscheduler.a 00:02:23.205 LIB libspdk_scheduler_dpdk_governor.a 00:02:23.205 SO libspdk_scheduler_gscheduler.so.3.0 00:02:23.205 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:23.463 LIB libspdk_accel_error.a 00:02:23.463 LIB libspdk_accel_ioat.a 00:02:23.463 LIB libspdk_scheduler_dynamic.a 00:02:23.463 LIB libspdk_accel_iaa.a 00:02:23.463 SO libspdk_accel_error.so.1.0 00:02:23.463 SO libspdk_accel_ioat.so.5.0 00:02:23.463 SO libspdk_scheduler_dynamic.so.3.0 00:02:23.463 SYMLINK libspdk_scheduler_gscheduler.so 00:02:23.463 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:23.463 SO libspdk_accel_iaa.so.2.0 00:02:23.463 LIB libspdk_accel_dsa.a 00:02:23.463 SYMLINK libspdk_accel_error.so 00:02:23.463 SYMLINK libspdk_scheduler_dynamic.so 00:02:23.463 SYMLINK libspdk_accel_ioat.so 00:02:23.463 SO libspdk_accel_dsa.so.4.0 00:02:23.463 LIB libspdk_blob_bdev.a 00:02:23.463 SYMLINK libspdk_accel_iaa.so 00:02:23.463 SO libspdk_blob_bdev.so.10.1 00:02:23.463 SYMLINK libspdk_accel_dsa.so 00:02:23.463 SYMLINK libspdk_blob_bdev.so 00:02:23.722 CC module/blobfs/bdev/blobfs_bdev.o 00:02:23.723 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:23.723 CC module/bdev/lvol/vbdev_lvol.o 00:02:23.723 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:23.723 CC module/bdev/error/vbdev_error.o 00:02:23.723 CC module/bdev/malloc/bdev_malloc.o 00:02:23.723 CC module/bdev/delay/vbdev_delay.o 00:02:23.723 CC module/bdev/null/bdev_null.o 00:02:23.723 CC module/bdev/nvme/bdev_nvme.o 00:02:23.723 CC module/bdev/error/vbdev_error_rpc.o 00:02:23.723 CC module/bdev/split/vbdev_split.o 00:02:23.723 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:23.723 CC module/bdev/null/bdev_null_rpc.o 00:02:23.723 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:23.723 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:23.723 CC module/bdev/split/vbdev_split_rpc.o 00:02:23.723 CC module/bdev/raid/bdev_raid.o 00:02:23.723 CC module/bdev/raid/bdev_raid_rpc.o 00:02:23.723 CC module/bdev/nvme/nvme_rpc.o 00:02:23.723 CC module/bdev/gpt/gpt.o 00:02:23.723 CC module/bdev/nvme/bdev_mdns_client.o 00:02:23.723 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:23.723 CC module/bdev/aio/bdev_aio.o 00:02:23.723 CC module/bdev/gpt/vbdev_gpt.o 00:02:23.723 CC module/bdev/raid/bdev_raid_sb.o 00:02:23.723 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:23.723 CC module/bdev/nvme/vbdev_opal.o 00:02:23.723 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:23.723 CC module/bdev/passthru/vbdev_passthru.o 00:02:23.723 CC module/bdev/aio/bdev_aio_rpc.o 00:02:23.723 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:23.723 CC module/bdev/raid/raid0.o 00:02:23.723 CC module/bdev/raid/concat.o 00:02:23.723 CC module/bdev/raid/raid1.o 00:02:23.723 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:23.723 CC module/bdev/ftl/bdev_ftl.o 00:02:23.723 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:23.723 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:23.723 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:23.723 CC module/bdev/iscsi/bdev_iscsi.o 00:02:23.723 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:23.723 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:23.981 LIB libspdk_sock_posix.a 00:02:23.981 LIB libspdk_blobfs_bdev.a 00:02:23.981 SO libspdk_sock_posix.so.5.0 00:02:23.981 SO libspdk_blobfs_bdev.so.5.0 00:02:23.981 LIB libspdk_bdev_ftl.a 00:02:23.981 SYMLINK libspdk_blobfs_bdev.so 00:02:23.981 SYMLINK libspdk_sock_posix.so 00:02:23.981 SO libspdk_bdev_ftl.so.5.0 00:02:24.240 LIB libspdk_bdev_split.a 00:02:24.240 LIB libspdk_bdev_gpt.a 00:02:24.240 LIB libspdk_bdev_error.a 00:02:24.240 SO libspdk_bdev_split.so.5.0 00:02:24.240 SO libspdk_bdev_gpt.so.5.0 00:02:24.240 LIB libspdk_bdev_passthru.a 00:02:24.240 LIB libspdk_bdev_null.a 00:02:24.240 SYMLINK libspdk_bdev_ftl.so 00:02:24.240 SO libspdk_bdev_error.so.5.0 00:02:24.240 SO libspdk_bdev_passthru.so.5.0 00:02:24.240 SO libspdk_bdev_null.so.5.0 00:02:24.240 LIB libspdk_bdev_zone_block.a 00:02:24.240 LIB libspdk_bdev_aio.a 00:02:24.240 SYMLINK libspdk_bdev_split.so 00:02:24.240 SYMLINK libspdk_bdev_gpt.so 00:02:24.240 SYMLINK libspdk_bdev_error.so 00:02:24.240 LIB libspdk_bdev_malloc.a 00:02:24.240 LIB libspdk_bdev_delay.a 00:02:24.240 SO libspdk_bdev_zone_block.so.5.0 00:02:24.240 SO libspdk_bdev_aio.so.5.0 00:02:24.240 SYMLINK libspdk_bdev_null.so 00:02:24.240 SYMLINK libspdk_bdev_passthru.so 00:02:24.240 SO libspdk_bdev_delay.so.5.0 00:02:24.240 SO libspdk_bdev_malloc.so.5.0 00:02:24.240 LIB libspdk_bdev_iscsi.a 00:02:24.240 SYMLINK libspdk_bdev_zone_block.so 00:02:24.240 SYMLINK libspdk_bdev_aio.so 00:02:24.240 SO libspdk_bdev_iscsi.so.5.0 00:02:24.240 SYMLINK libspdk_bdev_delay.so 00:02:24.240 SYMLINK libspdk_bdev_malloc.so 00:02:24.240 SYMLINK libspdk_bdev_iscsi.so 00:02:24.498 LIB libspdk_bdev_lvol.a 00:02:24.498 SO libspdk_bdev_lvol.so.5.0 00:02:24.498 LIB libspdk_bdev_virtio.a 00:02:24.498 SO libspdk_bdev_virtio.so.5.0 00:02:24.498 SYMLINK libspdk_bdev_lvol.so 00:02:24.498 SYMLINK libspdk_bdev_virtio.so 00:02:24.756 LIB libspdk_bdev_raid.a 00:02:24.756 SO libspdk_bdev_raid.so.5.0 00:02:24.756 SYMLINK libspdk_bdev_raid.so 00:02:25.692 LIB libspdk_bdev_nvme.a 00:02:25.950 SO libspdk_bdev_nvme.so.6.0 00:02:25.950 SYMLINK libspdk_bdev_nvme.so 00:02:26.209 CC module/event/subsystems/iobuf/iobuf.o 00:02:26.209 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:26.209 CC module/event/subsystems/vmd/vmd.o 00:02:26.209 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:26.209 CC module/event/subsystems/sock/sock.o 00:02:26.209 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:26.209 CC module/event/subsystems/scheduler/scheduler.o 00:02:26.209 LIB libspdk_event_sock.a 00:02:26.209 LIB libspdk_event_scheduler.a 00:02:26.209 LIB libspdk_event_vhost_blk.a 00:02:26.209 LIB libspdk_event_vmd.a 00:02:26.467 SO libspdk_event_sock.so.4.0 00:02:26.467 LIB libspdk_event_iobuf.a 00:02:26.467 SO libspdk_event_scheduler.so.3.0 00:02:26.467 SO libspdk_event_vhost_blk.so.2.0 00:02:26.467 SO libspdk_event_vmd.so.5.0 00:02:26.467 SO libspdk_event_iobuf.so.2.0 00:02:26.467 SYMLINK libspdk_event_sock.so 00:02:26.467 SYMLINK libspdk_event_scheduler.so 00:02:26.467 SYMLINK libspdk_event_vhost_blk.so 00:02:26.467 SYMLINK libspdk_event_vmd.so 00:02:26.467 SYMLINK libspdk_event_iobuf.so 00:02:26.467 CC module/event/subsystems/accel/accel.o 00:02:26.726 LIB libspdk_event_accel.a 00:02:26.726 SO libspdk_event_accel.so.5.0 00:02:26.726 SYMLINK libspdk_event_accel.so 00:02:26.984 CC module/event/subsystems/bdev/bdev.o 00:02:26.984 LIB libspdk_event_bdev.a 00:02:26.984 SO libspdk_event_bdev.so.5.0 00:02:26.984 SYMLINK libspdk_event_bdev.so 00:02:27.243 CC module/event/subsystems/scsi/scsi.o 00:02:27.243 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:27.243 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:27.243 CC module/event/subsystems/ublk/ublk.o 00:02:27.243 CC module/event/subsystems/nbd/nbd.o 00:02:27.243 LIB libspdk_event_ublk.a 00:02:27.243 LIB libspdk_event_nbd.a 00:02:27.243 LIB libspdk_event_scsi.a 00:02:27.243 SO libspdk_event_ublk.so.2.0 00:02:27.243 SO libspdk_event_nbd.so.5.0 00:02:27.243 SO libspdk_event_scsi.so.5.0 00:02:27.501 SYMLINK libspdk_event_ublk.so 00:02:27.501 SYMLINK libspdk_event_nbd.so 00:02:27.501 SYMLINK libspdk_event_scsi.so 00:02:27.501 LIB libspdk_event_nvmf.a 00:02:27.501 SO libspdk_event_nvmf.so.5.0 00:02:27.501 SYMLINK libspdk_event_nvmf.so 00:02:27.501 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:27.501 CC module/event/subsystems/iscsi/iscsi.o 00:02:27.760 LIB libspdk_event_vhost_scsi.a 00:02:27.760 LIB libspdk_event_iscsi.a 00:02:27.760 SO libspdk_event_vhost_scsi.so.2.0 00:02:27.760 SO libspdk_event_iscsi.so.5.0 00:02:27.760 SYMLINK libspdk_event_vhost_scsi.so 00:02:27.760 SYMLINK libspdk_event_iscsi.so 00:02:27.760 SO libspdk.so.5.0 00:02:27.760 SYMLINK libspdk.so 00:02:28.027 CC app/trace_record/trace_record.o 00:02:28.027 CC app/spdk_nvme_perf/perf.o 00:02:28.027 CC app/spdk_nvme_discover/discovery_aer.o 00:02:28.027 CXX app/trace/trace.o 00:02:28.027 CC app/spdk_top/spdk_top.o 00:02:28.027 CC app/spdk_lspci/spdk_lspci.o 00:02:28.027 CC app/spdk_nvme_identify/identify.o 00:02:28.027 TEST_HEADER include/spdk/accel.h 00:02:28.027 TEST_HEADER include/spdk/accel_module.h 00:02:28.027 CC test/rpc_client/rpc_client_test.o 00:02:28.027 TEST_HEADER include/spdk/assert.h 00:02:28.027 TEST_HEADER include/spdk/barrier.h 00:02:28.027 TEST_HEADER include/spdk/base64.h 00:02:28.027 TEST_HEADER include/spdk/bdev.h 00:02:28.027 TEST_HEADER include/spdk/bdev_module.h 00:02:28.027 TEST_HEADER include/spdk/bdev_zone.h 00:02:28.027 TEST_HEADER include/spdk/bit_array.h 00:02:28.027 TEST_HEADER include/spdk/bit_pool.h 00:02:28.027 TEST_HEADER include/spdk/blob_bdev.h 00:02:28.027 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:28.027 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:28.027 TEST_HEADER include/spdk/blobfs.h 00:02:28.027 CC app/spdk_dd/spdk_dd.o 00:02:28.027 TEST_HEADER include/spdk/blob.h 00:02:28.027 TEST_HEADER include/spdk/conf.h 00:02:28.027 TEST_HEADER include/spdk/config.h 00:02:28.027 TEST_HEADER include/spdk/cpuset.h 00:02:28.027 CC app/nvmf_tgt/nvmf_main.o 00:02:28.027 TEST_HEADER include/spdk/crc16.h 00:02:28.027 CC app/iscsi_tgt/iscsi_tgt.o 00:02:28.027 TEST_HEADER include/spdk/crc32.h 00:02:28.027 TEST_HEADER include/spdk/crc64.h 00:02:28.027 CC examples/ioat/verify/verify.o 00:02:28.027 TEST_HEADER include/spdk/dif.h 00:02:28.027 CC examples/ioat/perf/perf.o 00:02:28.027 TEST_HEADER include/spdk/dma.h 00:02:28.027 CC examples/vmd/lsvmd/lsvmd.o 00:02:28.027 CC app/vhost/vhost.o 00:02:28.027 CC examples/util/zipf/zipf.o 00:02:28.027 CC app/fio/nvme/fio_plugin.o 00:02:28.027 CC examples/sock/hello_world/hello_sock.o 00:02:28.027 TEST_HEADER include/spdk/endian.h 00:02:28.027 CC examples/nvme/reconnect/reconnect.o 00:02:28.027 TEST_HEADER include/spdk/env_dpdk.h 00:02:28.027 CC examples/vmd/led/led.o 00:02:28.027 CC examples/idxd/perf/perf.o 00:02:28.027 TEST_HEADER include/spdk/env.h 00:02:28.027 CC examples/nvme/hello_world/hello_world.o 00:02:28.027 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:28.027 TEST_HEADER include/spdk/event.h 00:02:28.027 CC examples/nvme/arbitration/arbitration.o 00:02:28.027 TEST_HEADER include/spdk/fd_group.h 00:02:28.027 CC examples/accel/perf/accel_perf.o 00:02:28.027 CC examples/nvme/hotplug/hotplug.o 00:02:28.027 CC app/spdk_tgt/spdk_tgt.o 00:02:28.027 TEST_HEADER include/spdk/fd.h 00:02:28.027 CC test/event/event_perf/event_perf.o 00:02:28.027 TEST_HEADER include/spdk/file.h 00:02:28.027 CC test/nvme/aer/aer.o 00:02:28.027 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:28.027 CC test/thread/poller_perf/poller_perf.o 00:02:28.027 TEST_HEADER include/spdk/ftl.h 00:02:28.027 TEST_HEADER include/spdk/gpt_spec.h 00:02:28.027 TEST_HEADER include/spdk/hexlify.h 00:02:28.027 TEST_HEADER include/spdk/histogram_data.h 00:02:28.027 TEST_HEADER include/spdk/idxd.h 00:02:28.027 TEST_HEADER include/spdk/idxd_spec.h 00:02:28.027 TEST_HEADER include/spdk/init.h 00:02:28.027 TEST_HEADER include/spdk/ioat.h 00:02:28.028 TEST_HEADER include/spdk/ioat_spec.h 00:02:28.028 TEST_HEADER include/spdk/iscsi_spec.h 00:02:28.028 CC examples/blob/cli/blobcli.o 00:02:28.028 CC examples/thread/thread/thread_ex.o 00:02:28.028 CC examples/blob/hello_world/hello_blob.o 00:02:28.028 TEST_HEADER include/spdk/json.h 00:02:28.028 CC examples/nvmf/nvmf/nvmf.o 00:02:28.028 CC examples/bdev/hello_world/hello_bdev.o 00:02:28.028 TEST_HEADER include/spdk/jsonrpc.h 00:02:28.028 TEST_HEADER include/spdk/likely.h 00:02:28.028 CC app/fio/bdev/fio_plugin.o 00:02:28.028 TEST_HEADER include/spdk/log.h 00:02:28.291 CC test/accel/dif/dif.o 00:02:28.291 TEST_HEADER include/spdk/lvol.h 00:02:28.291 CC test/bdev/bdevio/bdevio.o 00:02:28.291 CC examples/bdev/bdevperf/bdevperf.o 00:02:28.291 CC test/blobfs/mkfs/mkfs.o 00:02:28.291 TEST_HEADER include/spdk/memory.h 00:02:28.291 TEST_HEADER include/spdk/mmio.h 00:02:28.291 TEST_HEADER include/spdk/nbd.h 00:02:28.291 CC test/dma/test_dma/test_dma.o 00:02:28.291 TEST_HEADER include/spdk/notify.h 00:02:28.291 TEST_HEADER include/spdk/nvme.h 00:02:28.292 CC test/app/bdev_svc/bdev_svc.o 00:02:28.292 TEST_HEADER include/spdk/nvme_intel.h 00:02:28.292 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:28.292 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:28.292 TEST_HEADER include/spdk/nvme_spec.h 00:02:28.292 CC test/env/mem_callbacks/mem_callbacks.o 00:02:28.292 TEST_HEADER include/spdk/nvme_zns.h 00:02:28.292 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:28.292 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:28.292 TEST_HEADER include/spdk/nvmf.h 00:02:28.292 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:28.292 TEST_HEADER include/spdk/nvmf_spec.h 00:02:28.292 TEST_HEADER include/spdk/nvmf_transport.h 00:02:28.292 CC test/lvol/esnap/esnap.o 00:02:28.292 TEST_HEADER include/spdk/opal.h 00:02:28.292 TEST_HEADER include/spdk/opal_spec.h 00:02:28.292 TEST_HEADER include/spdk/pci_ids.h 00:02:28.292 TEST_HEADER include/spdk/pipe.h 00:02:28.292 TEST_HEADER include/spdk/queue.h 00:02:28.292 TEST_HEADER include/spdk/reduce.h 00:02:28.292 TEST_HEADER include/spdk/rpc.h 00:02:28.292 TEST_HEADER include/spdk/scheduler.h 00:02:28.292 TEST_HEADER include/spdk/scsi.h 00:02:28.292 TEST_HEADER include/spdk/scsi_spec.h 00:02:28.292 TEST_HEADER include/spdk/sock.h 00:02:28.292 TEST_HEADER include/spdk/stdinc.h 00:02:28.292 TEST_HEADER include/spdk/string.h 00:02:28.292 TEST_HEADER include/spdk/thread.h 00:02:28.292 LINK spdk_lspci 00:02:28.292 TEST_HEADER include/spdk/trace.h 00:02:28.292 TEST_HEADER include/spdk/trace_parser.h 00:02:28.292 TEST_HEADER include/spdk/tree.h 00:02:28.292 TEST_HEADER include/spdk/ublk.h 00:02:28.292 TEST_HEADER include/spdk/util.h 00:02:28.292 TEST_HEADER include/spdk/uuid.h 00:02:28.292 TEST_HEADER include/spdk/version.h 00:02:28.292 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:28.292 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:28.292 TEST_HEADER include/spdk/vhost.h 00:02:28.292 TEST_HEADER include/spdk/vmd.h 00:02:28.292 TEST_HEADER include/spdk/xor.h 00:02:28.292 TEST_HEADER include/spdk/zipf.h 00:02:28.292 CXX test/cpp_headers/accel.o 00:02:28.292 LINK lsvmd 00:02:28.292 LINK rpc_client_test 00:02:28.292 LINK led 00:02:28.292 LINK spdk_nvme_discover 00:02:28.292 LINK zipf 00:02:28.292 LINK interrupt_tgt 00:02:28.292 LINK event_perf 00:02:28.292 LINK poller_perf 00:02:28.292 LINK nvmf_tgt 00:02:28.555 LINK vhost 00:02:28.555 LINK iscsi_tgt 00:02:28.555 LINK spdk_trace_record 00:02:28.555 LINK cmb_copy 00:02:28.555 LINK ioat_perf 00:02:28.555 LINK spdk_tgt 00:02:28.555 LINK verify 00:02:28.555 LINK hello_world 00:02:28.555 LINK bdev_svc 00:02:28.555 LINK hello_sock 00:02:28.555 LINK mkfs 00:02:28.555 LINK hotplug 00:02:28.555 LINK hello_blob 00:02:28.555 LINK hello_bdev 00:02:28.555 LINK thread 00:02:28.555 CXX test/cpp_headers/accel_module.o 00:02:28.555 LINK aer 00:02:28.555 CC test/app/histogram_perf/histogram_perf.o 00:02:28.815 LINK nvmf 00:02:28.815 LINK spdk_dd 00:02:28.815 LINK arbitration 00:02:28.815 LINK idxd_perf 00:02:28.815 CXX test/cpp_headers/assert.o 00:02:28.815 CC test/app/jsoncat/jsoncat.o 00:02:28.815 LINK reconnect 00:02:28.815 CC test/env/vtophys/vtophys.o 00:02:28.815 CC test/app/stub/stub.o 00:02:28.815 CC test/event/reactor/reactor.o 00:02:28.815 CC test/nvme/reset/reset.o 00:02:28.815 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:28.815 LINK spdk_trace 00:02:28.815 CC examples/nvme/abort/abort.o 00:02:28.815 CXX test/cpp_headers/barrier.o 00:02:28.815 CC test/event/reactor_perf/reactor_perf.o 00:02:28.815 LINK dif 00:02:28.815 CC test/nvme/sgl/sgl.o 00:02:28.815 LINK test_dma 00:02:28.815 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:28.815 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:28.815 LINK bdevio 00:02:28.815 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:28.815 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:29.078 CC test/nvme/e2edp/nvme_dp.o 00:02:29.078 CC test/event/app_repeat/app_repeat.o 00:02:29.078 CC test/env/memory/memory_ut.o 00:02:29.078 CXX test/cpp_headers/base64.o 00:02:29.078 LINK histogram_perf 00:02:29.078 CXX test/cpp_headers/bdev.o 00:02:29.078 LINK accel_perf 00:02:29.078 CC test/env/pci/pci_ut.o 00:02:29.078 CC test/nvme/overhead/overhead.o 00:02:29.078 LINK nvme_fuzz 00:02:29.078 LINK nvme_manage 00:02:29.078 LINK reactor 00:02:29.078 CC test/nvme/err_injection/err_injection.o 00:02:29.078 LINK vtophys 00:02:29.078 LINK jsoncat 00:02:29.078 CXX test/cpp_headers/bdev_module.o 00:02:29.078 CXX test/cpp_headers/bdev_zone.o 00:02:29.078 LINK blobcli 00:02:29.078 CXX test/cpp_headers/bit_array.o 00:02:29.078 CC test/nvme/startup/startup.o 00:02:29.078 CC test/nvme/reserve/reserve.o 00:02:29.078 LINK spdk_bdev 00:02:29.078 CXX test/cpp_headers/bit_pool.o 00:02:29.078 LINK stub 00:02:29.078 LINK spdk_nvme 00:02:29.078 CC test/nvme/simple_copy/simple_copy.o 00:02:29.078 LINK reactor_perf 00:02:29.078 CC test/event/scheduler/scheduler.o 00:02:29.078 CC test/nvme/connect_stress/connect_stress.o 00:02:29.339 LINK env_dpdk_post_init 00:02:29.339 CC test/nvme/boot_partition/boot_partition.o 00:02:29.339 CC test/nvme/compliance/nvme_compliance.o 00:02:29.339 CXX test/cpp_headers/blob_bdev.o 00:02:29.339 LINK pmr_persistence 00:02:29.339 LINK app_repeat 00:02:29.339 LINK reset 00:02:29.339 CXX test/cpp_headers/blobfs_bdev.o 00:02:29.339 CXX test/cpp_headers/blobfs.o 00:02:29.339 CXX test/cpp_headers/blob.o 00:02:29.339 CC test/nvme/fused_ordering/fused_ordering.o 00:02:29.339 CXX test/cpp_headers/conf.o 00:02:29.339 CXX test/cpp_headers/config.o 00:02:29.339 CXX test/cpp_headers/cpuset.o 00:02:29.339 CXX test/cpp_headers/crc16.o 00:02:29.339 CXX test/cpp_headers/crc32.o 00:02:29.339 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:29.339 CXX test/cpp_headers/crc64.o 00:02:29.339 CC test/nvme/fdp/fdp.o 00:02:29.339 CXX test/cpp_headers/dif.o 00:02:29.339 CXX test/cpp_headers/dma.o 00:02:29.339 LINK mem_callbacks 00:02:29.339 LINK err_injection 00:02:29.339 CC test/nvme/cuse/cuse.o 00:02:29.339 LINK sgl 00:02:29.339 CXX test/cpp_headers/endian.o 00:02:29.339 LINK startup 00:02:29.339 CXX test/cpp_headers/env_dpdk.o 00:02:29.339 CXX test/cpp_headers/env.o 00:02:29.339 CXX test/cpp_headers/event.o 00:02:29.600 CXX test/cpp_headers/fd_group.o 00:02:29.600 CXX test/cpp_headers/fd.o 00:02:29.600 LINK nvme_dp 00:02:29.600 LINK reserve 00:02:29.600 CXX test/cpp_headers/file.o 00:02:29.600 CXX test/cpp_headers/ftl.o 00:02:29.600 LINK abort 00:02:29.600 LINK spdk_nvme_perf 00:02:29.600 LINK overhead 00:02:29.600 CXX test/cpp_headers/gpt_spec.o 00:02:29.600 LINK connect_stress 00:02:29.600 LINK boot_partition 00:02:29.600 LINK simple_copy 00:02:29.600 CXX test/cpp_headers/hexlify.o 00:02:29.600 LINK spdk_nvme_identify 00:02:29.600 CXX test/cpp_headers/histogram_data.o 00:02:29.600 CXX test/cpp_headers/idxd.o 00:02:29.600 LINK scheduler 00:02:29.600 LINK bdevperf 00:02:29.600 LINK spdk_top 00:02:29.600 CXX test/cpp_headers/idxd_spec.o 00:02:29.600 CXX test/cpp_headers/init.o 00:02:29.600 CXX test/cpp_headers/ioat.o 00:02:29.600 CXX test/cpp_headers/ioat_spec.o 00:02:29.600 CXX test/cpp_headers/iscsi_spec.o 00:02:29.600 CXX test/cpp_headers/json.o 00:02:29.600 CXX test/cpp_headers/jsonrpc.o 00:02:29.600 CXX test/cpp_headers/likely.o 00:02:29.864 LINK vhost_fuzz 00:02:29.864 LINK pci_ut 00:02:29.864 LINK fused_ordering 00:02:29.864 CXX test/cpp_headers/log.o 00:02:29.864 CXX test/cpp_headers/lvol.o 00:02:29.864 LINK doorbell_aers 00:02:29.864 CXX test/cpp_headers/memory.o 00:02:29.864 CXX test/cpp_headers/mmio.o 00:02:29.864 CXX test/cpp_headers/nbd.o 00:02:29.864 CXX test/cpp_headers/notify.o 00:02:29.864 CXX test/cpp_headers/nvme.o 00:02:29.864 CXX test/cpp_headers/nvme_intel.o 00:02:29.864 CXX test/cpp_headers/nvme_ocssd.o 00:02:29.864 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:29.864 CXX test/cpp_headers/nvme_spec.o 00:02:29.864 CXX test/cpp_headers/nvme_zns.o 00:02:29.864 CXX test/cpp_headers/nvmf_cmd.o 00:02:29.864 CXX test/cpp_headers/nvmf.o 00:02:29.864 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:29.864 LINK nvme_compliance 00:02:29.864 CXX test/cpp_headers/nvmf_spec.o 00:02:29.864 CXX test/cpp_headers/nvmf_transport.o 00:02:29.864 CXX test/cpp_headers/opal.o 00:02:29.864 CXX test/cpp_headers/opal_spec.o 00:02:29.864 CXX test/cpp_headers/pci_ids.o 00:02:29.864 CXX test/cpp_headers/pipe.o 00:02:29.864 CXX test/cpp_headers/queue.o 00:02:29.864 CXX test/cpp_headers/reduce.o 00:02:29.864 CXX test/cpp_headers/rpc.o 00:02:29.864 CXX test/cpp_headers/scheduler.o 00:02:29.864 CXX test/cpp_headers/scsi.o 00:02:29.864 CXX test/cpp_headers/scsi_spec.o 00:02:29.864 CXX test/cpp_headers/sock.o 00:02:29.864 CXX test/cpp_headers/stdinc.o 00:02:30.122 CXX test/cpp_headers/string.o 00:02:30.122 LINK fdp 00:02:30.122 CXX test/cpp_headers/thread.o 00:02:30.122 CXX test/cpp_headers/trace.o 00:02:30.122 CXX test/cpp_headers/trace_parser.o 00:02:30.122 CXX test/cpp_headers/tree.o 00:02:30.122 CXX test/cpp_headers/ublk.o 00:02:30.122 CXX test/cpp_headers/util.o 00:02:30.122 CXX test/cpp_headers/uuid.o 00:02:30.122 CXX test/cpp_headers/version.o 00:02:30.122 CXX test/cpp_headers/vfio_user_pci.o 00:02:30.122 CXX test/cpp_headers/vfio_user_spec.o 00:02:30.122 CXX test/cpp_headers/vhost.o 00:02:30.122 CXX test/cpp_headers/vmd.o 00:02:30.122 CXX test/cpp_headers/xor.o 00:02:30.122 CXX test/cpp_headers/zipf.o 00:02:30.731 LINK memory_ut 00:02:31.055 LINK cuse 00:02:31.055 LINK iscsi_fuzz 00:02:33.586 LINK esnap 00:02:33.844 00:02:33.844 real 0m45.920s 00:02:33.844 user 9m38.134s 00:02:33.844 sys 2m7.797s 00:02:33.844 01:38:22 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:33.844 01:38:22 -- common/autotest_common.sh@10 -- $ set +x 00:02:33.844 ************************************ 00:02:33.844 END TEST make 00:02:33.844 ************************************ 00:02:34.103 01:38:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:34.103 01:38:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:34.103 01:38:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:34.103 01:38:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:34.103 01:38:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:34.103 01:38:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:34.103 01:38:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:34.103 01:38:22 -- scripts/common.sh@335 -- # IFS=.-: 00:02:34.103 01:38:22 -- scripts/common.sh@335 -- # read -ra ver1 00:02:34.103 01:38:22 -- scripts/common.sh@336 -- # IFS=.-: 00:02:34.103 01:38:22 -- scripts/common.sh@336 -- # read -ra ver2 00:02:34.103 01:38:22 -- scripts/common.sh@337 -- # local 'op=<' 00:02:34.103 01:38:22 -- scripts/common.sh@339 -- # ver1_l=2 00:02:34.103 01:38:22 -- scripts/common.sh@340 -- # ver2_l=1 00:02:34.103 01:38:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:34.103 01:38:22 -- scripts/common.sh@343 -- # case "$op" in 00:02:34.103 01:38:22 -- scripts/common.sh@344 -- # : 1 00:02:34.103 01:38:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:34.103 01:38:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:34.103 01:38:22 -- scripts/common.sh@364 -- # decimal 1 00:02:34.103 01:38:22 -- scripts/common.sh@352 -- # local d=1 00:02:34.103 01:38:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:34.103 01:38:22 -- scripts/common.sh@354 -- # echo 1 00:02:34.103 01:38:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:34.103 01:38:22 -- scripts/common.sh@365 -- # decimal 2 00:02:34.103 01:38:22 -- scripts/common.sh@352 -- # local d=2 00:02:34.103 01:38:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:34.103 01:38:22 -- scripts/common.sh@354 -- # echo 2 00:02:34.103 01:38:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:34.103 01:38:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:34.103 01:38:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:34.103 01:38:22 -- scripts/common.sh@367 -- # return 0 00:02:34.103 01:38:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:34.103 01:38:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:34.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.103 --rc genhtml_branch_coverage=1 00:02:34.104 --rc genhtml_function_coverage=1 00:02:34.104 --rc genhtml_legend=1 00:02:34.104 --rc geninfo_all_blocks=1 00:02:34.104 --rc geninfo_unexecuted_blocks=1 00:02:34.104 00:02:34.104 ' 00:02:34.104 01:38:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:34.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.104 --rc genhtml_branch_coverage=1 00:02:34.104 --rc genhtml_function_coverage=1 00:02:34.104 --rc genhtml_legend=1 00:02:34.104 --rc geninfo_all_blocks=1 00:02:34.104 --rc geninfo_unexecuted_blocks=1 00:02:34.104 00:02:34.104 ' 00:02:34.104 01:38:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:34.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.104 --rc genhtml_branch_coverage=1 00:02:34.104 --rc genhtml_function_coverage=1 00:02:34.104 --rc genhtml_legend=1 00:02:34.104 --rc geninfo_all_blocks=1 00:02:34.104 --rc geninfo_unexecuted_blocks=1 00:02:34.104 00:02:34.104 ' 00:02:34.104 01:38:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:34.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.104 --rc genhtml_branch_coverage=1 00:02:34.104 --rc genhtml_function_coverage=1 00:02:34.104 --rc genhtml_legend=1 00:02:34.104 --rc geninfo_all_blocks=1 00:02:34.104 --rc geninfo_unexecuted_blocks=1 00:02:34.104 00:02:34.104 ' 00:02:34.104 01:38:22 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:34.104 01:38:22 -- nvmf/common.sh@7 -- # uname -s 00:02:34.104 01:38:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:34.104 01:38:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:34.104 01:38:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:34.104 01:38:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:34.104 01:38:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:34.104 01:38:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:34.104 01:38:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:34.104 01:38:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:34.104 01:38:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:34.104 01:38:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:34.104 01:38:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:34.104 01:38:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:34.104 01:38:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:34.104 01:38:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:34.104 01:38:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:34.104 01:38:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:34.104 01:38:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:34.104 01:38:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:34.104 01:38:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:34.104 01:38:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:34.104 01:38:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:34.104 01:38:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:34.104 01:38:22 -- paths/export.sh@5 -- # export PATH 00:02:34.104 01:38:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:34.104 01:38:22 -- nvmf/common.sh@46 -- # : 0 00:02:34.104 01:38:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:34.104 01:38:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:34.104 01:38:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:34.104 01:38:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:34.104 01:38:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:34.104 01:38:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:34.104 01:38:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:34.104 01:38:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:34.104 01:38:22 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:34.104 01:38:22 -- spdk/autotest.sh@32 -- # uname -s 00:02:34.104 01:38:22 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:34.104 01:38:22 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:34.104 01:38:22 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:34.104 01:38:22 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:34.104 01:38:22 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:34.104 01:38:22 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:34.104 01:38:22 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:34.104 01:38:22 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:34.104 01:38:22 -- spdk/autotest.sh@48 -- # udevadm_pid=3288162 00:02:34.104 01:38:22 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:34.104 01:38:22 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:34.104 01:38:22 -- spdk/autotest.sh@54 -- # echo 3288164 00:02:34.104 01:38:22 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:34.104 01:38:22 -- spdk/autotest.sh@56 -- # echo 3288165 00:02:34.104 01:38:22 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:34.104 01:38:22 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:34.104 01:38:22 -- spdk/autotest.sh@60 -- # echo 3288166 00:02:34.104 01:38:22 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:34.104 01:38:22 -- spdk/autotest.sh@62 -- # echo 3288167 00:02:34.104 01:38:22 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:34.104 01:38:22 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:34.104 01:38:22 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:34.104 01:38:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:34.104 01:38:22 -- common/autotest_common.sh@10 -- # set +x 00:02:34.104 01:38:22 -- spdk/autotest.sh@70 -- # create_test_list 00:02:34.104 01:38:22 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:34.104 01:38:22 -- common/autotest_common.sh@10 -- # set +x 00:02:34.104 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:34.104 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:34.104 01:38:22 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:34.104 01:38:22 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:34.104 01:38:22 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:34.104 01:38:22 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:34.104 01:38:22 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:34.104 01:38:22 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:34.104 01:38:22 -- common/autotest_common.sh@1450 -- # uname 00:02:34.104 01:38:22 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:34.104 01:38:22 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:34.104 01:38:22 -- common/autotest_common.sh@1470 -- # uname 00:02:34.104 01:38:22 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:34.104 01:38:22 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:34.104 01:38:22 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:34.363 lcov: LCOV version 1.15 00:02:34.363 01:38:22 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:37.643 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:37.643 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:37.643 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:37.643 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:37.643 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:37.643 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:09.724 01:38:55 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:09.724 01:38:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:09.724 01:38:55 -- common/autotest_common.sh@10 -- # set +x 00:03:09.724 01:38:55 -- spdk/autotest.sh@89 -- # rm -f 00:03:09.724 01:38:55 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:09.724 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:09.724 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:09.724 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:09.724 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:09.724 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:09.724 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:09.724 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:09.724 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:09.724 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:09.724 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:09.724 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:09.724 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:09.724 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:09.724 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:09.724 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:09.724 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:09.724 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:09.724 01:38:56 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:09.724 01:38:56 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:09.724 01:38:56 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:09.724 01:38:56 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:09.724 01:38:56 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:09.724 01:38:56 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:09.724 01:38:56 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:09.724 01:38:56 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:09.724 01:38:56 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:09.724 01:38:56 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:09.724 01:38:56 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:09.724 01:38:56 -- spdk/autotest.sh@108 -- # grep -v p 00:03:09.724 01:38:56 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:09.724 01:38:56 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:09.724 01:38:56 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:09.724 01:38:56 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:09.724 01:38:56 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:09.724 No valid GPT data, bailing 00:03:09.724 01:38:56 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:09.724 01:38:56 -- scripts/common.sh@393 -- # pt= 00:03:09.724 01:38:56 -- scripts/common.sh@394 -- # return 1 00:03:09.724 01:38:56 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:09.724 1+0 records in 00:03:09.724 1+0 records out 00:03:09.724 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00372151 s, 282 MB/s 00:03:09.724 01:38:56 -- spdk/autotest.sh@116 -- # sync 00:03:09.724 01:38:56 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:09.724 01:38:56 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:09.724 01:38:56 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:10.660 01:38:58 -- spdk/autotest.sh@122 -- # uname -s 00:03:10.660 01:38:58 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:10.660 01:38:58 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:10.660 01:38:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.660 01:38:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.660 01:38:58 -- common/autotest_common.sh@10 -- # set +x 00:03:10.660 ************************************ 00:03:10.660 START TEST setup.sh 00:03:10.660 ************************************ 00:03:10.660 01:38:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:10.660 * Looking for test storage... 00:03:10.660 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:10.660 01:38:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:10.660 01:38:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:10.660 01:38:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:10.660 01:38:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:10.660 01:38:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:10.660 01:38:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:10.660 01:38:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:10.660 01:38:59 -- scripts/common.sh@335 -- # IFS=.-: 00:03:10.660 01:38:59 -- scripts/common.sh@335 -- # read -ra ver1 00:03:10.660 01:38:59 -- scripts/common.sh@336 -- # IFS=.-: 00:03:10.660 01:38:59 -- scripts/common.sh@336 -- # read -ra ver2 00:03:10.660 01:38:59 -- scripts/common.sh@337 -- # local 'op=<' 00:03:10.660 01:38:59 -- scripts/common.sh@339 -- # ver1_l=2 00:03:10.660 01:38:59 -- scripts/common.sh@340 -- # ver2_l=1 00:03:10.660 01:38:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:10.660 01:38:59 -- scripts/common.sh@343 -- # case "$op" in 00:03:10.660 01:38:59 -- scripts/common.sh@344 -- # : 1 00:03:10.660 01:38:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:10.660 01:38:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:10.660 01:38:59 -- scripts/common.sh@364 -- # decimal 1 00:03:10.660 01:38:59 -- scripts/common.sh@352 -- # local d=1 00:03:10.660 01:38:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:10.660 01:38:59 -- scripts/common.sh@354 -- # echo 1 00:03:10.660 01:38:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:10.660 01:38:59 -- scripts/common.sh@365 -- # decimal 2 00:03:10.660 01:38:59 -- scripts/common.sh@352 -- # local d=2 00:03:10.660 01:38:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:10.660 01:38:59 -- scripts/common.sh@354 -- # echo 2 00:03:10.660 01:38:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:10.660 01:38:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:10.660 01:38:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:10.660 01:38:59 -- scripts/common.sh@367 -- # return 0 00:03:10.660 01:38:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:10.660 01:38:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:10.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.660 --rc genhtml_branch_coverage=1 00:03:10.660 --rc genhtml_function_coverage=1 00:03:10.660 --rc genhtml_legend=1 00:03:10.660 --rc geninfo_all_blocks=1 00:03:10.660 --rc geninfo_unexecuted_blocks=1 00:03:10.660 00:03:10.660 ' 00:03:10.660 01:38:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:10.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.660 --rc genhtml_branch_coverage=1 00:03:10.660 --rc genhtml_function_coverage=1 00:03:10.660 --rc genhtml_legend=1 00:03:10.660 --rc geninfo_all_blocks=1 00:03:10.660 --rc geninfo_unexecuted_blocks=1 00:03:10.660 00:03:10.660 ' 00:03:10.660 01:38:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:10.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.660 --rc genhtml_branch_coverage=1 00:03:10.660 --rc genhtml_function_coverage=1 00:03:10.660 --rc genhtml_legend=1 00:03:10.660 --rc geninfo_all_blocks=1 00:03:10.660 --rc geninfo_unexecuted_blocks=1 00:03:10.660 00:03:10.660 ' 00:03:10.660 01:38:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:10.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.660 --rc genhtml_branch_coverage=1 00:03:10.660 --rc genhtml_function_coverage=1 00:03:10.660 --rc genhtml_legend=1 00:03:10.660 --rc geninfo_all_blocks=1 00:03:10.660 --rc geninfo_unexecuted_blocks=1 00:03:10.660 00:03:10.660 ' 00:03:10.660 01:38:59 -- setup/test-setup.sh@10 -- # uname -s 00:03:10.660 01:38:59 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:10.660 01:38:59 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:10.661 01:38:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.661 01:38:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.661 01:38:59 -- common/autotest_common.sh@10 -- # set +x 00:03:10.661 ************************************ 00:03:10.661 START TEST acl 00:03:10.661 ************************************ 00:03:10.661 01:38:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:10.661 * Looking for test storage... 00:03:10.661 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:10.661 01:38:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:10.661 01:38:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:10.661 01:38:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:10.919 01:38:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:10.919 01:38:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:10.919 01:38:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:10.919 01:38:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:10.919 01:38:59 -- scripts/common.sh@335 -- # IFS=.-: 00:03:10.919 01:38:59 -- scripts/common.sh@335 -- # read -ra ver1 00:03:10.919 01:38:59 -- scripts/common.sh@336 -- # IFS=.-: 00:03:10.919 01:38:59 -- scripts/common.sh@336 -- # read -ra ver2 00:03:10.919 01:38:59 -- scripts/common.sh@337 -- # local 'op=<' 00:03:10.919 01:38:59 -- scripts/common.sh@339 -- # ver1_l=2 00:03:10.919 01:38:59 -- scripts/common.sh@340 -- # ver2_l=1 00:03:10.919 01:38:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:10.919 01:38:59 -- scripts/common.sh@343 -- # case "$op" in 00:03:10.919 01:38:59 -- scripts/common.sh@344 -- # : 1 00:03:10.919 01:38:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:10.919 01:38:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:10.919 01:38:59 -- scripts/common.sh@364 -- # decimal 1 00:03:10.919 01:38:59 -- scripts/common.sh@352 -- # local d=1 00:03:10.919 01:38:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:10.919 01:38:59 -- scripts/common.sh@354 -- # echo 1 00:03:10.919 01:38:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:10.919 01:38:59 -- scripts/common.sh@365 -- # decimal 2 00:03:10.919 01:38:59 -- scripts/common.sh@352 -- # local d=2 00:03:10.919 01:38:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:10.919 01:38:59 -- scripts/common.sh@354 -- # echo 2 00:03:10.919 01:38:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:10.919 01:38:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:10.919 01:38:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:10.919 01:38:59 -- scripts/common.sh@367 -- # return 0 00:03:10.919 01:38:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:10.919 01:38:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:10.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.919 --rc genhtml_branch_coverage=1 00:03:10.919 --rc genhtml_function_coverage=1 00:03:10.919 --rc genhtml_legend=1 00:03:10.919 --rc geninfo_all_blocks=1 00:03:10.919 --rc geninfo_unexecuted_blocks=1 00:03:10.919 00:03:10.919 ' 00:03:10.919 01:38:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:10.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.919 --rc genhtml_branch_coverage=1 00:03:10.919 --rc genhtml_function_coverage=1 00:03:10.919 --rc genhtml_legend=1 00:03:10.919 --rc geninfo_all_blocks=1 00:03:10.919 --rc geninfo_unexecuted_blocks=1 00:03:10.919 00:03:10.919 ' 00:03:10.919 01:38:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:10.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.919 --rc genhtml_branch_coverage=1 00:03:10.919 --rc genhtml_function_coverage=1 00:03:10.919 --rc genhtml_legend=1 00:03:10.919 --rc geninfo_all_blocks=1 00:03:10.919 --rc geninfo_unexecuted_blocks=1 00:03:10.919 00:03:10.919 ' 00:03:10.919 01:38:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:10.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.919 --rc genhtml_branch_coverage=1 00:03:10.919 --rc genhtml_function_coverage=1 00:03:10.919 --rc genhtml_legend=1 00:03:10.919 --rc geninfo_all_blocks=1 00:03:10.919 --rc geninfo_unexecuted_blocks=1 00:03:10.919 00:03:10.919 ' 00:03:10.919 01:38:59 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:10.919 01:38:59 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:10.919 01:38:59 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:10.919 01:38:59 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:10.919 01:38:59 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:10.919 01:38:59 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:10.919 01:38:59 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:10.919 01:38:59 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:10.919 01:38:59 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:10.919 01:38:59 -- setup/acl.sh@12 -- # devs=() 00:03:10.919 01:38:59 -- setup/acl.sh@12 -- # declare -a devs 00:03:10.919 01:38:59 -- setup/acl.sh@13 -- # drivers=() 00:03:10.919 01:38:59 -- setup/acl.sh@13 -- # declare -A drivers 00:03:10.919 01:38:59 -- setup/acl.sh@51 -- # setup reset 00:03:10.919 01:38:59 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:10.919 01:38:59 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:12.292 01:39:00 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:12.292 01:39:00 -- setup/acl.sh@16 -- # local dev driver 00:03:12.292 01:39:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.292 01:39:00 -- setup/acl.sh@15 -- # setup output status 00:03:12.292 01:39:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.292 01:39:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:13.226 Hugepages 00:03:13.226 node hugesize free / total 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 00:03:13.226 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.226 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.226 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.226 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.227 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:13.227 01:39:01 -- setup/acl.sh@20 -- # continue 00:03:13.227 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.485 01:39:01 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:13.485 01:39:01 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:13.485 01:39:01 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:13.485 01:39:01 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:13.485 01:39:01 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:13.485 01:39:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:13.485 01:39:01 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:13.485 01:39:01 -- setup/acl.sh@54 -- # run_test denied denied 00:03:13.485 01:39:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:13.485 01:39:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:13.485 01:39:01 -- common/autotest_common.sh@10 -- # set +x 00:03:13.485 ************************************ 00:03:13.485 START TEST denied 00:03:13.485 ************************************ 00:03:13.485 01:39:01 -- common/autotest_common.sh@1114 -- # denied 00:03:13.485 01:39:01 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:13.485 01:39:01 -- setup/acl.sh@38 -- # setup output config 00:03:13.485 01:39:01 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:13.485 01:39:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.485 01:39:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:14.859 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:14.859 01:39:03 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:14.859 01:39:03 -- setup/acl.sh@28 -- # local dev driver 00:03:14.859 01:39:03 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:14.859 01:39:03 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:14.859 01:39:03 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:14.859 01:39:03 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:14.859 01:39:03 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:14.859 01:39:03 -- setup/acl.sh@41 -- # setup reset 00:03:14.860 01:39:03 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:14.860 01:39:03 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:17.392 00:03:17.392 real 0m3.829s 00:03:17.392 user 0m1.112s 00:03:17.392 sys 0m1.814s 00:03:17.392 01:39:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.392 01:39:05 -- common/autotest_common.sh@10 -- # set +x 00:03:17.392 ************************************ 00:03:17.392 END TEST denied 00:03:17.392 ************************************ 00:03:17.392 01:39:05 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:17.392 01:39:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:17.392 01:39:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:17.392 01:39:05 -- common/autotest_common.sh@10 -- # set +x 00:03:17.392 ************************************ 00:03:17.392 START TEST allowed 00:03:17.392 ************************************ 00:03:17.392 01:39:05 -- common/autotest_common.sh@1114 -- # allowed 00:03:17.392 01:39:05 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:17.392 01:39:05 -- setup/acl.sh@45 -- # setup output config 00:03:17.392 01:39:05 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:17.392 01:39:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.392 01:39:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:19.924 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:19.924 01:39:08 -- setup/acl.sh@47 -- # verify 00:03:19.924 01:39:08 -- setup/acl.sh@28 -- # local dev driver 00:03:19.924 01:39:08 -- setup/acl.sh@48 -- # setup reset 00:03:19.924 01:39:08 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:19.924 01:39:08 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:21.307 00:03:21.307 real 0m3.836s 00:03:21.307 user 0m0.987s 00:03:21.307 sys 0m1.734s 00:03:21.307 01:39:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:21.307 01:39:09 -- common/autotest_common.sh@10 -- # set +x 00:03:21.307 ************************************ 00:03:21.307 END TEST allowed 00:03:21.307 ************************************ 00:03:21.307 00:03:21.307 real 0m10.398s 00:03:21.307 user 0m3.228s 00:03:21.307 sys 0m5.242s 00:03:21.307 01:39:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:21.307 01:39:09 -- common/autotest_common.sh@10 -- # set +x 00:03:21.307 ************************************ 00:03:21.307 END TEST acl 00:03:21.307 ************************************ 00:03:21.307 01:39:09 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:21.307 01:39:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.307 01:39:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.307 01:39:09 -- common/autotest_common.sh@10 -- # set +x 00:03:21.307 ************************************ 00:03:21.307 START TEST hugepages 00:03:21.307 ************************************ 00:03:21.307 01:39:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:21.307 * Looking for test storage... 00:03:21.307 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:21.307 01:39:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:21.307 01:39:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:21.307 01:39:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:21.307 01:39:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:21.307 01:39:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:21.307 01:39:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:21.307 01:39:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:21.307 01:39:09 -- scripts/common.sh@335 -- # IFS=.-: 00:03:21.307 01:39:09 -- scripts/common.sh@335 -- # read -ra ver1 00:03:21.307 01:39:09 -- scripts/common.sh@336 -- # IFS=.-: 00:03:21.307 01:39:09 -- scripts/common.sh@336 -- # read -ra ver2 00:03:21.307 01:39:09 -- scripts/common.sh@337 -- # local 'op=<' 00:03:21.307 01:39:09 -- scripts/common.sh@339 -- # ver1_l=2 00:03:21.307 01:39:09 -- scripts/common.sh@340 -- # ver2_l=1 00:03:21.307 01:39:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:21.307 01:39:09 -- scripts/common.sh@343 -- # case "$op" in 00:03:21.307 01:39:09 -- scripts/common.sh@344 -- # : 1 00:03:21.307 01:39:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:21.307 01:39:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:21.307 01:39:09 -- scripts/common.sh@364 -- # decimal 1 00:03:21.307 01:39:09 -- scripts/common.sh@352 -- # local d=1 00:03:21.307 01:39:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:21.307 01:39:09 -- scripts/common.sh@354 -- # echo 1 00:03:21.307 01:39:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:21.307 01:39:09 -- scripts/common.sh@365 -- # decimal 2 00:03:21.307 01:39:09 -- scripts/common.sh@352 -- # local d=2 00:03:21.307 01:39:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:21.307 01:39:09 -- scripts/common.sh@354 -- # echo 2 00:03:21.307 01:39:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:21.307 01:39:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:21.307 01:39:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:21.307 01:39:09 -- scripts/common.sh@367 -- # return 0 00:03:21.307 01:39:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:21.307 01:39:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:21.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.307 --rc genhtml_branch_coverage=1 00:03:21.307 --rc genhtml_function_coverage=1 00:03:21.307 --rc genhtml_legend=1 00:03:21.307 --rc geninfo_all_blocks=1 00:03:21.307 --rc geninfo_unexecuted_blocks=1 00:03:21.307 00:03:21.307 ' 00:03:21.307 01:39:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:21.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.307 --rc genhtml_branch_coverage=1 00:03:21.307 --rc genhtml_function_coverage=1 00:03:21.307 --rc genhtml_legend=1 00:03:21.307 --rc geninfo_all_blocks=1 00:03:21.307 --rc geninfo_unexecuted_blocks=1 00:03:21.307 00:03:21.307 ' 00:03:21.307 01:39:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:21.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.307 --rc genhtml_branch_coverage=1 00:03:21.307 --rc genhtml_function_coverage=1 00:03:21.307 --rc genhtml_legend=1 00:03:21.307 --rc geninfo_all_blocks=1 00:03:21.307 --rc geninfo_unexecuted_blocks=1 00:03:21.307 00:03:21.307 ' 00:03:21.307 01:39:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:21.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.307 --rc genhtml_branch_coverage=1 00:03:21.307 --rc genhtml_function_coverage=1 00:03:21.307 --rc genhtml_legend=1 00:03:21.307 --rc geninfo_all_blocks=1 00:03:21.307 --rc geninfo_unexecuted_blocks=1 00:03:21.307 00:03:21.307 ' 00:03:21.307 01:39:09 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:21.307 01:39:09 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:21.307 01:39:09 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:21.307 01:39:09 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:21.307 01:39:09 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:21.307 01:39:09 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:21.307 01:39:09 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:21.307 01:39:09 -- setup/common.sh@18 -- # local node= 00:03:21.307 01:39:09 -- setup/common.sh@19 -- # local var val 00:03:21.307 01:39:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.307 01:39:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.307 01:39:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.307 01:39:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.307 01:39:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.307 01:39:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.307 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.307 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.307 01:39:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 43151816 kB' 'MemAvailable: 46908844 kB' 'Buffers: 3740 kB' 'Cached: 10641052 kB' 'SwapCached: 0 kB' 'Active: 7342160 kB' 'Inactive: 3759348 kB' 'Active(anon): 6941892 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460076 kB' 'Mapped: 175460 kB' 'Shmem: 6485176 kB' 'KReclaimable: 181984 kB' 'Slab: 687592 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505608 kB' 'KernelStack: 12704 kB' 'PageTables: 7824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 8025772 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198168 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:21.307 01:39:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.307 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.307 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.307 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.307 01:39:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.307 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.307 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # continue 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.308 01:39:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.308 01:39:09 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.308 01:39:09 -- setup/common.sh@33 -- # echo 2048 00:03:21.308 01:39:09 -- setup/common.sh@33 -- # return 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:21.308 01:39:09 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:21.308 01:39:09 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:21.308 01:39:09 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:21.308 01:39:09 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:21.308 01:39:09 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:21.308 01:39:09 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:21.308 01:39:09 -- setup/hugepages.sh@207 -- # get_nodes 00:03:21.308 01:39:09 -- setup/hugepages.sh@27 -- # local node 00:03:21.308 01:39:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.308 01:39:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:21.308 01:39:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.308 01:39:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:21.308 01:39:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.308 01:39:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.308 01:39:09 -- setup/hugepages.sh@208 -- # clear_hp 00:03:21.308 01:39:09 -- setup/hugepages.sh@37 -- # local node hp 00:03:21.308 01:39:09 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:21.308 01:39:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.308 01:39:09 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.308 01:39:09 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:21.308 01:39:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.308 01:39:09 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.308 01:39:09 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:21.308 01:39:09 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:21.308 01:39:09 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:21.308 01:39:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.308 01:39:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.308 01:39:09 -- common/autotest_common.sh@10 -- # set +x 00:03:21.308 ************************************ 00:03:21.308 START TEST default_setup 00:03:21.308 ************************************ 00:03:21.308 01:39:09 -- common/autotest_common.sh@1114 -- # default_setup 00:03:21.308 01:39:09 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:21.308 01:39:09 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:21.308 01:39:09 -- setup/hugepages.sh@51 -- # shift 00:03:21.308 01:39:09 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:21.308 01:39:09 -- setup/hugepages.sh@52 -- # local node_ids 00:03:21.308 01:39:09 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.308 01:39:09 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:21.308 01:39:09 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:21.308 01:39:09 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.308 01:39:09 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:21.308 01:39:09 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.308 01:39:09 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.308 01:39:09 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.308 01:39:09 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:21.308 01:39:09 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:21.308 01:39:09 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:21.308 01:39:09 -- setup/hugepages.sh@73 -- # return 0 00:03:21.308 01:39:09 -- setup/hugepages.sh@137 -- # setup output 00:03:21.308 01:39:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.308 01:39:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:22.685 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:22.685 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:22.685 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:22.685 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:22.685 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:22.685 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:22.685 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:22.685 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:22.685 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:23.624 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:23.624 01:39:12 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:23.624 01:39:12 -- setup/hugepages.sh@89 -- # local node 00:03:23.624 01:39:12 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.624 01:39:12 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.624 01:39:12 -- setup/hugepages.sh@92 -- # local surp 00:03:23.624 01:39:12 -- setup/hugepages.sh@93 -- # local resv 00:03:23.624 01:39:12 -- setup/hugepages.sh@94 -- # local anon 00:03:23.624 01:39:12 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.624 01:39:12 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.624 01:39:12 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.624 01:39:12 -- setup/common.sh@18 -- # local node= 00:03:23.624 01:39:12 -- setup/common.sh@19 -- # local var val 00:03:23.624 01:39:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.624 01:39:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.625 01:39:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.625 01:39:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.625 01:39:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.625 01:39:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45304296 kB' 'MemAvailable: 49061324 kB' 'Buffers: 3740 kB' 'Cached: 10641144 kB' 'SwapCached: 0 kB' 'Active: 7339860 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939592 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457624 kB' 'Mapped: 174536 kB' 'Shmem: 6485268 kB' 'KReclaimable: 181984 kB' 'Slab: 687452 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505468 kB' 'KernelStack: 12800 kB' 'PageTables: 8012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8026892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.625 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.625 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.626 01:39:12 -- setup/common.sh@33 -- # echo 0 00:03:23.626 01:39:12 -- setup/common.sh@33 -- # return 0 00:03:23.626 01:39:12 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.626 01:39:12 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.626 01:39:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.626 01:39:12 -- setup/common.sh@18 -- # local node= 00:03:23.626 01:39:12 -- setup/common.sh@19 -- # local var val 00:03:23.626 01:39:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.626 01:39:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.626 01:39:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.626 01:39:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.626 01:39:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.626 01:39:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45308756 kB' 'MemAvailable: 49065784 kB' 'Buffers: 3740 kB' 'Cached: 10641148 kB' 'SwapCached: 0 kB' 'Active: 7339528 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939260 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457284 kB' 'Mapped: 174496 kB' 'Shmem: 6485272 kB' 'KReclaimable: 181984 kB' 'Slab: 687460 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505476 kB' 'KernelStack: 12768 kB' 'PageTables: 7884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8026904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.626 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.626 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.627 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.627 01:39:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.887 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.887 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.888 01:39:12 -- setup/common.sh@33 -- # echo 0 00:03:23.888 01:39:12 -- setup/common.sh@33 -- # return 0 00:03:23.888 01:39:12 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.888 01:39:12 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.888 01:39:12 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.888 01:39:12 -- setup/common.sh@18 -- # local node= 00:03:23.888 01:39:12 -- setup/common.sh@19 -- # local var val 00:03:23.888 01:39:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.888 01:39:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.888 01:39:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.888 01:39:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.888 01:39:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.888 01:39:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45308824 kB' 'MemAvailable: 49065852 kB' 'Buffers: 3740 kB' 'Cached: 10641160 kB' 'SwapCached: 0 kB' 'Active: 7339452 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939184 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457168 kB' 'Mapped: 174496 kB' 'Shmem: 6485284 kB' 'KReclaimable: 181984 kB' 'Slab: 687496 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505512 kB' 'KernelStack: 12768 kB' 'PageTables: 7860 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8026920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.888 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.888 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.889 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.889 01:39:12 -- setup/common.sh@33 -- # echo 0 00:03:23.889 01:39:12 -- setup/common.sh@33 -- # return 0 00:03:23.889 01:39:12 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.889 01:39:12 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.889 nr_hugepages=1024 00:03:23.889 01:39:12 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.889 resv_hugepages=0 00:03:23.889 01:39:12 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.889 surplus_hugepages=0 00:03:23.889 01:39:12 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.889 anon_hugepages=0 00:03:23.889 01:39:12 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.889 01:39:12 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.889 01:39:12 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.889 01:39:12 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.889 01:39:12 -- setup/common.sh@18 -- # local node= 00:03:23.889 01:39:12 -- setup/common.sh@19 -- # local var val 00:03:23.889 01:39:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.889 01:39:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.889 01:39:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.889 01:39:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.889 01:39:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.889 01:39:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.889 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45309556 kB' 'MemAvailable: 49066584 kB' 'Buffers: 3740 kB' 'Cached: 10641172 kB' 'SwapCached: 0 kB' 'Active: 7339380 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939112 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457108 kB' 'Mapped: 174496 kB' 'Shmem: 6485296 kB' 'KReclaimable: 181984 kB' 'Slab: 687496 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505512 kB' 'KernelStack: 12752 kB' 'PageTables: 7816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8026936 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.890 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.890 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.891 01:39:12 -- setup/common.sh@33 -- # echo 1024 00:03:23.891 01:39:12 -- setup/common.sh@33 -- # return 0 00:03:23.891 01:39:12 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.891 01:39:12 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.891 01:39:12 -- setup/hugepages.sh@27 -- # local node 00:03:23.891 01:39:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.891 01:39:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:23.891 01:39:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.891 01:39:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.891 01:39:12 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.891 01:39:12 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.891 01:39:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.891 01:39:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.891 01:39:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.891 01:39:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.891 01:39:12 -- setup/common.sh@18 -- # local node=0 00:03:23.891 01:39:12 -- setup/common.sh@19 -- # local var val 00:03:23.891 01:39:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.891 01:39:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.891 01:39:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.891 01:39:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.891 01:39:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.891 01:39:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20323696 kB' 'MemUsed: 12502160 kB' 'SwapCached: 0 kB' 'Active: 5539884 kB' 'Inactive: 3508956 kB' 'Active(anon): 5300276 kB' 'Inactive(anon): 0 kB' 'Active(file): 239608 kB' 'Inactive(file): 3508956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8937068 kB' 'Mapped: 121340 kB' 'AnonPages: 114896 kB' 'Shmem: 5188504 kB' 'KernelStack: 7336 kB' 'PageTables: 3868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113676 kB' 'Slab: 434572 kB' 'SReclaimable: 113676 kB' 'SUnreclaim: 320896 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.891 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.891 01:39:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # continue 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.892 01:39:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.892 01:39:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.892 01:39:12 -- setup/common.sh@33 -- # echo 0 00:03:23.892 01:39:12 -- setup/common.sh@33 -- # return 0 00:03:23.892 01:39:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.892 01:39:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.892 01:39:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.892 01:39:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.892 01:39:12 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:23.892 node0=1024 expecting 1024 00:03:23.892 01:39:12 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:23.892 00:03:23.892 real 0m2.519s 00:03:23.892 user 0m0.676s 00:03:23.892 sys 0m0.967s 00:03:23.892 01:39:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.892 01:39:12 -- common/autotest_common.sh@10 -- # set +x 00:03:23.892 ************************************ 00:03:23.892 END TEST default_setup 00:03:23.892 ************************************ 00:03:23.892 01:39:12 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:23.892 01:39:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.892 01:39:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.892 01:39:12 -- common/autotest_common.sh@10 -- # set +x 00:03:23.893 ************************************ 00:03:23.893 START TEST per_node_1G_alloc 00:03:23.893 ************************************ 00:03:23.893 01:39:12 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:23.893 01:39:12 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:23.893 01:39:12 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:23.893 01:39:12 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:23.893 01:39:12 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:23.893 01:39:12 -- setup/hugepages.sh@51 -- # shift 00:03:23.893 01:39:12 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:23.893 01:39:12 -- setup/hugepages.sh@52 -- # local node_ids 00:03:23.893 01:39:12 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.893 01:39:12 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:23.893 01:39:12 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:23.893 01:39:12 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:23.893 01:39:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.893 01:39:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:23.893 01:39:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.893 01:39:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.893 01:39:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.893 01:39:12 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:23.893 01:39:12 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:23.893 01:39:12 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:23.893 01:39:12 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:23.893 01:39:12 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:23.893 01:39:12 -- setup/hugepages.sh@73 -- # return 0 00:03:23.893 01:39:12 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:23.893 01:39:12 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:23.893 01:39:12 -- setup/hugepages.sh@146 -- # setup output 00:03:23.893 01:39:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.893 01:39:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:25.275 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.275 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:25.275 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.275 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.275 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.275 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.275 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.275 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.275 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.275 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.275 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.275 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.275 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.275 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.275 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.275 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.275 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.275 01:39:13 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:25.275 01:39:13 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:25.275 01:39:13 -- setup/hugepages.sh@89 -- # local node 00:03:25.275 01:39:13 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:25.275 01:39:13 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:25.275 01:39:13 -- setup/hugepages.sh@92 -- # local surp 00:03:25.275 01:39:13 -- setup/hugepages.sh@93 -- # local resv 00:03:25.275 01:39:13 -- setup/hugepages.sh@94 -- # local anon 00:03:25.275 01:39:13 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:25.275 01:39:13 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:25.275 01:39:13 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:25.275 01:39:13 -- setup/common.sh@18 -- # local node= 00:03:25.275 01:39:13 -- setup/common.sh@19 -- # local var val 00:03:25.275 01:39:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.275 01:39:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.275 01:39:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.275 01:39:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.275 01:39:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.275 01:39:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.275 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.275 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45349028 kB' 'MemAvailable: 49106056 kB' 'Buffers: 3740 kB' 'Cached: 10641236 kB' 'SwapCached: 0 kB' 'Active: 7340176 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939908 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457720 kB' 'Mapped: 174532 kB' 'Shmem: 6485360 kB' 'KReclaimable: 181984 kB' 'Slab: 687780 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505796 kB' 'KernelStack: 12784 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027116 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.276 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.276 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.277 01:39:13 -- setup/common.sh@33 -- # echo 0 00:03:25.277 01:39:13 -- setup/common.sh@33 -- # return 0 00:03:25.277 01:39:13 -- setup/hugepages.sh@97 -- # anon=0 00:03:25.277 01:39:13 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:25.277 01:39:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.277 01:39:13 -- setup/common.sh@18 -- # local node= 00:03:25.277 01:39:13 -- setup/common.sh@19 -- # local var val 00:03:25.277 01:39:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.277 01:39:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.277 01:39:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.277 01:39:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.277 01:39:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.277 01:39:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45352700 kB' 'MemAvailable: 49109728 kB' 'Buffers: 3740 kB' 'Cached: 10641236 kB' 'SwapCached: 0 kB' 'Active: 7340424 kB' 'Inactive: 3759348 kB' 'Active(anon): 6940156 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457944 kB' 'Mapped: 174532 kB' 'Shmem: 6485360 kB' 'KReclaimable: 181984 kB' 'Slab: 687780 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505796 kB' 'KernelStack: 12768 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027128 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.277 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.277 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.278 01:39:13 -- setup/common.sh@33 -- # echo 0 00:03:25.278 01:39:13 -- setup/common.sh@33 -- # return 0 00:03:25.278 01:39:13 -- setup/hugepages.sh@99 -- # surp=0 00:03:25.278 01:39:13 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:25.278 01:39:13 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:25.278 01:39:13 -- setup/common.sh@18 -- # local node= 00:03:25.278 01:39:13 -- setup/common.sh@19 -- # local var val 00:03:25.278 01:39:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.278 01:39:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.278 01:39:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.278 01:39:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.278 01:39:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.278 01:39:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45353340 kB' 'MemAvailable: 49110368 kB' 'Buffers: 3740 kB' 'Cached: 10641248 kB' 'SwapCached: 0 kB' 'Active: 7339804 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939536 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457324 kB' 'Mapped: 174508 kB' 'Shmem: 6485372 kB' 'KReclaimable: 181984 kB' 'Slab: 687804 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505820 kB' 'KernelStack: 12768 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.278 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.278 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.279 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.279 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.280 01:39:13 -- setup/common.sh@33 -- # echo 0 00:03:25.280 01:39:13 -- setup/common.sh@33 -- # return 0 00:03:25.280 01:39:13 -- setup/hugepages.sh@100 -- # resv=0 00:03:25.280 01:39:13 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:25.280 nr_hugepages=1024 00:03:25.280 01:39:13 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:25.280 resv_hugepages=0 00:03:25.280 01:39:13 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:25.280 surplus_hugepages=0 00:03:25.280 01:39:13 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:25.280 anon_hugepages=0 00:03:25.280 01:39:13 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.280 01:39:13 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:25.280 01:39:13 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:25.280 01:39:13 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:25.280 01:39:13 -- setup/common.sh@18 -- # local node= 00:03:25.280 01:39:13 -- setup/common.sh@19 -- # local var val 00:03:25.280 01:39:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.280 01:39:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.280 01:39:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.280 01:39:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.280 01:39:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.280 01:39:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45353720 kB' 'MemAvailable: 49110748 kB' 'Buffers: 3740 kB' 'Cached: 10641264 kB' 'SwapCached: 0 kB' 'Active: 7339732 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939464 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457264 kB' 'Mapped: 174508 kB' 'Shmem: 6485388 kB' 'KReclaimable: 181984 kB' 'Slab: 687904 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505920 kB' 'KernelStack: 12784 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027156 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.280 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.280 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.281 01:39:13 -- setup/common.sh@33 -- # echo 1024 00:03:25.281 01:39:13 -- setup/common.sh@33 -- # return 0 00:03:25.281 01:39:13 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.281 01:39:13 -- setup/hugepages.sh@112 -- # get_nodes 00:03:25.281 01:39:13 -- setup/hugepages.sh@27 -- # local node 00:03:25.281 01:39:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.281 01:39:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.281 01:39:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.281 01:39:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.281 01:39:13 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:25.281 01:39:13 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:25.281 01:39:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.281 01:39:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.281 01:39:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:25.281 01:39:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.281 01:39:13 -- setup/common.sh@18 -- # local node=0 00:03:25.281 01:39:13 -- setup/common.sh@19 -- # local var val 00:03:25.281 01:39:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.281 01:39:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.281 01:39:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:25.281 01:39:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:25.281 01:39:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.281 01:39:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.281 01:39:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21394492 kB' 'MemUsed: 11431364 kB' 'SwapCached: 0 kB' 'Active: 5540624 kB' 'Inactive: 3508956 kB' 'Active(anon): 5301016 kB' 'Inactive(anon): 0 kB' 'Active(file): 239608 kB' 'Inactive(file): 3508956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8937120 kB' 'Mapped: 121352 kB' 'AnonPages: 115676 kB' 'Shmem: 5188556 kB' 'KernelStack: 7352 kB' 'PageTables: 3968 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113676 kB' 'Slab: 434788 kB' 'SReclaimable: 113676 kB' 'SUnreclaim: 321112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.281 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.281 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.282 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.282 01:39:13 -- setup/common.sh@33 -- # echo 0 00:03:25.282 01:39:13 -- setup/common.sh@33 -- # return 0 00:03:25.282 01:39:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.282 01:39:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.282 01:39:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.282 01:39:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:25.282 01:39:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.282 01:39:13 -- setup/common.sh@18 -- # local node=1 00:03:25.282 01:39:13 -- setup/common.sh@19 -- # local var val 00:03:25.282 01:39:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.282 01:39:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.282 01:39:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:25.282 01:39:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:25.282 01:39:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.282 01:39:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.282 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 23958976 kB' 'MemUsed: 3750824 kB' 'SwapCached: 0 kB' 'Active: 1799100 kB' 'Inactive: 250392 kB' 'Active(anon): 1638440 kB' 'Inactive(anon): 0 kB' 'Active(file): 160660 kB' 'Inactive(file): 250392 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1707900 kB' 'Mapped: 53156 kB' 'AnonPages: 341592 kB' 'Shmem: 1296848 kB' 'KernelStack: 5432 kB' 'PageTables: 3888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68308 kB' 'Slab: 253116 kB' 'SReclaimable: 68308 kB' 'SUnreclaim: 184808 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # continue 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.283 01:39:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.283 01:39:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.283 01:39:13 -- setup/common.sh@33 -- # echo 0 00:03:25.283 01:39:13 -- setup/common.sh@33 -- # return 0 00:03:25.283 01:39:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.283 01:39:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.283 01:39:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.283 01:39:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.283 01:39:13 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:25.283 node0=512 expecting 512 00:03:25.284 01:39:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.284 01:39:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.284 01:39:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.284 01:39:13 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:25.284 node1=512 expecting 512 00:03:25.284 01:39:13 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:25.284 00:03:25.284 real 0m1.498s 00:03:25.284 user 0m0.642s 00:03:25.284 sys 0m0.815s 00:03:25.284 01:39:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:25.284 01:39:13 -- common/autotest_common.sh@10 -- # set +x 00:03:25.284 ************************************ 00:03:25.284 END TEST per_node_1G_alloc 00:03:25.284 ************************************ 00:03:25.284 01:39:13 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:25.284 01:39:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.284 01:39:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.284 01:39:13 -- common/autotest_common.sh@10 -- # set +x 00:03:25.284 ************************************ 00:03:25.284 START TEST even_2G_alloc 00:03:25.284 ************************************ 00:03:25.284 01:39:13 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:25.284 01:39:13 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:25.284 01:39:13 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:25.284 01:39:13 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:25.284 01:39:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:25.284 01:39:13 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:25.284 01:39:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:25.284 01:39:13 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:25.284 01:39:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:25.284 01:39:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:25.284 01:39:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:25.284 01:39:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:25.284 01:39:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:25.284 01:39:13 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:25.284 01:39:13 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:25.284 01:39:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.284 01:39:13 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:25.284 01:39:13 -- setup/hugepages.sh@83 -- # : 512 00:03:25.284 01:39:13 -- setup/hugepages.sh@84 -- # : 1 00:03:25.284 01:39:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.284 01:39:13 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:25.284 01:39:13 -- setup/hugepages.sh@83 -- # : 0 00:03:25.284 01:39:13 -- setup/hugepages.sh@84 -- # : 0 00:03:25.284 01:39:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.284 01:39:13 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:25.284 01:39:13 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:25.284 01:39:13 -- setup/hugepages.sh@153 -- # setup output 00:03:25.284 01:39:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.284 01:39:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.664 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.664 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.664 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.664 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.664 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.664 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.664 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.664 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.664 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.664 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.664 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.664 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.664 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.664 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.664 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.664 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.664 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.664 01:39:15 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:26.664 01:39:15 -- setup/hugepages.sh@89 -- # local node 00:03:26.664 01:39:15 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.664 01:39:15 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.664 01:39:15 -- setup/hugepages.sh@92 -- # local surp 00:03:26.664 01:39:15 -- setup/hugepages.sh@93 -- # local resv 00:03:26.664 01:39:15 -- setup/hugepages.sh@94 -- # local anon 00:03:26.664 01:39:15 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.664 01:39:15 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.664 01:39:15 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.664 01:39:15 -- setup/common.sh@18 -- # local node= 00:03:26.664 01:39:15 -- setup/common.sh@19 -- # local var val 00:03:26.664 01:39:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.664 01:39:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.664 01:39:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.664 01:39:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.664 01:39:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.664 01:39:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.664 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.664 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45323992 kB' 'MemAvailable: 49081020 kB' 'Buffers: 3740 kB' 'Cached: 10641320 kB' 'SwapCached: 0 kB' 'Active: 7340220 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939952 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457716 kB' 'Mapped: 174544 kB' 'Shmem: 6485444 kB' 'KReclaimable: 181984 kB' 'Slab: 687344 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505360 kB' 'KernelStack: 12784 kB' 'PageTables: 7824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027200 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.665 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.665 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.666 01:39:15 -- setup/common.sh@33 -- # echo 0 00:03:26.666 01:39:15 -- setup/common.sh@33 -- # return 0 00:03:26.666 01:39:15 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.666 01:39:15 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.666 01:39:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.666 01:39:15 -- setup/common.sh@18 -- # local node= 00:03:26.666 01:39:15 -- setup/common.sh@19 -- # local var val 00:03:26.666 01:39:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.666 01:39:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.666 01:39:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.666 01:39:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.666 01:39:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.666 01:39:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45328788 kB' 'MemAvailable: 49085816 kB' 'Buffers: 3740 kB' 'Cached: 10641324 kB' 'SwapCached: 0 kB' 'Active: 7340288 kB' 'Inactive: 3759348 kB' 'Active(anon): 6940020 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457768 kB' 'Mapped: 174544 kB' 'Shmem: 6485448 kB' 'KReclaimable: 181984 kB' 'Slab: 687296 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505312 kB' 'KernelStack: 12752 kB' 'PageTables: 7716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027212 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.666 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.666 01:39:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.667 01:39:15 -- setup/common.sh@33 -- # echo 0 00:03:26.667 01:39:15 -- setup/common.sh@33 -- # return 0 00:03:26.667 01:39:15 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.667 01:39:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.667 01:39:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.667 01:39:15 -- setup/common.sh@18 -- # local node= 00:03:26.667 01:39:15 -- setup/common.sh@19 -- # local var val 00:03:26.667 01:39:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.667 01:39:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.667 01:39:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.667 01:39:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.667 01:39:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.667 01:39:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45328656 kB' 'MemAvailable: 49085684 kB' 'Buffers: 3740 kB' 'Cached: 10641332 kB' 'SwapCached: 0 kB' 'Active: 7339840 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939572 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457308 kB' 'Mapped: 174512 kB' 'Shmem: 6485456 kB' 'KReclaimable: 181984 kB' 'Slab: 687332 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505348 kB' 'KernelStack: 12784 kB' 'PageTables: 7812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.667 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.667 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.668 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.668 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.668 01:39:15 -- setup/common.sh@33 -- # echo 0 00:03:26.668 01:39:15 -- setup/common.sh@33 -- # return 0 00:03:26.668 01:39:15 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.668 01:39:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:26.668 nr_hugepages=1024 00:03:26.668 01:39:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.668 resv_hugepages=0 00:03:26.668 01:39:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.668 surplus_hugepages=0 00:03:26.669 01:39:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.669 anon_hugepages=0 00:03:26.669 01:39:15 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.669 01:39:15 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:26.669 01:39:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.669 01:39:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.669 01:39:15 -- setup/common.sh@18 -- # local node= 00:03:26.669 01:39:15 -- setup/common.sh@19 -- # local var val 00:03:26.669 01:39:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.669 01:39:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.669 01:39:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.669 01:39:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.669 01:39:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.669 01:39:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45329644 kB' 'MemAvailable: 49086672 kB' 'Buffers: 3740 kB' 'Cached: 10641348 kB' 'SwapCached: 0 kB' 'Active: 7340084 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939816 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457584 kB' 'Mapped: 174512 kB' 'Shmem: 6485472 kB' 'KReclaimable: 181984 kB' 'Slab: 687332 kB' 'SReclaimable: 181984 kB' 'SUnreclaim: 505348 kB' 'KernelStack: 12832 kB' 'PageTables: 7984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8026872 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.669 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.669 01:39:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.670 01:39:15 -- setup/common.sh@33 -- # echo 1024 00:03:26.670 01:39:15 -- setup/common.sh@33 -- # return 0 00:03:26.670 01:39:15 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.670 01:39:15 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.670 01:39:15 -- setup/hugepages.sh@27 -- # local node 00:03:26.670 01:39:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.670 01:39:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:26.670 01:39:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.670 01:39:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:26.670 01:39:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.670 01:39:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.670 01:39:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.670 01:39:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.670 01:39:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.670 01:39:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.670 01:39:15 -- setup/common.sh@18 -- # local node=0 00:03:26.670 01:39:15 -- setup/common.sh@19 -- # local var val 00:03:26.670 01:39:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.670 01:39:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.670 01:39:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.670 01:39:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.670 01:39:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.670 01:39:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21378368 kB' 'MemUsed: 11447488 kB' 'SwapCached: 0 kB' 'Active: 5538332 kB' 'Inactive: 3508956 kB' 'Active(anon): 5298724 kB' 'Inactive(anon): 0 kB' 'Active(file): 239608 kB' 'Inactive(file): 3508956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8937200 kB' 'Mapped: 120488 kB' 'AnonPages: 113260 kB' 'Shmem: 5188636 kB' 'KernelStack: 7288 kB' 'PageTables: 3560 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113676 kB' 'Slab: 434256 kB' 'SReclaimable: 113676 kB' 'SUnreclaim: 320580 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.670 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.670 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@33 -- # echo 0 00:03:26.671 01:39:15 -- setup/common.sh@33 -- # return 0 00:03:26.671 01:39:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.671 01:39:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.671 01:39:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.671 01:39:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:26.671 01:39:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.671 01:39:15 -- setup/common.sh@18 -- # local node=1 00:03:26.671 01:39:15 -- setup/common.sh@19 -- # local var val 00:03:26.671 01:39:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.671 01:39:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.671 01:39:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:26.671 01:39:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:26.671 01:39:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.671 01:39:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 23953996 kB' 'MemUsed: 3755804 kB' 'SwapCached: 0 kB' 'Active: 1798852 kB' 'Inactive: 250392 kB' 'Active(anon): 1638192 kB' 'Inactive(anon): 0 kB' 'Active(file): 160660 kB' 'Inactive(file): 250392 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1707908 kB' 'Mapped: 52948 kB' 'AnonPages: 341404 kB' 'Shmem: 1296856 kB' 'KernelStack: 5400 kB' 'PageTables: 3820 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68276 kB' 'Slab: 253016 kB' 'SReclaimable: 68276 kB' 'SUnreclaim: 184740 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.671 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.671 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # continue 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.672 01:39:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.672 01:39:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.672 01:39:15 -- setup/common.sh@33 -- # echo 0 00:03:26.672 01:39:15 -- setup/common.sh@33 -- # return 0 00:03:26.672 01:39:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.672 01:39:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.672 01:39:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.672 01:39:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.672 01:39:15 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:26.672 node0=512 expecting 512 00:03:26.672 01:39:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.672 01:39:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.672 01:39:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.672 01:39:15 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:26.672 node1=512 expecting 512 00:03:26.672 01:39:15 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:26.672 00:03:26.672 real 0m1.402s 00:03:26.672 user 0m0.557s 00:03:26.672 sys 0m0.802s 00:03:26.672 01:39:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.672 01:39:15 -- common/autotest_common.sh@10 -- # set +x 00:03:26.672 ************************************ 00:03:26.672 END TEST even_2G_alloc 00:03:26.672 ************************************ 00:03:26.931 01:39:15 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:26.931 01:39:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.931 01:39:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.931 01:39:15 -- common/autotest_common.sh@10 -- # set +x 00:03:26.931 ************************************ 00:03:26.931 START TEST odd_alloc 00:03:26.931 ************************************ 00:03:26.931 01:39:15 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:26.931 01:39:15 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:26.931 01:39:15 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:26.931 01:39:15 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.931 01:39:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.931 01:39:15 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:26.931 01:39:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.931 01:39:15 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.931 01:39:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.931 01:39:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:26.931 01:39:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.931 01:39:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.931 01:39:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.931 01:39:15 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.931 01:39:15 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:26.931 01:39:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.931 01:39:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:26.931 01:39:15 -- setup/hugepages.sh@83 -- # : 513 00:03:26.931 01:39:15 -- setup/hugepages.sh@84 -- # : 1 00:03:26.931 01:39:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.931 01:39:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:26.931 01:39:15 -- setup/hugepages.sh@83 -- # : 0 00:03:26.931 01:39:15 -- setup/hugepages.sh@84 -- # : 0 00:03:26.931 01:39:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.931 01:39:15 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:26.931 01:39:15 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:26.931 01:39:15 -- setup/hugepages.sh@160 -- # setup output 00:03:26.931 01:39:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.931 01:39:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:27.867 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.867 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:27.867 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.867 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.867 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.867 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.867 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.867 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.867 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:27.867 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.867 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.867 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.867 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.867 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.867 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.867 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.867 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.130 01:39:16 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:28.130 01:39:16 -- setup/hugepages.sh@89 -- # local node 00:03:28.130 01:39:16 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:28.130 01:39:16 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:28.130 01:39:16 -- setup/hugepages.sh@92 -- # local surp 00:03:28.130 01:39:16 -- setup/hugepages.sh@93 -- # local resv 00:03:28.130 01:39:16 -- setup/hugepages.sh@94 -- # local anon 00:03:28.130 01:39:16 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:28.130 01:39:16 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:28.130 01:39:16 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:28.130 01:39:16 -- setup/common.sh@18 -- # local node= 00:03:28.130 01:39:16 -- setup/common.sh@19 -- # local var val 00:03:28.130 01:39:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.130 01:39:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.130 01:39:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.130 01:39:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.130 01:39:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.130 01:39:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.130 01:39:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45345204 kB' 'MemAvailable: 49102216 kB' 'Buffers: 3740 kB' 'Cached: 10641416 kB' 'SwapCached: 0 kB' 'Active: 7338256 kB' 'Inactive: 3759348 kB' 'Active(anon): 6937988 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455712 kB' 'Mapped: 173564 kB' 'Shmem: 6485540 kB' 'KReclaimable: 181952 kB' 'Slab: 687300 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505348 kB' 'KernelStack: 12752 kB' 'PageTables: 7644 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8013752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.130 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.130 01:39:16 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.131 01:39:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.131 01:39:16 -- setup/common.sh@33 -- # echo 0 00:03:28.131 01:39:16 -- setup/common.sh@33 -- # return 0 00:03:28.131 01:39:16 -- setup/hugepages.sh@97 -- # anon=0 00:03:28.131 01:39:16 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:28.131 01:39:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.131 01:39:16 -- setup/common.sh@18 -- # local node= 00:03:28.131 01:39:16 -- setup/common.sh@19 -- # local var val 00:03:28.131 01:39:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.131 01:39:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.131 01:39:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.131 01:39:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.131 01:39:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.131 01:39:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.131 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45346916 kB' 'MemAvailable: 49103928 kB' 'Buffers: 3740 kB' 'Cached: 10641420 kB' 'SwapCached: 0 kB' 'Active: 7340908 kB' 'Inactive: 3759348 kB' 'Active(anon): 6940640 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458468 kB' 'Mapped: 174000 kB' 'Shmem: 6485544 kB' 'KReclaimable: 181952 kB' 'Slab: 687288 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505336 kB' 'KernelStack: 12800 kB' 'PageTables: 7768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8019148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.132 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.132 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.133 01:39:16 -- setup/common.sh@33 -- # echo 0 00:03:28.133 01:39:16 -- setup/common.sh@33 -- # return 0 00:03:28.133 01:39:16 -- setup/hugepages.sh@99 -- # surp=0 00:03:28.133 01:39:16 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:28.133 01:39:16 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:28.133 01:39:16 -- setup/common.sh@18 -- # local node= 00:03:28.133 01:39:16 -- setup/common.sh@19 -- # local var val 00:03:28.133 01:39:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.133 01:39:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.133 01:39:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.133 01:39:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.133 01:39:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.133 01:39:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45345160 kB' 'MemAvailable: 49102172 kB' 'Buffers: 3740 kB' 'Cached: 10641432 kB' 'SwapCached: 0 kB' 'Active: 7343892 kB' 'Inactive: 3759348 kB' 'Active(anon): 6943624 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461448 kB' 'Mapped: 173880 kB' 'Shmem: 6485556 kB' 'KReclaimable: 181952 kB' 'Slab: 687256 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505304 kB' 'KernelStack: 12896 kB' 'PageTables: 7700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8022548 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198220 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.133 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.133 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.134 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.134 01:39:16 -- setup/common.sh@33 -- # echo 0 00:03:28.134 01:39:16 -- setup/common.sh@33 -- # return 0 00:03:28.134 01:39:16 -- setup/hugepages.sh@100 -- # resv=0 00:03:28.134 01:39:16 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:28.134 nr_hugepages=1025 00:03:28.134 01:39:16 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:28.134 resv_hugepages=0 00:03:28.134 01:39:16 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:28.134 surplus_hugepages=0 00:03:28.134 01:39:16 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:28.134 anon_hugepages=0 00:03:28.134 01:39:16 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:28.134 01:39:16 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:28.134 01:39:16 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:28.134 01:39:16 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:28.134 01:39:16 -- setup/common.sh@18 -- # local node= 00:03:28.134 01:39:16 -- setup/common.sh@19 -- # local var val 00:03:28.134 01:39:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.134 01:39:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.134 01:39:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.134 01:39:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.134 01:39:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.134 01:39:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.134 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45343108 kB' 'MemAvailable: 49100120 kB' 'Buffers: 3740 kB' 'Cached: 10641444 kB' 'SwapCached: 0 kB' 'Active: 7344592 kB' 'Inactive: 3759348 kB' 'Active(anon): 6944324 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461244 kB' 'Mapped: 174288 kB' 'Shmem: 6485568 kB' 'KReclaimable: 181952 kB' 'Slab: 687248 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505296 kB' 'KernelStack: 12896 kB' 'PageTables: 9152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8023940 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.135 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.135 01:39:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.136 01:39:16 -- setup/common.sh@33 -- # echo 1025 00:03:28.136 01:39:16 -- setup/common.sh@33 -- # return 0 00:03:28.136 01:39:16 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:28.136 01:39:16 -- setup/hugepages.sh@112 -- # get_nodes 00:03:28.136 01:39:16 -- setup/hugepages.sh@27 -- # local node 00:03:28.136 01:39:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.136 01:39:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:28.136 01:39:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.136 01:39:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:28.136 01:39:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:28.136 01:39:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:28.136 01:39:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.136 01:39:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.136 01:39:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:28.136 01:39:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.136 01:39:16 -- setup/common.sh@18 -- # local node=0 00:03:28.136 01:39:16 -- setup/common.sh@19 -- # local var val 00:03:28.136 01:39:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.136 01:39:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.136 01:39:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:28.136 01:39:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:28.136 01:39:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.136 01:39:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21384964 kB' 'MemUsed: 11440892 kB' 'SwapCached: 0 kB' 'Active: 5542704 kB' 'Inactive: 3508956 kB' 'Active(anon): 5303096 kB' 'Inactive(anon): 0 kB' 'Active(file): 239608 kB' 'Inactive(file): 3508956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8937232 kB' 'Mapped: 120496 kB' 'AnonPages: 117600 kB' 'Shmem: 5188668 kB' 'KernelStack: 7592 kB' 'PageTables: 4372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113676 kB' 'Slab: 434108 kB' 'SReclaimable: 113676 kB' 'SUnreclaim: 320432 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.136 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.136 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@33 -- # echo 0 00:03:28.137 01:39:16 -- setup/common.sh@33 -- # return 0 00:03:28.137 01:39:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.137 01:39:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.137 01:39:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.137 01:39:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:28.137 01:39:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.137 01:39:16 -- setup/common.sh@18 -- # local node=1 00:03:28.137 01:39:16 -- setup/common.sh@19 -- # local var val 00:03:28.137 01:39:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.137 01:39:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.137 01:39:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:28.137 01:39:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:28.137 01:39:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.137 01:39:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 23960392 kB' 'MemUsed: 3749408 kB' 'SwapCached: 0 kB' 'Active: 1799740 kB' 'Inactive: 250392 kB' 'Active(anon): 1639080 kB' 'Inactive(anon): 0 kB' 'Active(file): 160660 kB' 'Inactive(file): 250392 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1707968 kB' 'Mapped: 53792 kB' 'AnonPages: 342256 kB' 'Shmem: 1296916 kB' 'KernelStack: 5464 kB' 'PageTables: 4048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68276 kB' 'Slab: 253140 kB' 'SReclaimable: 68276 kB' 'SUnreclaim: 184864 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.137 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.137 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # continue 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.138 01:39:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.138 01:39:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.138 01:39:16 -- setup/common.sh@33 -- # echo 0 00:03:28.138 01:39:16 -- setup/common.sh@33 -- # return 0 00:03:28.138 01:39:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.138 01:39:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.138 01:39:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.138 01:39:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.138 01:39:16 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:28.138 node0=512 expecting 513 00:03:28.138 01:39:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.138 01:39:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.138 01:39:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.138 01:39:16 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:28.138 node1=513 expecting 512 00:03:28.138 01:39:16 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:28.138 00:03:28.138 real 0m1.385s 00:03:28.138 user 0m0.596s 00:03:28.138 sys 0m0.751s 00:03:28.138 01:39:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.138 01:39:16 -- common/autotest_common.sh@10 -- # set +x 00:03:28.138 ************************************ 00:03:28.138 END TEST odd_alloc 00:03:28.138 ************************************ 00:03:28.138 01:39:16 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:28.138 01:39:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.138 01:39:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.138 01:39:16 -- common/autotest_common.sh@10 -- # set +x 00:03:28.138 ************************************ 00:03:28.138 START TEST custom_alloc 00:03:28.138 ************************************ 00:03:28.138 01:39:16 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:28.138 01:39:16 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:28.138 01:39:16 -- setup/hugepages.sh@169 -- # local node 00:03:28.138 01:39:16 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:28.138 01:39:16 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:28.138 01:39:16 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:28.138 01:39:16 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:28.138 01:39:16 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:28.138 01:39:16 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:28.138 01:39:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:28.138 01:39:16 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:28.138 01:39:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:28.138 01:39:16 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:28.138 01:39:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.138 01:39:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:28.138 01:39:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.138 01:39:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.139 01:39:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.139 01:39:16 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:28.139 01:39:16 -- setup/hugepages.sh@83 -- # : 256 00:03:28.139 01:39:16 -- setup/hugepages.sh@84 -- # : 1 00:03:28.139 01:39:16 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:28.139 01:39:16 -- setup/hugepages.sh@83 -- # : 0 00:03:28.139 01:39:16 -- setup/hugepages.sh@84 -- # : 0 00:03:28.139 01:39:16 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:28.139 01:39:16 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:28.139 01:39:16 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:28.139 01:39:16 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:28.139 01:39:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:28.139 01:39:16 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:28.139 01:39:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.139 01:39:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:28.139 01:39:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.139 01:39:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.139 01:39:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.139 01:39:16 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:28.139 01:39:16 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:28.139 01:39:16 -- setup/hugepages.sh@78 -- # return 0 00:03:28.139 01:39:16 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:28.139 01:39:16 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:28.139 01:39:16 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:28.139 01:39:16 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:28.139 01:39:16 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:28.139 01:39:16 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:28.139 01:39:16 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:28.139 01:39:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.139 01:39:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:28.139 01:39:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.139 01:39:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.139 01:39:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.139 01:39:16 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:28.139 01:39:16 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:28.139 01:39:16 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:28.139 01:39:16 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:28.139 01:39:16 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:28.139 01:39:16 -- setup/hugepages.sh@78 -- # return 0 00:03:28.139 01:39:16 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:28.139 01:39:16 -- setup/hugepages.sh@187 -- # setup output 00:03:28.139 01:39:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.139 01:39:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:29.517 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.517 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.517 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.517 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.517 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.517 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.517 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.517 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.517 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.517 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.517 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.517 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.517 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.517 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.517 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.517 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.517 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.517 01:39:17 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:29.517 01:39:17 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:29.517 01:39:17 -- setup/hugepages.sh@89 -- # local node 00:03:29.517 01:39:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.517 01:39:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.517 01:39:17 -- setup/hugepages.sh@92 -- # local surp 00:03:29.517 01:39:17 -- setup/hugepages.sh@93 -- # local resv 00:03:29.517 01:39:17 -- setup/hugepages.sh@94 -- # local anon 00:03:29.517 01:39:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.517 01:39:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.517 01:39:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.517 01:39:17 -- setup/common.sh@18 -- # local node= 00:03:29.517 01:39:17 -- setup/common.sh@19 -- # local var val 00:03:29.517 01:39:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.517 01:39:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.517 01:39:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.517 01:39:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.517 01:39:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.517 01:39:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.517 01:39:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44281184 kB' 'MemAvailable: 48038196 kB' 'Buffers: 3740 kB' 'Cached: 10641516 kB' 'SwapCached: 0 kB' 'Active: 7337652 kB' 'Inactive: 3759348 kB' 'Active(anon): 6937384 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455004 kB' 'Mapped: 173536 kB' 'Shmem: 6485640 kB' 'KReclaimable: 181952 kB' 'Slab: 687040 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505088 kB' 'KernelStack: 12720 kB' 'PageTables: 7480 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8013852 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:29.517 01:39:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:17 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.517 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.517 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.518 01:39:18 -- setup/common.sh@33 -- # echo 0 00:03:29.518 01:39:18 -- setup/common.sh@33 -- # return 0 00:03:29.518 01:39:18 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.518 01:39:18 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.518 01:39:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.518 01:39:18 -- setup/common.sh@18 -- # local node= 00:03:29.518 01:39:18 -- setup/common.sh@19 -- # local var val 00:03:29.518 01:39:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.518 01:39:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.518 01:39:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.518 01:39:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.518 01:39:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.518 01:39:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44282056 kB' 'MemAvailable: 48039068 kB' 'Buffers: 3740 kB' 'Cached: 10641520 kB' 'SwapCached: 0 kB' 'Active: 7337996 kB' 'Inactive: 3759348 kB' 'Active(anon): 6937728 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455368 kB' 'Mapped: 173536 kB' 'Shmem: 6485644 kB' 'KReclaimable: 181952 kB' 'Slab: 687012 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505060 kB' 'KernelStack: 12736 kB' 'PageTables: 7496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8013864 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198216 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.518 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.518 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.519 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.519 01:39:18 -- setup/common.sh@33 -- # echo 0 00:03:29.519 01:39:18 -- setup/common.sh@33 -- # return 0 00:03:29.519 01:39:18 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.519 01:39:18 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.519 01:39:18 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.519 01:39:18 -- setup/common.sh@18 -- # local node= 00:03:29.519 01:39:18 -- setup/common.sh@19 -- # local var val 00:03:29.519 01:39:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.519 01:39:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.519 01:39:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.519 01:39:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.519 01:39:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.519 01:39:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.519 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44282320 kB' 'MemAvailable: 48039332 kB' 'Buffers: 3740 kB' 'Cached: 10641532 kB' 'SwapCached: 0 kB' 'Active: 7337864 kB' 'Inactive: 3759348 kB' 'Active(anon): 6937596 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455176 kB' 'Mapped: 173460 kB' 'Shmem: 6485656 kB' 'KReclaimable: 181952 kB' 'Slab: 686988 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505036 kB' 'KernelStack: 12736 kB' 'PageTables: 7436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8013880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198216 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.520 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.520 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.782 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.782 01:39:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.782 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.782 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.782 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.782 01:39:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.782 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.782 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.782 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.782 01:39:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.782 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.782 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.782 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.782 01:39:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.783 01:39:18 -- setup/common.sh@33 -- # echo 0 00:03:29.783 01:39:18 -- setup/common.sh@33 -- # return 0 00:03:29.783 01:39:18 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.783 01:39:18 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:29.783 nr_hugepages=1536 00:03:29.783 01:39:18 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.783 resv_hugepages=0 00:03:29.783 01:39:18 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.783 surplus_hugepages=0 00:03:29.783 01:39:18 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.783 anon_hugepages=0 00:03:29.783 01:39:18 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.783 01:39:18 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:29.783 01:39:18 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.783 01:39:18 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.783 01:39:18 -- setup/common.sh@18 -- # local node= 00:03:29.783 01:39:18 -- setup/common.sh@19 -- # local var val 00:03:29.783 01:39:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.783 01:39:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.783 01:39:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.783 01:39:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.783 01:39:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.783 01:39:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44281312 kB' 'MemAvailable: 48038324 kB' 'Buffers: 3740 kB' 'Cached: 10641544 kB' 'SwapCached: 0 kB' 'Active: 7337976 kB' 'Inactive: 3759348 kB' 'Active(anon): 6937708 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455260 kB' 'Mapped: 173460 kB' 'Shmem: 6485668 kB' 'KReclaimable: 181952 kB' 'Slab: 686988 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505036 kB' 'KernelStack: 12768 kB' 'PageTables: 7548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8013892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198216 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.783 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.783 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.784 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.784 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.785 01:39:18 -- setup/common.sh@33 -- # echo 1536 00:03:29.785 01:39:18 -- setup/common.sh@33 -- # return 0 00:03:29.785 01:39:18 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.785 01:39:18 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.785 01:39:18 -- setup/hugepages.sh@27 -- # local node 00:03:29.785 01:39:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.785 01:39:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.785 01:39:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.785 01:39:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.785 01:39:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.785 01:39:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.785 01:39:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.785 01:39:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.785 01:39:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.785 01:39:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.785 01:39:18 -- setup/common.sh@18 -- # local node=0 00:03:29.785 01:39:18 -- setup/common.sh@19 -- # local var val 00:03:29.785 01:39:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.785 01:39:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.785 01:39:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.785 01:39:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.785 01:39:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.785 01:39:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21377952 kB' 'MemUsed: 11447904 kB' 'SwapCached: 0 kB' 'Active: 5538660 kB' 'Inactive: 3508956 kB' 'Active(anon): 5299052 kB' 'Inactive(anon): 0 kB' 'Active(file): 239608 kB' 'Inactive(file): 3508956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8937292 kB' 'Mapped: 120504 kB' 'AnonPages: 113488 kB' 'Shmem: 5188728 kB' 'KernelStack: 7304 kB' 'PageTables: 3608 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113676 kB' 'Slab: 433976 kB' 'SReclaimable: 113676 kB' 'SUnreclaim: 320300 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.785 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.785 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@33 -- # echo 0 00:03:29.786 01:39:18 -- setup/common.sh@33 -- # return 0 00:03:29.786 01:39:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.786 01:39:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.786 01:39:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.786 01:39:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:29.786 01:39:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.786 01:39:18 -- setup/common.sh@18 -- # local node=1 00:03:29.786 01:39:18 -- setup/common.sh@19 -- # local var val 00:03:29.786 01:39:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.786 01:39:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.786 01:39:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:29.786 01:39:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:29.786 01:39:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.786 01:39:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 22903360 kB' 'MemUsed: 4806440 kB' 'SwapCached: 0 kB' 'Active: 1799316 kB' 'Inactive: 250392 kB' 'Active(anon): 1638656 kB' 'Inactive(anon): 0 kB' 'Active(file): 160660 kB' 'Inactive(file): 250392 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1708008 kB' 'Mapped: 52956 kB' 'AnonPages: 341780 kB' 'Shmem: 1296956 kB' 'KernelStack: 5464 kB' 'PageTables: 3940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68276 kB' 'Slab: 253012 kB' 'SReclaimable: 68276 kB' 'SUnreclaim: 184736 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.786 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.786 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # continue 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.787 01:39:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.787 01:39:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.787 01:39:18 -- setup/common.sh@33 -- # echo 0 00:03:29.787 01:39:18 -- setup/common.sh@33 -- # return 0 00:03:29.787 01:39:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.787 01:39:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.787 01:39:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.787 01:39:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.787 01:39:18 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:29.787 node0=512 expecting 512 00:03:29.787 01:39:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.787 01:39:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.787 01:39:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.787 01:39:18 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:29.787 node1=1024 expecting 1024 00:03:29.787 01:39:18 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:29.787 00:03:29.787 real 0m1.512s 00:03:29.787 user 0m0.607s 00:03:29.787 sys 0m0.867s 00:03:29.787 01:39:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.787 01:39:18 -- common/autotest_common.sh@10 -- # set +x 00:03:29.787 ************************************ 00:03:29.787 END TEST custom_alloc 00:03:29.787 ************************************ 00:03:29.787 01:39:18 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:29.787 01:39:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.787 01:39:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.787 01:39:18 -- common/autotest_common.sh@10 -- # set +x 00:03:29.787 ************************************ 00:03:29.787 START TEST no_shrink_alloc 00:03:29.787 ************************************ 00:03:29.787 01:39:18 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:29.787 01:39:18 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:29.787 01:39:18 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:29.787 01:39:18 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:29.787 01:39:18 -- setup/hugepages.sh@51 -- # shift 00:03:29.787 01:39:18 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:29.787 01:39:18 -- setup/hugepages.sh@52 -- # local node_ids 00:03:29.787 01:39:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:29.787 01:39:18 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:29.787 01:39:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:29.787 01:39:18 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:29.787 01:39:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:29.787 01:39:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:29.787 01:39:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:29.787 01:39:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:29.787 01:39:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:29.787 01:39:18 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:29.787 01:39:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:29.787 01:39:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:29.787 01:39:18 -- setup/hugepages.sh@73 -- # return 0 00:03:29.787 01:39:18 -- setup/hugepages.sh@198 -- # setup output 00:03:29.787 01:39:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.787 01:39:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:30.731 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.731 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:30.731 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.731 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.731 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.731 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.731 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.731 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.731 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.731 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.731 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.731 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.731 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.731 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.731 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.731 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.731 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.998 01:39:19 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:30.998 01:39:19 -- setup/hugepages.sh@89 -- # local node 00:03:30.998 01:39:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:30.998 01:39:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:30.998 01:39:19 -- setup/hugepages.sh@92 -- # local surp 00:03:30.998 01:39:19 -- setup/hugepages.sh@93 -- # local resv 00:03:30.998 01:39:19 -- setup/hugepages.sh@94 -- # local anon 00:03:30.998 01:39:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:30.998 01:39:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:30.998 01:39:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:30.998 01:39:19 -- setup/common.sh@18 -- # local node= 00:03:30.998 01:39:19 -- setup/common.sh@19 -- # local var val 00:03:30.998 01:39:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.998 01:39:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.998 01:39:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.998 01:39:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.998 01:39:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.998 01:39:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.998 01:39:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45321380 kB' 'MemAvailable: 49078392 kB' 'Buffers: 3740 kB' 'Cached: 10641604 kB' 'SwapCached: 0 kB' 'Active: 7338552 kB' 'Inactive: 3759348 kB' 'Active(anon): 6938284 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455460 kB' 'Mapped: 173504 kB' 'Shmem: 6485728 kB' 'KReclaimable: 181952 kB' 'Slab: 686864 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 504912 kB' 'KernelStack: 12784 kB' 'PageTables: 7512 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8014068 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.998 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.998 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # continue 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.999 01:39:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.999 01:39:19 -- setup/common.sh@33 -- # echo 0 00:03:30.999 01:39:19 -- setup/common.sh@33 -- # return 0 00:03:30.999 01:39:19 -- setup/hugepages.sh@97 -- # anon=0 00:03:30.999 01:39:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:30.999 01:39:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:30.999 01:39:19 -- setup/common.sh@18 -- # local node= 00:03:30.999 01:39:19 -- setup/common.sh@19 -- # local var val 00:03:30.999 01:39:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.999 01:39:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.999 01:39:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.999 01:39:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.999 01:39:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.999 01:39:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.999 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45331192 kB' 'MemAvailable: 49088204 kB' 'Buffers: 3740 kB' 'Cached: 10641604 kB' 'SwapCached: 0 kB' 'Active: 7338540 kB' 'Inactive: 3759348 kB' 'Active(anon): 6938272 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455448 kB' 'Mapped: 173504 kB' 'Shmem: 6485728 kB' 'KReclaimable: 181952 kB' 'Slab: 686836 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 504884 kB' 'KernelStack: 12768 kB' 'PageTables: 7448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8014080 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.000 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.000 01:39:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.001 01:39:19 -- setup/common.sh@33 -- # echo 0 00:03:31.001 01:39:19 -- setup/common.sh@33 -- # return 0 00:03:31.001 01:39:19 -- setup/hugepages.sh@99 -- # surp=0 00:03:31.001 01:39:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:31.001 01:39:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:31.001 01:39:19 -- setup/common.sh@18 -- # local node= 00:03:31.001 01:39:19 -- setup/common.sh@19 -- # local var val 00:03:31.001 01:39:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.001 01:39:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.001 01:39:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.001 01:39:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.001 01:39:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.001 01:39:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45330356 kB' 'MemAvailable: 49087368 kB' 'Buffers: 3740 kB' 'Cached: 10641620 kB' 'SwapCached: 0 kB' 'Active: 7338084 kB' 'Inactive: 3759348 kB' 'Active(anon): 6937816 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455336 kB' 'Mapped: 173456 kB' 'Shmem: 6485744 kB' 'KReclaimable: 181952 kB' 'Slab: 686880 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 504928 kB' 'KernelStack: 12832 kB' 'PageTables: 7572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8013892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.001 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.001 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.002 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.002 01:39:19 -- setup/common.sh@33 -- # echo 0 00:03:31.002 01:39:19 -- setup/common.sh@33 -- # return 0 00:03:31.002 01:39:19 -- setup/hugepages.sh@100 -- # resv=0 00:03:31.002 01:39:19 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:31.002 nr_hugepages=1024 00:03:31.002 01:39:19 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:31.002 resv_hugepages=0 00:03:31.002 01:39:19 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:31.002 surplus_hugepages=0 00:03:31.002 01:39:19 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:31.002 anon_hugepages=0 00:03:31.002 01:39:19 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.002 01:39:19 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:31.002 01:39:19 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:31.002 01:39:19 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:31.002 01:39:19 -- setup/common.sh@18 -- # local node= 00:03:31.002 01:39:19 -- setup/common.sh@19 -- # local var val 00:03:31.002 01:39:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.002 01:39:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.002 01:39:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.002 01:39:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.002 01:39:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.002 01:39:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.002 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45329676 kB' 'MemAvailable: 49086688 kB' 'Buffers: 3740 kB' 'Cached: 10641632 kB' 'SwapCached: 0 kB' 'Active: 7338024 kB' 'Inactive: 3759348 kB' 'Active(anon): 6937756 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455320 kB' 'Mapped: 173456 kB' 'Shmem: 6485756 kB' 'KReclaimable: 181952 kB' 'Slab: 686868 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 504916 kB' 'KernelStack: 12800 kB' 'PageTables: 7476 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8013744 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.003 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.003 01:39:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.004 01:39:19 -- setup/common.sh@33 -- # echo 1024 00:03:31.004 01:39:19 -- setup/common.sh@33 -- # return 0 00:03:31.004 01:39:19 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.004 01:39:19 -- setup/hugepages.sh@112 -- # get_nodes 00:03:31.004 01:39:19 -- setup/hugepages.sh@27 -- # local node 00:03:31.004 01:39:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.004 01:39:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:31.004 01:39:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.004 01:39:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:31.004 01:39:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:31.004 01:39:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:31.004 01:39:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.004 01:39:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.004 01:39:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:31.004 01:39:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.004 01:39:19 -- setup/common.sh@18 -- # local node=0 00:03:31.004 01:39:19 -- setup/common.sh@19 -- # local var val 00:03:31.004 01:39:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.004 01:39:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.004 01:39:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:31.004 01:39:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:31.004 01:39:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.004 01:39:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20359576 kB' 'MemUsed: 12466280 kB' 'SwapCached: 0 kB' 'Active: 5538596 kB' 'Inactive: 3508956 kB' 'Active(anon): 5298988 kB' 'Inactive(anon): 0 kB' 'Active(file): 239608 kB' 'Inactive(file): 3508956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8937368 kB' 'Mapped: 120508 kB' 'AnonPages: 113388 kB' 'Shmem: 5188804 kB' 'KernelStack: 7272 kB' 'PageTables: 3540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113676 kB' 'Slab: 433964 kB' 'SReclaimable: 113676 kB' 'SUnreclaim: 320288 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.004 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.004 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # continue 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.005 01:39:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.005 01:39:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.005 01:39:19 -- setup/common.sh@33 -- # echo 0 00:03:31.005 01:39:19 -- setup/common.sh@33 -- # return 0 00:03:31.005 01:39:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.005 01:39:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.005 01:39:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.005 01:39:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.005 01:39:19 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:31.005 node0=1024 expecting 1024 00:03:31.005 01:39:19 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:31.005 01:39:19 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:31.005 01:39:19 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:31.005 01:39:19 -- setup/hugepages.sh@202 -- # setup output 00:03:31.005 01:39:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:31.005 01:39:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:32.476 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.476 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:32.476 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.476 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.476 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.476 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.476 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.476 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.476 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.476 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.476 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.476 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.476 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.476 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.476 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.476 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.476 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.476 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:32.476 01:39:20 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:32.476 01:39:20 -- setup/hugepages.sh@89 -- # local node 00:03:32.476 01:39:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:32.476 01:39:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:32.476 01:39:20 -- setup/hugepages.sh@92 -- # local surp 00:03:32.476 01:39:20 -- setup/hugepages.sh@93 -- # local resv 00:03:32.476 01:39:20 -- setup/hugepages.sh@94 -- # local anon 00:03:32.476 01:39:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:32.476 01:39:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:32.476 01:39:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:32.476 01:39:20 -- setup/common.sh@18 -- # local node= 00:03:32.476 01:39:20 -- setup/common.sh@19 -- # local var val 00:03:32.476 01:39:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.476 01:39:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.476 01:39:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.476 01:39:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.476 01:39:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.476 01:39:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.476 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.476 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.476 01:39:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45327024 kB' 'MemAvailable: 49084036 kB' 'Buffers: 3740 kB' 'Cached: 10641684 kB' 'SwapCached: 0 kB' 'Active: 7339968 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939700 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457240 kB' 'Mapped: 173464 kB' 'Shmem: 6485808 kB' 'KReclaimable: 181952 kB' 'Slab: 687104 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505152 kB' 'KernelStack: 12816 kB' 'PageTables: 7552 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8014276 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:32.476 01:39:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.476 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.476 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.476 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.477 01:39:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.477 01:39:20 -- setup/common.sh@33 -- # echo 0 00:03:32.477 01:39:20 -- setup/common.sh@33 -- # return 0 00:03:32.477 01:39:20 -- setup/hugepages.sh@97 -- # anon=0 00:03:32.477 01:39:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:32.477 01:39:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.477 01:39:20 -- setup/common.sh@18 -- # local node= 00:03:32.477 01:39:20 -- setup/common.sh@19 -- # local var val 00:03:32.477 01:39:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.477 01:39:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.477 01:39:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.477 01:39:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.477 01:39:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.477 01:39:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.477 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45327360 kB' 'MemAvailable: 49084372 kB' 'Buffers: 3740 kB' 'Cached: 10641688 kB' 'SwapCached: 0 kB' 'Active: 7339652 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939384 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 456936 kB' 'Mapped: 173468 kB' 'Shmem: 6485812 kB' 'KReclaimable: 181952 kB' 'Slab: 687104 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505152 kB' 'KernelStack: 12784 kB' 'PageTables: 7448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8014288 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.478 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.478 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.479 01:39:20 -- setup/common.sh@33 -- # echo 0 00:03:32.479 01:39:20 -- setup/common.sh@33 -- # return 0 00:03:32.479 01:39:20 -- setup/hugepages.sh@99 -- # surp=0 00:03:32.479 01:39:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:32.479 01:39:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:32.479 01:39:20 -- setup/common.sh@18 -- # local node= 00:03:32.479 01:39:20 -- setup/common.sh@19 -- # local var val 00:03:32.479 01:39:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.479 01:39:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.479 01:39:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.479 01:39:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.479 01:39:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.479 01:39:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45335212 kB' 'MemAvailable: 49092224 kB' 'Buffers: 3740 kB' 'Cached: 10641700 kB' 'SwapCached: 0 kB' 'Active: 7339208 kB' 'Inactive: 3759348 kB' 'Active(anon): 6938940 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 456404 kB' 'Mapped: 173464 kB' 'Shmem: 6485824 kB' 'KReclaimable: 181952 kB' 'Slab: 687088 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505136 kB' 'KernelStack: 12800 kB' 'PageTables: 7460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8014304 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.479 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.479 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.480 01:39:20 -- setup/common.sh@33 -- # echo 0 00:03:32.480 01:39:20 -- setup/common.sh@33 -- # return 0 00:03:32.480 01:39:20 -- setup/hugepages.sh@100 -- # resv=0 00:03:32.480 01:39:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:32.480 nr_hugepages=1024 00:03:32.480 01:39:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:32.480 resv_hugepages=0 00:03:32.480 01:39:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:32.480 surplus_hugepages=0 00:03:32.480 01:39:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:32.480 anon_hugepages=0 00:03:32.480 01:39:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.480 01:39:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:32.480 01:39:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:32.480 01:39:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:32.480 01:39:20 -- setup/common.sh@18 -- # local node= 00:03:32.480 01:39:20 -- setup/common.sh@19 -- # local var val 00:03:32.480 01:39:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.480 01:39:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.480 01:39:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.480 01:39:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.480 01:39:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.480 01:39:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45336120 kB' 'MemAvailable: 49093132 kB' 'Buffers: 3740 kB' 'Cached: 10641712 kB' 'SwapCached: 0 kB' 'Active: 7339352 kB' 'Inactive: 3759348 kB' 'Active(anon): 6939084 kB' 'Inactive(anon): 0 kB' 'Active(file): 400268 kB' 'Inactive(file): 3759348 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 456544 kB' 'Mapped: 173464 kB' 'Shmem: 6485836 kB' 'KReclaimable: 181952 kB' 'Slab: 687152 kB' 'SReclaimable: 181952 kB' 'SUnreclaim: 505200 kB' 'KernelStack: 12816 kB' 'PageTables: 7544 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8014320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1820252 kB' 'DirectMap2M: 12779520 kB' 'DirectMap1G: 55574528 kB' 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.480 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.480 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.481 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.481 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.482 01:39:20 -- setup/common.sh@33 -- # echo 1024 00:03:32.482 01:39:20 -- setup/common.sh@33 -- # return 0 00:03:32.482 01:39:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.482 01:39:20 -- setup/hugepages.sh@112 -- # get_nodes 00:03:32.482 01:39:20 -- setup/hugepages.sh@27 -- # local node 00:03:32.482 01:39:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.482 01:39:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:32.482 01:39:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.482 01:39:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:32.482 01:39:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:32.482 01:39:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:32.482 01:39:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.482 01:39:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.482 01:39:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:32.482 01:39:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.482 01:39:20 -- setup/common.sh@18 -- # local node=0 00:03:32.482 01:39:20 -- setup/common.sh@19 -- # local var val 00:03:32.482 01:39:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.482 01:39:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.482 01:39:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:32.482 01:39:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:32.482 01:39:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.482 01:39:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20367668 kB' 'MemUsed: 12458188 kB' 'SwapCached: 0 kB' 'Active: 5538896 kB' 'Inactive: 3508956 kB' 'Active(anon): 5299288 kB' 'Inactive(anon): 0 kB' 'Active(file): 239608 kB' 'Inactive(file): 3508956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8937440 kB' 'Mapped: 120516 kB' 'AnonPages: 113604 kB' 'Shmem: 5188876 kB' 'KernelStack: 7320 kB' 'PageTables: 3556 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113676 kB' 'Slab: 434112 kB' 'SReclaimable: 113676 kB' 'SUnreclaim: 320436 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.482 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.482 01:39:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # continue 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.483 01:39:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.483 01:39:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.483 01:39:20 -- setup/common.sh@33 -- # echo 0 00:03:32.483 01:39:20 -- setup/common.sh@33 -- # return 0 00:03:32.483 01:39:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.483 01:39:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.483 01:39:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.483 01:39:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.483 01:39:20 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:32.483 node0=1024 expecting 1024 00:03:32.483 01:39:20 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:32.483 00:03:32.483 real 0m2.752s 00:03:32.483 user 0m1.115s 00:03:32.483 sys 0m1.561s 00:03:32.483 01:39:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.483 01:39:20 -- common/autotest_common.sh@10 -- # set +x 00:03:32.483 ************************************ 00:03:32.483 END TEST no_shrink_alloc 00:03:32.483 ************************************ 00:03:32.483 01:39:20 -- setup/hugepages.sh@217 -- # clear_hp 00:03:32.483 01:39:20 -- setup/hugepages.sh@37 -- # local node hp 00:03:32.483 01:39:20 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:32.483 01:39:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.483 01:39:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.483 01:39:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.483 01:39:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.483 01:39:20 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:32.483 01:39:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.483 01:39:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.483 01:39:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.483 01:39:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.483 01:39:20 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:32.483 01:39:20 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:32.483 00:03:32.483 real 0m11.399s 00:03:32.483 user 0m4.368s 00:03:32.483 sys 0m5.953s 00:03:32.483 01:39:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.483 01:39:20 -- common/autotest_common.sh@10 -- # set +x 00:03:32.483 ************************************ 00:03:32.483 END TEST hugepages 00:03:32.483 ************************************ 00:03:32.483 01:39:20 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:32.483 01:39:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.483 01:39:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.483 01:39:20 -- common/autotest_common.sh@10 -- # set +x 00:03:32.483 ************************************ 00:03:32.483 START TEST driver 00:03:32.483 ************************************ 00:03:32.483 01:39:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:32.483 * Looking for test storage... 00:03:32.742 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:32.742 01:39:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:32.742 01:39:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:32.742 01:39:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:32.742 01:39:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:32.742 01:39:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:32.742 01:39:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:32.742 01:39:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:32.742 01:39:21 -- scripts/common.sh@335 -- # IFS=.-: 00:03:32.742 01:39:21 -- scripts/common.sh@335 -- # read -ra ver1 00:03:32.742 01:39:21 -- scripts/common.sh@336 -- # IFS=.-: 00:03:32.742 01:39:21 -- scripts/common.sh@336 -- # read -ra ver2 00:03:32.742 01:39:21 -- scripts/common.sh@337 -- # local 'op=<' 00:03:32.742 01:39:21 -- scripts/common.sh@339 -- # ver1_l=2 00:03:32.742 01:39:21 -- scripts/common.sh@340 -- # ver2_l=1 00:03:32.742 01:39:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:32.742 01:39:21 -- scripts/common.sh@343 -- # case "$op" in 00:03:32.742 01:39:21 -- scripts/common.sh@344 -- # : 1 00:03:32.742 01:39:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:32.742 01:39:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:32.742 01:39:21 -- scripts/common.sh@364 -- # decimal 1 00:03:32.742 01:39:21 -- scripts/common.sh@352 -- # local d=1 00:03:32.742 01:39:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:32.742 01:39:21 -- scripts/common.sh@354 -- # echo 1 00:03:32.742 01:39:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:32.742 01:39:21 -- scripts/common.sh@365 -- # decimal 2 00:03:32.742 01:39:21 -- scripts/common.sh@352 -- # local d=2 00:03:32.742 01:39:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:32.742 01:39:21 -- scripts/common.sh@354 -- # echo 2 00:03:32.742 01:39:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:32.742 01:39:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:32.742 01:39:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:32.742 01:39:21 -- scripts/common.sh@367 -- # return 0 00:03:32.742 01:39:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:32.742 01:39:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:32.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.742 --rc genhtml_branch_coverage=1 00:03:32.742 --rc genhtml_function_coverage=1 00:03:32.742 --rc genhtml_legend=1 00:03:32.742 --rc geninfo_all_blocks=1 00:03:32.742 --rc geninfo_unexecuted_blocks=1 00:03:32.742 00:03:32.742 ' 00:03:32.742 01:39:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:32.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.742 --rc genhtml_branch_coverage=1 00:03:32.742 --rc genhtml_function_coverage=1 00:03:32.742 --rc genhtml_legend=1 00:03:32.742 --rc geninfo_all_blocks=1 00:03:32.742 --rc geninfo_unexecuted_blocks=1 00:03:32.742 00:03:32.742 ' 00:03:32.742 01:39:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:32.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.742 --rc genhtml_branch_coverage=1 00:03:32.742 --rc genhtml_function_coverage=1 00:03:32.742 --rc genhtml_legend=1 00:03:32.742 --rc geninfo_all_blocks=1 00:03:32.742 --rc geninfo_unexecuted_blocks=1 00:03:32.742 00:03:32.742 ' 00:03:32.742 01:39:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:32.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.742 --rc genhtml_branch_coverage=1 00:03:32.742 --rc genhtml_function_coverage=1 00:03:32.742 --rc genhtml_legend=1 00:03:32.742 --rc geninfo_all_blocks=1 00:03:32.742 --rc geninfo_unexecuted_blocks=1 00:03:32.742 00:03:32.742 ' 00:03:32.742 01:39:21 -- setup/driver.sh@68 -- # setup reset 00:03:32.742 01:39:21 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:32.742 01:39:21 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:35.276 01:39:23 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:35.276 01:39:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.276 01:39:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.276 01:39:23 -- common/autotest_common.sh@10 -- # set +x 00:03:35.276 ************************************ 00:03:35.276 START TEST guess_driver 00:03:35.276 ************************************ 00:03:35.276 01:39:23 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:35.276 01:39:23 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:35.276 01:39:23 -- setup/driver.sh@47 -- # local fail=0 00:03:35.276 01:39:23 -- setup/driver.sh@49 -- # pick_driver 00:03:35.276 01:39:23 -- setup/driver.sh@36 -- # vfio 00:03:35.276 01:39:23 -- setup/driver.sh@21 -- # local iommu_grups 00:03:35.276 01:39:23 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:35.276 01:39:23 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:35.276 01:39:23 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:35.276 01:39:23 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:35.276 01:39:23 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:35.276 01:39:23 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:35.276 01:39:23 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:35.276 01:39:23 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:35.276 01:39:23 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:35.276 01:39:23 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:35.276 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:35.276 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:35.276 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:35.276 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:35.276 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:35.276 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:35.276 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:35.276 01:39:23 -- setup/driver.sh@30 -- # return 0 00:03:35.276 01:39:23 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:35.276 01:39:23 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:35.276 01:39:23 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:35.276 01:39:23 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:35.276 Looking for driver=vfio-pci 00:03:35.276 01:39:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.276 01:39:23 -- setup/driver.sh@45 -- # setup output config 00:03:35.276 01:39:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.276 01:39:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:36.210 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.210 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.210 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.210 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.210 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.210 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.210 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.210 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.210 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.470 01:39:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.470 01:39:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.470 01:39:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.406 01:39:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.406 01:39:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.406 01:39:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.406 01:39:25 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:37.406 01:39:25 -- setup/driver.sh@65 -- # setup reset 00:03:37.406 01:39:25 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:37.406 01:39:25 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:39.937 00:03:39.937 real 0m4.730s 00:03:39.937 user 0m1.062s 00:03:39.937 sys 0m1.866s 00:03:39.937 01:39:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.937 01:39:28 -- common/autotest_common.sh@10 -- # set +x 00:03:39.937 ************************************ 00:03:39.937 END TEST guess_driver 00:03:39.937 ************************************ 00:03:39.937 00:03:39.937 real 0m7.388s 00:03:39.937 user 0m1.724s 00:03:39.937 sys 0m2.930s 00:03:39.937 01:39:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.937 01:39:28 -- common/autotest_common.sh@10 -- # set +x 00:03:39.937 ************************************ 00:03:39.937 END TEST driver 00:03:39.937 ************************************ 00:03:39.937 01:39:28 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:39.937 01:39:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.937 01:39:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.937 01:39:28 -- common/autotest_common.sh@10 -- # set +x 00:03:39.937 ************************************ 00:03:39.937 START TEST devices 00:03:39.937 ************************************ 00:03:39.937 01:39:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:39.937 * Looking for test storage... 00:03:39.937 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:39.937 01:39:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.937 01:39:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.937 01:39:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:40.195 01:39:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:40.195 01:39:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:40.195 01:39:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:40.195 01:39:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:40.195 01:39:28 -- scripts/common.sh@335 -- # IFS=.-: 00:03:40.195 01:39:28 -- scripts/common.sh@335 -- # read -ra ver1 00:03:40.195 01:39:28 -- scripts/common.sh@336 -- # IFS=.-: 00:03:40.195 01:39:28 -- scripts/common.sh@336 -- # read -ra ver2 00:03:40.195 01:39:28 -- scripts/common.sh@337 -- # local 'op=<' 00:03:40.195 01:39:28 -- scripts/common.sh@339 -- # ver1_l=2 00:03:40.195 01:39:28 -- scripts/common.sh@340 -- # ver2_l=1 00:03:40.195 01:39:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:40.195 01:39:28 -- scripts/common.sh@343 -- # case "$op" in 00:03:40.195 01:39:28 -- scripts/common.sh@344 -- # : 1 00:03:40.195 01:39:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:40.195 01:39:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:40.195 01:39:28 -- scripts/common.sh@364 -- # decimal 1 00:03:40.195 01:39:28 -- scripts/common.sh@352 -- # local d=1 00:03:40.195 01:39:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:40.195 01:39:28 -- scripts/common.sh@354 -- # echo 1 00:03:40.195 01:39:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:40.195 01:39:28 -- scripts/common.sh@365 -- # decimal 2 00:03:40.195 01:39:28 -- scripts/common.sh@352 -- # local d=2 00:03:40.195 01:39:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:40.195 01:39:28 -- scripts/common.sh@354 -- # echo 2 00:03:40.195 01:39:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:40.195 01:39:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:40.195 01:39:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:40.195 01:39:28 -- scripts/common.sh@367 -- # return 0 00:03:40.195 01:39:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:40.195 01:39:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:40.195 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.195 --rc genhtml_branch_coverage=1 00:03:40.195 --rc genhtml_function_coverage=1 00:03:40.195 --rc genhtml_legend=1 00:03:40.195 --rc geninfo_all_blocks=1 00:03:40.195 --rc geninfo_unexecuted_blocks=1 00:03:40.195 00:03:40.195 ' 00:03:40.195 01:39:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:40.195 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.195 --rc genhtml_branch_coverage=1 00:03:40.195 --rc genhtml_function_coverage=1 00:03:40.195 --rc genhtml_legend=1 00:03:40.195 --rc geninfo_all_blocks=1 00:03:40.195 --rc geninfo_unexecuted_blocks=1 00:03:40.195 00:03:40.195 ' 00:03:40.195 01:39:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:40.195 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.195 --rc genhtml_branch_coverage=1 00:03:40.195 --rc genhtml_function_coverage=1 00:03:40.195 --rc genhtml_legend=1 00:03:40.195 --rc geninfo_all_blocks=1 00:03:40.195 --rc geninfo_unexecuted_blocks=1 00:03:40.195 00:03:40.195 ' 00:03:40.195 01:39:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:40.195 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.195 --rc genhtml_branch_coverage=1 00:03:40.195 --rc genhtml_function_coverage=1 00:03:40.195 --rc genhtml_legend=1 00:03:40.195 --rc geninfo_all_blocks=1 00:03:40.195 --rc geninfo_unexecuted_blocks=1 00:03:40.195 00:03:40.195 ' 00:03:40.195 01:39:28 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:40.195 01:39:28 -- setup/devices.sh@192 -- # setup reset 00:03:40.195 01:39:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:40.195 01:39:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:41.571 01:39:30 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:41.571 01:39:30 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:41.571 01:39:30 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:41.571 01:39:30 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:41.571 01:39:30 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:41.571 01:39:30 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:41.571 01:39:30 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:41.571 01:39:30 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:41.571 01:39:30 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:41.571 01:39:30 -- setup/devices.sh@196 -- # blocks=() 00:03:41.571 01:39:30 -- setup/devices.sh@196 -- # declare -a blocks 00:03:41.571 01:39:30 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:41.571 01:39:30 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:41.571 01:39:30 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:41.571 01:39:30 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:41.571 01:39:30 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:41.571 01:39:30 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:41.571 01:39:30 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:41.571 01:39:30 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:41.571 01:39:30 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:41.571 01:39:30 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:41.571 01:39:30 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:41.571 No valid GPT data, bailing 00:03:41.571 01:39:30 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:41.571 01:39:30 -- scripts/common.sh@393 -- # pt= 00:03:41.571 01:39:30 -- scripts/common.sh@394 -- # return 1 00:03:41.571 01:39:30 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:41.571 01:39:30 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:41.571 01:39:30 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:41.571 01:39:30 -- setup/common.sh@80 -- # echo 1000204886016 00:03:41.571 01:39:30 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:41.571 01:39:30 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:41.571 01:39:30 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:41.571 01:39:30 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:41.571 01:39:30 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:41.571 01:39:30 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:41.571 01:39:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.571 01:39:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.571 01:39:30 -- common/autotest_common.sh@10 -- # set +x 00:03:41.571 ************************************ 00:03:41.571 START TEST nvme_mount 00:03:41.571 ************************************ 00:03:41.571 01:39:30 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:41.571 01:39:30 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:41.571 01:39:30 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:41.571 01:39:30 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.571 01:39:30 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:41.571 01:39:30 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:41.571 01:39:30 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:41.571 01:39:30 -- setup/common.sh@40 -- # local part_no=1 00:03:41.571 01:39:30 -- setup/common.sh@41 -- # local size=1073741824 00:03:41.571 01:39:30 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:41.571 01:39:30 -- setup/common.sh@44 -- # parts=() 00:03:41.571 01:39:30 -- setup/common.sh@44 -- # local parts 00:03:41.571 01:39:30 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:41.571 01:39:30 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:41.571 01:39:30 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:41.571 01:39:30 -- setup/common.sh@46 -- # (( part++ )) 00:03:41.571 01:39:30 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:41.571 01:39:30 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:41.571 01:39:30 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:41.571 01:39:30 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:42.945 Creating new GPT entries in memory. 00:03:42.945 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:42.945 other utilities. 00:03:42.945 01:39:31 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:42.945 01:39:31 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:42.945 01:39:31 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:42.945 01:39:31 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:42.945 01:39:31 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:43.880 Creating new GPT entries in memory. 00:03:43.880 The operation has completed successfully. 00:03:43.880 01:39:32 -- setup/common.sh@57 -- # (( part++ )) 00:03:43.880 01:39:32 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:43.880 01:39:32 -- setup/common.sh@62 -- # wait 3308809 00:03:43.880 01:39:32 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.880 01:39:32 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:43.880 01:39:32 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.880 01:39:32 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:43.880 01:39:32 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:43.880 01:39:32 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.880 01:39:32 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:43.880 01:39:32 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:43.880 01:39:32 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:43.880 01:39:32 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.880 01:39:32 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:43.880 01:39:32 -- setup/devices.sh@53 -- # local found=0 00:03:43.880 01:39:32 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:43.880 01:39:32 -- setup/devices.sh@56 -- # : 00:03:43.880 01:39:32 -- setup/devices.sh@59 -- # local pci status 00:03:43.880 01:39:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.880 01:39:32 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:43.880 01:39:32 -- setup/devices.sh@47 -- # setup output config 00:03:43.880 01:39:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:43.880 01:39:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:44.815 01:39:33 -- setup/devices.sh@63 -- # found=1 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.815 01:39:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.815 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.074 01:39:33 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:45.074 01:39:33 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:45.074 01:39:33 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.074 01:39:33 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:45.074 01:39:33 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:45.074 01:39:33 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:45.074 01:39:33 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.074 01:39:33 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.074 01:39:33 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:45.074 01:39:33 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:45.074 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:45.074 01:39:33 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:45.074 01:39:33 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:45.333 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:45.333 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:45.333 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:45.333 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:45.333 01:39:33 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:45.333 01:39:33 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:45.333 01:39:33 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.333 01:39:33 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:45.333 01:39:33 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:45.333 01:39:33 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.333 01:39:33 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:45.333 01:39:33 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:45.333 01:39:33 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:45.333 01:39:33 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.333 01:39:33 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:45.333 01:39:33 -- setup/devices.sh@53 -- # local found=0 00:03:45.333 01:39:33 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:45.333 01:39:33 -- setup/devices.sh@56 -- # : 00:03:45.333 01:39:33 -- setup/devices.sh@59 -- # local pci status 00:03:45.333 01:39:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.333 01:39:33 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:45.333 01:39:33 -- setup/devices.sh@47 -- # setup output config 00:03:45.333 01:39:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:45.333 01:39:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:46.709 01:39:34 -- setup/devices.sh@63 -- # found=1 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.709 01:39:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:35 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.709 01:39:35 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:46.709 01:39:35 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.709 01:39:35 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:46.709 01:39:35 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.709 01:39:35 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.709 01:39:35 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:46.709 01:39:35 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:46.709 01:39:35 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:46.709 01:39:35 -- setup/devices.sh@50 -- # local mount_point= 00:03:46.709 01:39:35 -- setup/devices.sh@51 -- # local test_file= 00:03:46.709 01:39:35 -- setup/devices.sh@53 -- # local found=0 00:03:46.709 01:39:35 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:46.709 01:39:35 -- setup/devices.sh@59 -- # local pci status 00:03:46.709 01:39:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.709 01:39:35 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:46.709 01:39:35 -- setup/devices.sh@47 -- # setup output config 00:03:46.709 01:39:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:46.709 01:39:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:48.084 01:39:36 -- setup/devices.sh@63 -- # found=1 00:03:48.084 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.084 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.084 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.084 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.084 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.084 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.084 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.085 01:39:36 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:48.085 01:39:36 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:48.085 01:39:36 -- setup/devices.sh@68 -- # return 0 00:03:48.085 01:39:36 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:48.085 01:39:36 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.085 01:39:36 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:48.085 01:39:36 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:48.085 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:48.085 00:03:48.085 real 0m6.376s 00:03:48.085 user 0m1.474s 00:03:48.085 sys 0m2.473s 00:03:48.085 01:39:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:48.085 01:39:36 -- common/autotest_common.sh@10 -- # set +x 00:03:48.085 ************************************ 00:03:48.085 END TEST nvme_mount 00:03:48.085 ************************************ 00:03:48.085 01:39:36 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:48.085 01:39:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:48.085 01:39:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:48.085 01:39:36 -- common/autotest_common.sh@10 -- # set +x 00:03:48.085 ************************************ 00:03:48.085 START TEST dm_mount 00:03:48.085 ************************************ 00:03:48.085 01:39:36 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:48.085 01:39:36 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:48.085 01:39:36 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:48.085 01:39:36 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:48.085 01:39:36 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:48.085 01:39:36 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:48.085 01:39:36 -- setup/common.sh@40 -- # local part_no=2 00:03:48.085 01:39:36 -- setup/common.sh@41 -- # local size=1073741824 00:03:48.085 01:39:36 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:48.085 01:39:36 -- setup/common.sh@44 -- # parts=() 00:03:48.085 01:39:36 -- setup/common.sh@44 -- # local parts 00:03:48.085 01:39:36 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:48.085 01:39:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:48.085 01:39:36 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:48.085 01:39:36 -- setup/common.sh@46 -- # (( part++ )) 00:03:48.085 01:39:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:48.085 01:39:36 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:48.085 01:39:36 -- setup/common.sh@46 -- # (( part++ )) 00:03:48.085 01:39:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:48.085 01:39:36 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:48.085 01:39:36 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:48.085 01:39:36 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:49.020 Creating new GPT entries in memory. 00:03:49.020 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:49.020 other utilities. 00:03:49.020 01:39:37 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:49.020 01:39:37 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:49.020 01:39:37 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:49.020 01:39:37 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:49.020 01:39:37 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:50.395 Creating new GPT entries in memory. 00:03:50.395 The operation has completed successfully. 00:03:50.396 01:39:38 -- setup/common.sh@57 -- # (( part++ )) 00:03:50.396 01:39:38 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:50.396 01:39:38 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:50.396 01:39:38 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:50.396 01:39:38 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:51.330 The operation has completed successfully. 00:03:51.330 01:39:39 -- setup/common.sh@57 -- # (( part++ )) 00:03:51.330 01:39:39 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:51.330 01:39:39 -- setup/common.sh@62 -- # wait 3311273 00:03:51.330 01:39:39 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:51.330 01:39:39 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.330 01:39:39 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:51.330 01:39:39 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:51.330 01:39:39 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:51.330 01:39:39 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:51.330 01:39:39 -- setup/devices.sh@161 -- # break 00:03:51.330 01:39:39 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:51.330 01:39:39 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:51.330 01:39:39 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:51.330 01:39:39 -- setup/devices.sh@166 -- # dm=dm-0 00:03:51.330 01:39:39 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:51.330 01:39:39 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:51.330 01:39:39 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.330 01:39:39 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:51.330 01:39:39 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.330 01:39:39 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:51.330 01:39:39 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:51.330 01:39:39 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.330 01:39:39 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:51.330 01:39:39 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:51.330 01:39:39 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:51.330 01:39:39 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.330 01:39:39 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:51.330 01:39:39 -- setup/devices.sh@53 -- # local found=0 00:03:51.330 01:39:39 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:51.330 01:39:39 -- setup/devices.sh@56 -- # : 00:03:51.330 01:39:39 -- setup/devices.sh@59 -- # local pci status 00:03:51.330 01:39:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.330 01:39:39 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:51.330 01:39:39 -- setup/devices.sh@47 -- # setup output config 00:03:51.330 01:39:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:51.330 01:39:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:52.266 01:39:40 -- setup/devices.sh@63 -- # found=1 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.266 01:39:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.266 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.525 01:39:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:52.525 01:39:40 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:52.525 01:39:40 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.525 01:39:40 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:52.525 01:39:40 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:52.525 01:39:40 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.525 01:39:40 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:52.525 01:39:40 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:52.525 01:39:40 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:52.525 01:39:40 -- setup/devices.sh@50 -- # local mount_point= 00:03:52.525 01:39:40 -- setup/devices.sh@51 -- # local test_file= 00:03:52.525 01:39:40 -- setup/devices.sh@53 -- # local found=0 00:03:52.525 01:39:40 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:52.525 01:39:40 -- setup/devices.sh@59 -- # local pci status 00:03:52.525 01:39:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.525 01:39:40 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:52.525 01:39:40 -- setup/devices.sh@47 -- # setup output config 00:03:52.525 01:39:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:52.525 01:39:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:53.458 01:39:41 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.458 01:39:41 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:53.458 01:39:41 -- setup/devices.sh@63 -- # found=1 00:03:53.458 01:39:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.458 01:39:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.458 01:39:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.458 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.458 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.716 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.716 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.716 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.717 01:39:42 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:53.717 01:39:42 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:53.717 01:39:42 -- setup/devices.sh@68 -- # return 0 00:03:53.717 01:39:42 -- setup/devices.sh@187 -- # cleanup_dm 00:03:53.717 01:39:42 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:53.717 01:39:42 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:53.717 01:39:42 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:53.717 01:39:42 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:53.717 01:39:42 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:53.976 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:53.976 01:39:42 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:53.976 01:39:42 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:53.976 00:03:53.976 real 0m5.780s 00:03:53.976 user 0m1.037s 00:03:53.976 sys 0m1.599s 00:03:53.976 01:39:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:53.976 01:39:42 -- common/autotest_common.sh@10 -- # set +x 00:03:53.976 ************************************ 00:03:53.976 END TEST dm_mount 00:03:53.976 ************************************ 00:03:53.976 01:39:42 -- setup/devices.sh@1 -- # cleanup 00:03:53.976 01:39:42 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:53.976 01:39:42 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:53.976 01:39:42 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:53.976 01:39:42 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:53.976 01:39:42 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:53.976 01:39:42 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:54.234 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:54.234 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:54.234 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:54.234 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:54.234 01:39:42 -- setup/devices.sh@12 -- # cleanup_dm 00:03:54.234 01:39:42 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.234 01:39:42 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:54.234 01:39:42 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:54.234 01:39:42 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:54.234 01:39:42 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:54.234 01:39:42 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:54.234 00:03:54.234 real 0m14.192s 00:03:54.234 user 0m3.259s 00:03:54.234 sys 0m5.135s 00:03:54.234 01:39:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:54.234 01:39:42 -- common/autotest_common.sh@10 -- # set +x 00:03:54.234 ************************************ 00:03:54.234 END TEST devices 00:03:54.234 ************************************ 00:03:54.234 00:03:54.234 real 0m43.620s 00:03:54.234 user 0m12.698s 00:03:54.234 sys 0m19.409s 00:03:54.234 01:39:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:54.234 01:39:42 -- common/autotest_common.sh@10 -- # set +x 00:03:54.234 ************************************ 00:03:54.234 END TEST setup.sh 00:03:54.234 ************************************ 00:03:54.234 01:39:42 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:55.169 Hugepages 00:03:55.169 node hugesize free / total 00:03:55.169 node0 1048576kB 0 / 0 00:03:55.169 node0 2048kB 2048 / 2048 00:03:55.169 node1 1048576kB 0 / 0 00:03:55.169 node1 2048kB 0 / 0 00:03:55.169 00:03:55.169 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:55.169 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:55.169 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:55.169 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:55.169 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:55.169 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:55.169 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:55.169 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:55.169 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:55.169 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:55.169 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:55.169 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:55.169 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:55.427 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:55.427 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:55.427 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:55.427 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:55.427 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:55.427 01:39:43 -- spdk/autotest.sh@128 -- # uname -s 00:03:55.427 01:39:43 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:55.427 01:39:43 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:55.427 01:39:43 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:56.802 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:56.802 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:56.802 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:56.802 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:56.802 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:56.802 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:56.802 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:56.802 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:56.802 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:57.738 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:57.738 01:39:46 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:58.672 01:39:47 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:58.672 01:39:47 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:58.672 01:39:47 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:58.672 01:39:47 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:58.672 01:39:47 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:58.672 01:39:47 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:58.672 01:39:47 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:58.672 01:39:47 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:58.672 01:39:47 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:58.672 01:39:47 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:58.672 01:39:47 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:58.672 01:39:47 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:00.046 Waiting for block devices as requested 00:04:00.046 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:00.046 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:00.305 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:00.306 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:00.306 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:00.563 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:00.564 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:00.564 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:00.564 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:00.564 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:00.824 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:00.824 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:00.824 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:01.084 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:01.084 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:01.084 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:01.084 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:01.343 01:39:49 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:01.343 01:39:49 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:01.343 01:39:49 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:01.343 01:39:49 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:01.343 01:39:49 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:01.343 01:39:49 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:01.343 01:39:49 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:01.343 01:39:49 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:01.343 01:39:49 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:01.343 01:39:49 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:01.343 01:39:49 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:01.343 01:39:49 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:01.343 01:39:49 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:01.343 01:39:49 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:01.343 01:39:49 -- common/autotest_common.sh@1552 -- # continue 00:04:01.343 01:39:49 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:01.343 01:39:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:01.343 01:39:49 -- common/autotest_common.sh@10 -- # set +x 00:04:01.343 01:39:49 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:01.343 01:39:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:01.343 01:39:49 -- common/autotest_common.sh@10 -- # set +x 00:04:01.343 01:39:49 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:02.718 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:02.718 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:02.718 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:02.718 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:02.718 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:02.718 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:02.718 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:02.718 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:02.718 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:02.718 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:02.718 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:02.718 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:02.718 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:02.719 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:02.719 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:02.719 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:03.654 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:03.654 01:39:52 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:03.654 01:39:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:03.654 01:39:52 -- common/autotest_common.sh@10 -- # set +x 00:04:03.654 01:39:52 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:03.654 01:39:52 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:03.654 01:39:52 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:03.654 01:39:52 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:03.654 01:39:52 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:03.654 01:39:52 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:03.654 01:39:52 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:03.654 01:39:52 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:03.654 01:39:52 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:03.654 01:39:52 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:03.654 01:39:52 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:03.912 01:39:52 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:03.912 01:39:52 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:03.912 01:39:52 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:03.912 01:39:52 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:03.912 01:39:52 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:03.912 01:39:52 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:03.912 01:39:52 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:03.912 01:39:52 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:03.913 01:39:52 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:03.913 01:39:52 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3316702 00:04:03.913 01:39:52 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:03.913 01:39:52 -- common/autotest_common.sh@1593 -- # waitforlisten 3316702 00:04:03.913 01:39:52 -- common/autotest_common.sh@829 -- # '[' -z 3316702 ']' 00:04:03.913 01:39:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:03.913 01:39:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:03.913 01:39:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:03.913 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:03.913 01:39:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:03.913 01:39:52 -- common/autotest_common.sh@10 -- # set +x 00:04:03.913 [2024-11-19 01:39:52.298966] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:03.913 [2024-11-19 01:39:52.299063] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3316702 ] 00:04:03.913 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.913 [2024-11-19 01:39:52.362179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:04.171 [2024-11-19 01:39:52.472103] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:04.171 [2024-11-19 01:39:52.472258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:04.737 01:39:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:04.737 01:39:53 -- common/autotest_common.sh@862 -- # return 0 00:04:04.737 01:39:53 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:04.737 01:39:53 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:04.737 01:39:53 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:08.022 nvme0n1 00:04:08.022 01:39:56 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:08.287 [2024-11-19 01:39:56.608911] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:08.287 [2024-11-19 01:39:56.608978] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:08.287 request: 00:04:08.287 { 00:04:08.287 "nvme_ctrlr_name": "nvme0", 00:04:08.287 "password": "test", 00:04:08.287 "method": "bdev_nvme_opal_revert", 00:04:08.287 "req_id": 1 00:04:08.287 } 00:04:08.287 Got JSON-RPC error response 00:04:08.287 response: 00:04:08.287 { 00:04:08.287 "code": -32603, 00:04:08.287 "message": "Internal error" 00:04:08.287 } 00:04:08.287 01:39:56 -- common/autotest_common.sh@1599 -- # true 00:04:08.287 01:39:56 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:08.287 01:39:56 -- common/autotest_common.sh@1603 -- # killprocess 3316702 00:04:08.287 01:39:56 -- common/autotest_common.sh@936 -- # '[' -z 3316702 ']' 00:04:08.287 01:39:56 -- common/autotest_common.sh@940 -- # kill -0 3316702 00:04:08.287 01:39:56 -- common/autotest_common.sh@941 -- # uname 00:04:08.287 01:39:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:08.287 01:39:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3316702 00:04:08.287 01:39:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:08.287 01:39:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:08.287 01:39:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3316702' 00:04:08.287 killing process with pid 3316702 00:04:08.287 01:39:56 -- common/autotest_common.sh@955 -- # kill 3316702 00:04:08.287 01:39:56 -- common/autotest_common.sh@960 -- # wait 3316702 00:04:10.255 01:39:58 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:10.255 01:39:58 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:10.255 01:39:58 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:10.255 01:39:58 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:10.255 01:39:58 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:10.255 01:39:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:10.255 01:39:58 -- common/autotest_common.sh@10 -- # set +x 00:04:10.255 01:39:58 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:10.255 01:39:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.255 01:39:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.255 01:39:58 -- common/autotest_common.sh@10 -- # set +x 00:04:10.255 ************************************ 00:04:10.255 START TEST env 00:04:10.255 ************************************ 00:04:10.255 01:39:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:10.255 * Looking for test storage... 00:04:10.255 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:10.255 01:39:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:10.255 01:39:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:10.255 01:39:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:10.255 01:39:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:10.255 01:39:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:10.255 01:39:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:10.255 01:39:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:10.255 01:39:58 -- scripts/common.sh@335 -- # IFS=.-: 00:04:10.255 01:39:58 -- scripts/common.sh@335 -- # read -ra ver1 00:04:10.255 01:39:58 -- scripts/common.sh@336 -- # IFS=.-: 00:04:10.255 01:39:58 -- scripts/common.sh@336 -- # read -ra ver2 00:04:10.255 01:39:58 -- scripts/common.sh@337 -- # local 'op=<' 00:04:10.255 01:39:58 -- scripts/common.sh@339 -- # ver1_l=2 00:04:10.255 01:39:58 -- scripts/common.sh@340 -- # ver2_l=1 00:04:10.255 01:39:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:10.255 01:39:58 -- scripts/common.sh@343 -- # case "$op" in 00:04:10.255 01:39:58 -- scripts/common.sh@344 -- # : 1 00:04:10.255 01:39:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:10.255 01:39:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:10.255 01:39:58 -- scripts/common.sh@364 -- # decimal 1 00:04:10.255 01:39:58 -- scripts/common.sh@352 -- # local d=1 00:04:10.255 01:39:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:10.255 01:39:58 -- scripts/common.sh@354 -- # echo 1 00:04:10.255 01:39:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:10.255 01:39:58 -- scripts/common.sh@365 -- # decimal 2 00:04:10.255 01:39:58 -- scripts/common.sh@352 -- # local d=2 00:04:10.255 01:39:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:10.255 01:39:58 -- scripts/common.sh@354 -- # echo 2 00:04:10.255 01:39:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:10.255 01:39:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:10.255 01:39:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:10.255 01:39:58 -- scripts/common.sh@367 -- # return 0 00:04:10.255 01:39:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:10.255 01:39:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:10.255 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.255 --rc genhtml_branch_coverage=1 00:04:10.255 --rc genhtml_function_coverage=1 00:04:10.255 --rc genhtml_legend=1 00:04:10.255 --rc geninfo_all_blocks=1 00:04:10.256 --rc geninfo_unexecuted_blocks=1 00:04:10.256 00:04:10.256 ' 00:04:10.256 01:39:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:10.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.256 --rc genhtml_branch_coverage=1 00:04:10.256 --rc genhtml_function_coverage=1 00:04:10.256 --rc genhtml_legend=1 00:04:10.256 --rc geninfo_all_blocks=1 00:04:10.256 --rc geninfo_unexecuted_blocks=1 00:04:10.256 00:04:10.256 ' 00:04:10.256 01:39:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:10.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.256 --rc genhtml_branch_coverage=1 00:04:10.256 --rc genhtml_function_coverage=1 00:04:10.256 --rc genhtml_legend=1 00:04:10.256 --rc geninfo_all_blocks=1 00:04:10.256 --rc geninfo_unexecuted_blocks=1 00:04:10.256 00:04:10.256 ' 00:04:10.256 01:39:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:10.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.256 --rc genhtml_branch_coverage=1 00:04:10.256 --rc genhtml_function_coverage=1 00:04:10.256 --rc genhtml_legend=1 00:04:10.256 --rc geninfo_all_blocks=1 00:04:10.256 --rc geninfo_unexecuted_blocks=1 00:04:10.256 00:04:10.256 ' 00:04:10.256 01:39:58 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:10.256 01:39:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.256 01:39:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.256 01:39:58 -- common/autotest_common.sh@10 -- # set +x 00:04:10.256 ************************************ 00:04:10.256 START TEST env_memory 00:04:10.256 ************************************ 00:04:10.256 01:39:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:10.256 00:04:10.256 00:04:10.256 CUnit - A unit testing framework for C - Version 2.1-3 00:04:10.256 http://cunit.sourceforge.net/ 00:04:10.256 00:04:10.256 00:04:10.256 Suite: memory 00:04:10.256 Test: alloc and free memory map ...[2024-11-19 01:39:58.652300] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:10.256 passed 00:04:10.256 Test: mem map translation ...[2024-11-19 01:39:58.672574] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:10.256 [2024-11-19 01:39:58.672596] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:10.256 [2024-11-19 01:39:58.672659] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:10.256 [2024-11-19 01:39:58.672674] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:10.256 passed 00:04:10.256 Test: mem map registration ...[2024-11-19 01:39:58.713598] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:10.256 [2024-11-19 01:39:58.713617] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:10.256 passed 00:04:10.256 Test: mem map adjacent registrations ...passed 00:04:10.256 00:04:10.256 Run Summary: Type Total Ran Passed Failed Inactive 00:04:10.256 suites 1 1 n/a 0 0 00:04:10.256 tests 4 4 4 0 0 00:04:10.256 asserts 152 152 152 0 n/a 00:04:10.256 00:04:10.256 Elapsed time = 0.145 seconds 00:04:10.256 00:04:10.256 real 0m0.152s 00:04:10.256 user 0m0.144s 00:04:10.256 sys 0m0.008s 00:04:10.256 01:39:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.256 01:39:58 -- common/autotest_common.sh@10 -- # set +x 00:04:10.256 ************************************ 00:04:10.256 END TEST env_memory 00:04:10.256 ************************************ 00:04:10.256 01:39:58 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:10.256 01:39:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.256 01:39:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.256 01:39:58 -- common/autotest_common.sh@10 -- # set +x 00:04:10.256 ************************************ 00:04:10.256 START TEST env_vtophys 00:04:10.256 ************************************ 00:04:10.256 01:39:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:10.514 EAL: lib.eal log level changed from notice to debug 00:04:10.514 EAL: Detected lcore 0 as core 0 on socket 0 00:04:10.514 EAL: Detected lcore 1 as core 1 on socket 0 00:04:10.514 EAL: Detected lcore 2 as core 2 on socket 0 00:04:10.514 EAL: Detected lcore 3 as core 3 on socket 0 00:04:10.514 EAL: Detected lcore 4 as core 4 on socket 0 00:04:10.514 EAL: Detected lcore 5 as core 5 on socket 0 00:04:10.514 EAL: Detected lcore 6 as core 8 on socket 0 00:04:10.514 EAL: Detected lcore 7 as core 9 on socket 0 00:04:10.514 EAL: Detected lcore 8 as core 10 on socket 0 00:04:10.514 EAL: Detected lcore 9 as core 11 on socket 0 00:04:10.514 EAL: Detected lcore 10 as core 12 on socket 0 00:04:10.514 EAL: Detected lcore 11 as core 13 on socket 0 00:04:10.514 EAL: Detected lcore 12 as core 0 on socket 1 00:04:10.514 EAL: Detected lcore 13 as core 1 on socket 1 00:04:10.514 EAL: Detected lcore 14 as core 2 on socket 1 00:04:10.514 EAL: Detected lcore 15 as core 3 on socket 1 00:04:10.514 EAL: Detected lcore 16 as core 4 on socket 1 00:04:10.514 EAL: Detected lcore 17 as core 5 on socket 1 00:04:10.514 EAL: Detected lcore 18 as core 8 on socket 1 00:04:10.514 EAL: Detected lcore 19 as core 9 on socket 1 00:04:10.514 EAL: Detected lcore 20 as core 10 on socket 1 00:04:10.514 EAL: Detected lcore 21 as core 11 on socket 1 00:04:10.514 EAL: Detected lcore 22 as core 12 on socket 1 00:04:10.514 EAL: Detected lcore 23 as core 13 on socket 1 00:04:10.514 EAL: Detected lcore 24 as core 0 on socket 0 00:04:10.514 EAL: Detected lcore 25 as core 1 on socket 0 00:04:10.514 EAL: Detected lcore 26 as core 2 on socket 0 00:04:10.514 EAL: Detected lcore 27 as core 3 on socket 0 00:04:10.514 EAL: Detected lcore 28 as core 4 on socket 0 00:04:10.514 EAL: Detected lcore 29 as core 5 on socket 0 00:04:10.514 EAL: Detected lcore 30 as core 8 on socket 0 00:04:10.514 EAL: Detected lcore 31 as core 9 on socket 0 00:04:10.514 EAL: Detected lcore 32 as core 10 on socket 0 00:04:10.514 EAL: Detected lcore 33 as core 11 on socket 0 00:04:10.514 EAL: Detected lcore 34 as core 12 on socket 0 00:04:10.514 EAL: Detected lcore 35 as core 13 on socket 0 00:04:10.514 EAL: Detected lcore 36 as core 0 on socket 1 00:04:10.514 EAL: Detected lcore 37 as core 1 on socket 1 00:04:10.514 EAL: Detected lcore 38 as core 2 on socket 1 00:04:10.514 EAL: Detected lcore 39 as core 3 on socket 1 00:04:10.514 EAL: Detected lcore 40 as core 4 on socket 1 00:04:10.514 EAL: Detected lcore 41 as core 5 on socket 1 00:04:10.514 EAL: Detected lcore 42 as core 8 on socket 1 00:04:10.514 EAL: Detected lcore 43 as core 9 on socket 1 00:04:10.514 EAL: Detected lcore 44 as core 10 on socket 1 00:04:10.514 EAL: Detected lcore 45 as core 11 on socket 1 00:04:10.514 EAL: Detected lcore 46 as core 12 on socket 1 00:04:10.514 EAL: Detected lcore 47 as core 13 on socket 1 00:04:10.514 EAL: Maximum logical cores by configuration: 128 00:04:10.514 EAL: Detected CPU lcores: 48 00:04:10.514 EAL: Detected NUMA nodes: 2 00:04:10.514 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:10.514 EAL: Detected shared linkage of DPDK 00:04:10.514 EAL: No shared files mode enabled, IPC will be disabled 00:04:10.514 EAL: Bus pci wants IOVA as 'DC' 00:04:10.514 EAL: Buses did not request a specific IOVA mode. 00:04:10.514 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:10.514 EAL: Selected IOVA mode 'VA' 00:04:10.514 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.514 EAL: Probing VFIO support... 00:04:10.514 EAL: IOMMU type 1 (Type 1) is supported 00:04:10.514 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:10.514 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:10.514 EAL: VFIO support initialized 00:04:10.514 EAL: Ask a virtual area of 0x2e000 bytes 00:04:10.514 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:10.514 EAL: Setting up physically contiguous memory... 00:04:10.514 EAL: Setting maximum number of open files to 524288 00:04:10.514 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:10.514 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:10.514 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:10.514 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:10.514 EAL: Ask a virtual area of 0x61000 bytes 00:04:10.514 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:10.514 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:10.514 EAL: Ask a virtual area of 0x400000000 bytes 00:04:10.514 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:10.514 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:10.514 EAL: Hugepages will be freed exactly as allocated. 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: TSC frequency is ~2700000 KHz 00:04:10.514 EAL: Main lcore 0 is ready (tid=7fcc16190a00;cpuset=[0]) 00:04:10.514 EAL: Trying to obtain current memory policy. 00:04:10.514 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.514 EAL: Restoring previous memory policy: 0 00:04:10.514 EAL: request: mp_malloc_sync 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: Heap on socket 0 was expanded by 2MB 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:10.514 EAL: Mem event callback 'spdk:(nil)' registered 00:04:10.514 00:04:10.514 00:04:10.514 CUnit - A unit testing framework for C - Version 2.1-3 00:04:10.514 http://cunit.sourceforge.net/ 00:04:10.514 00:04:10.514 00:04:10.514 Suite: components_suite 00:04:10.514 Test: vtophys_malloc_test ...passed 00:04:10.514 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:10.514 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.514 EAL: Restoring previous memory policy: 4 00:04:10.514 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.514 EAL: request: mp_malloc_sync 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: Heap on socket 0 was expanded by 4MB 00:04:10.514 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.514 EAL: request: mp_malloc_sync 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: Heap on socket 0 was shrunk by 4MB 00:04:10.514 EAL: Trying to obtain current memory policy. 00:04:10.514 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.514 EAL: Restoring previous memory policy: 4 00:04:10.514 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.514 EAL: request: mp_malloc_sync 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: Heap on socket 0 was expanded by 6MB 00:04:10.514 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.514 EAL: request: mp_malloc_sync 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: Heap on socket 0 was shrunk by 6MB 00:04:10.514 EAL: Trying to obtain current memory policy. 00:04:10.514 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.514 EAL: Restoring previous memory policy: 4 00:04:10.514 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.514 EAL: request: mp_malloc_sync 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: Heap on socket 0 was expanded by 10MB 00:04:10.514 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.514 EAL: request: mp_malloc_sync 00:04:10.514 EAL: No shared files mode enabled, IPC is disabled 00:04:10.514 EAL: Heap on socket 0 was shrunk by 10MB 00:04:10.514 EAL: Trying to obtain current memory policy. 00:04:10.514 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.514 EAL: Restoring previous memory policy: 4 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was expanded by 18MB 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was shrunk by 18MB 00:04:10.515 EAL: Trying to obtain current memory policy. 00:04:10.515 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.515 EAL: Restoring previous memory policy: 4 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was expanded by 34MB 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was shrunk by 34MB 00:04:10.515 EAL: Trying to obtain current memory policy. 00:04:10.515 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.515 EAL: Restoring previous memory policy: 4 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was expanded by 66MB 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was shrunk by 66MB 00:04:10.515 EAL: Trying to obtain current memory policy. 00:04:10.515 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.515 EAL: Restoring previous memory policy: 4 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was expanded by 130MB 00:04:10.515 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.515 EAL: request: mp_malloc_sync 00:04:10.515 EAL: No shared files mode enabled, IPC is disabled 00:04:10.515 EAL: Heap on socket 0 was shrunk by 130MB 00:04:10.515 EAL: Trying to obtain current memory policy. 00:04:10.515 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.774 EAL: Restoring previous memory policy: 4 00:04:10.775 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.775 EAL: request: mp_malloc_sync 00:04:10.775 EAL: No shared files mode enabled, IPC is disabled 00:04:10.775 EAL: Heap on socket 0 was expanded by 258MB 00:04:10.775 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.775 EAL: request: mp_malloc_sync 00:04:10.775 EAL: No shared files mode enabled, IPC is disabled 00:04:10.775 EAL: Heap on socket 0 was shrunk by 258MB 00:04:10.775 EAL: Trying to obtain current memory policy. 00:04:10.775 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:11.034 EAL: Restoring previous memory policy: 4 00:04:11.034 EAL: Calling mem event callback 'spdk:(nil)' 00:04:11.034 EAL: request: mp_malloc_sync 00:04:11.034 EAL: No shared files mode enabled, IPC is disabled 00:04:11.034 EAL: Heap on socket 0 was expanded by 514MB 00:04:11.034 EAL: Calling mem event callback 'spdk:(nil)' 00:04:11.292 EAL: request: mp_malloc_sync 00:04:11.292 EAL: No shared files mode enabled, IPC is disabled 00:04:11.292 EAL: Heap on socket 0 was shrunk by 514MB 00:04:11.292 EAL: Trying to obtain current memory policy. 00:04:11.292 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:11.550 EAL: Restoring previous memory policy: 4 00:04:11.550 EAL: Calling mem event callback 'spdk:(nil)' 00:04:11.550 EAL: request: mp_malloc_sync 00:04:11.550 EAL: No shared files mode enabled, IPC is disabled 00:04:11.550 EAL: Heap on socket 0 was expanded by 1026MB 00:04:11.550 EAL: Calling mem event callback 'spdk:(nil)' 00:04:11.808 EAL: request: mp_malloc_sync 00:04:11.808 EAL: No shared files mode enabled, IPC is disabled 00:04:11.808 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:11.808 passed 00:04:11.808 00:04:11.808 Run Summary: Type Total Ran Passed Failed Inactive 00:04:11.808 suites 1 1 n/a 0 0 00:04:11.808 tests 2 2 2 0 0 00:04:11.808 asserts 497 497 497 0 n/a 00:04:11.808 00:04:11.808 Elapsed time = 1.391 seconds 00:04:11.808 EAL: Calling mem event callback 'spdk:(nil)' 00:04:11.808 EAL: request: mp_malloc_sync 00:04:11.808 EAL: No shared files mode enabled, IPC is disabled 00:04:11.808 EAL: Heap on socket 0 was shrunk by 2MB 00:04:11.808 EAL: No shared files mode enabled, IPC is disabled 00:04:11.808 EAL: No shared files mode enabled, IPC is disabled 00:04:11.808 EAL: No shared files mode enabled, IPC is disabled 00:04:11.808 00:04:11.808 real 0m1.509s 00:04:11.808 user 0m0.866s 00:04:11.808 sys 0m0.612s 00:04:11.808 01:40:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.808 01:40:00 -- common/autotest_common.sh@10 -- # set +x 00:04:11.808 ************************************ 00:04:11.808 END TEST env_vtophys 00:04:11.808 ************************************ 00:04:11.808 01:40:00 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:11.808 01:40:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.808 01:40:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.808 01:40:00 -- common/autotest_common.sh@10 -- # set +x 00:04:11.808 ************************************ 00:04:11.808 START TEST env_pci 00:04:11.808 ************************************ 00:04:11.808 01:40:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:11.808 00:04:11.808 00:04:11.808 CUnit - A unit testing framework for C - Version 2.1-3 00:04:11.808 http://cunit.sourceforge.net/ 00:04:11.808 00:04:11.808 00:04:11.808 Suite: pci 00:04:11.808 Test: pci_hook ...[2024-11-19 01:40:00.351197] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3317754 has claimed it 00:04:12.067 EAL: Cannot find device (10000:00:01.0) 00:04:12.067 EAL: Failed to attach device on primary process 00:04:12.067 passed 00:04:12.067 00:04:12.067 Run Summary: Type Total Ran Passed Failed Inactive 00:04:12.067 suites 1 1 n/a 0 0 00:04:12.067 tests 1 1 1 0 0 00:04:12.067 asserts 25 25 25 0 n/a 00:04:12.067 00:04:12.067 Elapsed time = 0.021 seconds 00:04:12.067 00:04:12.067 real 0m0.035s 00:04:12.067 user 0m0.013s 00:04:12.067 sys 0m0.022s 00:04:12.067 01:40:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.067 01:40:00 -- common/autotest_common.sh@10 -- # set +x 00:04:12.067 ************************************ 00:04:12.067 END TEST env_pci 00:04:12.067 ************************************ 00:04:12.067 01:40:00 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:12.067 01:40:00 -- env/env.sh@15 -- # uname 00:04:12.067 01:40:00 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:12.067 01:40:00 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:12.067 01:40:00 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:12.067 01:40:00 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:12.067 01:40:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.067 01:40:00 -- common/autotest_common.sh@10 -- # set +x 00:04:12.067 ************************************ 00:04:12.067 START TEST env_dpdk_post_init 00:04:12.067 ************************************ 00:04:12.067 01:40:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:12.067 EAL: Detected CPU lcores: 48 00:04:12.067 EAL: Detected NUMA nodes: 2 00:04:12.067 EAL: Detected shared linkage of DPDK 00:04:12.067 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:12.067 EAL: Selected IOVA mode 'VA' 00:04:12.067 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.067 EAL: VFIO support initialized 00:04:12.067 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:12.067 EAL: Using IOMMU type 1 (Type 1) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:12.067 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:12.326 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:13.261 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:16.541 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:16.541 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:16.541 Starting DPDK initialization... 00:04:16.541 Starting SPDK post initialization... 00:04:16.541 SPDK NVMe probe 00:04:16.541 Attaching to 0000:88:00.0 00:04:16.541 Attached to 0000:88:00.0 00:04:16.541 Cleaning up... 00:04:16.541 00:04:16.541 real 0m4.382s 00:04:16.541 user 0m3.267s 00:04:16.541 sys 0m0.167s 00:04:16.541 01:40:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.541 01:40:04 -- common/autotest_common.sh@10 -- # set +x 00:04:16.541 ************************************ 00:04:16.541 END TEST env_dpdk_post_init 00:04:16.541 ************************************ 00:04:16.541 01:40:04 -- env/env.sh@26 -- # uname 00:04:16.541 01:40:04 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:16.541 01:40:04 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:16.541 01:40:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.541 01:40:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.541 01:40:04 -- common/autotest_common.sh@10 -- # set +x 00:04:16.541 ************************************ 00:04:16.541 START TEST env_mem_callbacks 00:04:16.541 ************************************ 00:04:16.541 01:40:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:16.541 EAL: Detected CPU lcores: 48 00:04:16.541 EAL: Detected NUMA nodes: 2 00:04:16.541 EAL: Detected shared linkage of DPDK 00:04:16.541 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:16.541 EAL: Selected IOVA mode 'VA' 00:04:16.541 EAL: No free 2048 kB hugepages reported on node 1 00:04:16.541 EAL: VFIO support initialized 00:04:16.541 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:16.541 00:04:16.541 00:04:16.541 CUnit - A unit testing framework for C - Version 2.1-3 00:04:16.541 http://cunit.sourceforge.net/ 00:04:16.541 00:04:16.541 00:04:16.541 Suite: memory 00:04:16.541 Test: test ... 00:04:16.541 register 0x200000200000 2097152 00:04:16.541 malloc 3145728 00:04:16.541 register 0x200000400000 4194304 00:04:16.541 buf 0x200000500000 len 3145728 PASSED 00:04:16.541 malloc 64 00:04:16.541 buf 0x2000004fff40 len 64 PASSED 00:04:16.541 malloc 4194304 00:04:16.541 register 0x200000800000 6291456 00:04:16.541 buf 0x200000a00000 len 4194304 PASSED 00:04:16.541 free 0x200000500000 3145728 00:04:16.541 free 0x2000004fff40 64 00:04:16.541 unregister 0x200000400000 4194304 PASSED 00:04:16.541 free 0x200000a00000 4194304 00:04:16.541 unregister 0x200000800000 6291456 PASSED 00:04:16.541 malloc 8388608 00:04:16.541 register 0x200000400000 10485760 00:04:16.541 buf 0x200000600000 len 8388608 PASSED 00:04:16.541 free 0x200000600000 8388608 00:04:16.541 unregister 0x200000400000 10485760 PASSED 00:04:16.541 passed 00:04:16.541 00:04:16.541 Run Summary: Type Total Ran Passed Failed Inactive 00:04:16.541 suites 1 1 n/a 0 0 00:04:16.541 tests 1 1 1 0 0 00:04:16.541 asserts 15 15 15 0 n/a 00:04:16.541 00:04:16.541 Elapsed time = 0.005 seconds 00:04:16.541 00:04:16.541 real 0m0.049s 00:04:16.541 user 0m0.014s 00:04:16.541 sys 0m0.034s 00:04:16.541 01:40:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.541 01:40:04 -- common/autotest_common.sh@10 -- # set +x 00:04:16.541 ************************************ 00:04:16.541 END TEST env_mem_callbacks 00:04:16.541 ************************************ 00:04:16.541 00:04:16.541 real 0m6.415s 00:04:16.541 user 0m4.447s 00:04:16.541 sys 0m1.019s 00:04:16.541 01:40:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.541 01:40:04 -- common/autotest_common.sh@10 -- # set +x 00:04:16.541 ************************************ 00:04:16.541 END TEST env 00:04:16.541 ************************************ 00:04:16.541 01:40:04 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:16.541 01:40:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.541 01:40:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.541 01:40:04 -- common/autotest_common.sh@10 -- # set +x 00:04:16.541 ************************************ 00:04:16.541 START TEST rpc 00:04:16.541 ************************************ 00:04:16.541 01:40:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:16.541 * Looking for test storage... 00:04:16.541 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:16.541 01:40:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:16.541 01:40:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:16.541 01:40:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:16.541 01:40:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:16.541 01:40:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:16.541 01:40:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:16.541 01:40:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:16.541 01:40:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:16.541 01:40:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:16.541 01:40:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:16.541 01:40:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:16.541 01:40:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:16.541 01:40:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:16.541 01:40:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:16.541 01:40:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:16.541 01:40:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:16.541 01:40:05 -- scripts/common.sh@344 -- # : 1 00:04:16.541 01:40:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:16.541 01:40:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:16.541 01:40:05 -- scripts/common.sh@364 -- # decimal 1 00:04:16.541 01:40:05 -- scripts/common.sh@352 -- # local d=1 00:04:16.541 01:40:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:16.541 01:40:05 -- scripts/common.sh@354 -- # echo 1 00:04:16.541 01:40:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:16.541 01:40:05 -- scripts/common.sh@365 -- # decimal 2 00:04:16.541 01:40:05 -- scripts/common.sh@352 -- # local d=2 00:04:16.541 01:40:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:16.541 01:40:05 -- scripts/common.sh@354 -- # echo 2 00:04:16.541 01:40:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:16.541 01:40:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:16.541 01:40:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:16.541 01:40:05 -- scripts/common.sh@367 -- # return 0 00:04:16.541 01:40:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:16.541 01:40:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:16.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.541 --rc genhtml_branch_coverage=1 00:04:16.541 --rc genhtml_function_coverage=1 00:04:16.541 --rc genhtml_legend=1 00:04:16.541 --rc geninfo_all_blocks=1 00:04:16.541 --rc geninfo_unexecuted_blocks=1 00:04:16.541 00:04:16.541 ' 00:04:16.541 01:40:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:16.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.541 --rc genhtml_branch_coverage=1 00:04:16.541 --rc genhtml_function_coverage=1 00:04:16.541 --rc genhtml_legend=1 00:04:16.541 --rc geninfo_all_blocks=1 00:04:16.541 --rc geninfo_unexecuted_blocks=1 00:04:16.541 00:04:16.541 ' 00:04:16.541 01:40:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:16.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.541 --rc genhtml_branch_coverage=1 00:04:16.541 --rc genhtml_function_coverage=1 00:04:16.541 --rc genhtml_legend=1 00:04:16.541 --rc geninfo_all_blocks=1 00:04:16.541 --rc geninfo_unexecuted_blocks=1 00:04:16.541 00:04:16.541 ' 00:04:16.541 01:40:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:16.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.541 --rc genhtml_branch_coverage=1 00:04:16.541 --rc genhtml_function_coverage=1 00:04:16.541 --rc genhtml_legend=1 00:04:16.541 --rc geninfo_all_blocks=1 00:04:16.541 --rc geninfo_unexecuted_blocks=1 00:04:16.541 00:04:16.541 ' 00:04:16.541 01:40:05 -- rpc/rpc.sh@65 -- # spdk_pid=3318440 00:04:16.541 01:40:05 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:16.541 01:40:05 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:16.541 01:40:05 -- rpc/rpc.sh@67 -- # waitforlisten 3318440 00:04:16.541 01:40:05 -- common/autotest_common.sh@829 -- # '[' -z 3318440 ']' 00:04:16.541 01:40:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:16.541 01:40:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:16.542 01:40:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:16.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:16.542 01:40:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:16.542 01:40:05 -- common/autotest_common.sh@10 -- # set +x 00:04:16.800 [2024-11-19 01:40:05.090247] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:16.800 [2024-11-19 01:40:05.090334] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3318440 ] 00:04:16.800 EAL: No free 2048 kB hugepages reported on node 1 00:04:16.800 [2024-11-19 01:40:05.146112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:16.800 [2024-11-19 01:40:05.257603] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:16.800 [2024-11-19 01:40:05.257783] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:16.800 [2024-11-19 01:40:05.257804] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3318440' to capture a snapshot of events at runtime. 00:04:16.800 [2024-11-19 01:40:05.257816] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3318440 for offline analysis/debug. 00:04:16.800 [2024-11-19 01:40:05.257851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:17.735 01:40:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:17.735 01:40:06 -- common/autotest_common.sh@862 -- # return 0 00:04:17.735 01:40:06 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:17.735 01:40:06 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:17.735 01:40:06 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:17.735 01:40:06 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:17.735 01:40:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.735 01:40:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.735 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.735 ************************************ 00:04:17.735 START TEST rpc_integrity 00:04:17.735 ************************************ 00:04:17.735 01:40:06 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:17.735 01:40:06 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:17.735 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.735 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.735 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.735 01:40:06 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:17.735 01:40:06 -- rpc/rpc.sh@13 -- # jq length 00:04:17.735 01:40:06 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:17.735 01:40:06 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:17.735 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.735 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.735 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.735 01:40:06 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:17.735 01:40:06 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:17.735 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.735 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.735 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.735 01:40:06 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:17.735 { 00:04:17.735 "name": "Malloc0", 00:04:17.735 "aliases": [ 00:04:17.735 "a6fd28bd-e017-46d3-8801-900537681b3b" 00:04:17.735 ], 00:04:17.735 "product_name": "Malloc disk", 00:04:17.735 "block_size": 512, 00:04:17.735 "num_blocks": 16384, 00:04:17.735 "uuid": "a6fd28bd-e017-46d3-8801-900537681b3b", 00:04:17.735 "assigned_rate_limits": { 00:04:17.735 "rw_ios_per_sec": 0, 00:04:17.735 "rw_mbytes_per_sec": 0, 00:04:17.735 "r_mbytes_per_sec": 0, 00:04:17.735 "w_mbytes_per_sec": 0 00:04:17.735 }, 00:04:17.735 "claimed": false, 00:04:17.735 "zoned": false, 00:04:17.735 "supported_io_types": { 00:04:17.735 "read": true, 00:04:17.735 "write": true, 00:04:17.735 "unmap": true, 00:04:17.735 "write_zeroes": true, 00:04:17.735 "flush": true, 00:04:17.735 "reset": true, 00:04:17.735 "compare": false, 00:04:17.735 "compare_and_write": false, 00:04:17.735 "abort": true, 00:04:17.735 "nvme_admin": false, 00:04:17.735 "nvme_io": false 00:04:17.735 }, 00:04:17.735 "memory_domains": [ 00:04:17.735 { 00:04:17.735 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.735 "dma_device_type": 2 00:04:17.735 } 00:04:17.735 ], 00:04:17.735 "driver_specific": {} 00:04:17.735 } 00:04:17.735 ]' 00:04:17.735 01:40:06 -- rpc/rpc.sh@17 -- # jq length 00:04:17.735 01:40:06 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:17.735 01:40:06 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:17.735 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.735 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.735 [2024-11-19 01:40:06.155122] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:17.735 [2024-11-19 01:40:06.155176] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:17.735 [2024-11-19 01:40:06.155203] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x5bccb0 00:04:17.735 [2024-11-19 01:40:06.155232] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:17.735 [2024-11-19 01:40:06.156550] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:17.735 [2024-11-19 01:40:06.156578] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:17.735 Passthru0 00:04:17.735 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.735 01:40:06 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:17.735 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.735 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.735 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.735 01:40:06 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:17.735 { 00:04:17.735 "name": "Malloc0", 00:04:17.735 "aliases": [ 00:04:17.736 "a6fd28bd-e017-46d3-8801-900537681b3b" 00:04:17.736 ], 00:04:17.736 "product_name": "Malloc disk", 00:04:17.736 "block_size": 512, 00:04:17.736 "num_blocks": 16384, 00:04:17.736 "uuid": "a6fd28bd-e017-46d3-8801-900537681b3b", 00:04:17.736 "assigned_rate_limits": { 00:04:17.736 "rw_ios_per_sec": 0, 00:04:17.736 "rw_mbytes_per_sec": 0, 00:04:17.736 "r_mbytes_per_sec": 0, 00:04:17.736 "w_mbytes_per_sec": 0 00:04:17.736 }, 00:04:17.736 "claimed": true, 00:04:17.736 "claim_type": "exclusive_write", 00:04:17.736 "zoned": false, 00:04:17.736 "supported_io_types": { 00:04:17.736 "read": true, 00:04:17.736 "write": true, 00:04:17.736 "unmap": true, 00:04:17.736 "write_zeroes": true, 00:04:17.736 "flush": true, 00:04:17.736 "reset": true, 00:04:17.736 "compare": false, 00:04:17.736 "compare_and_write": false, 00:04:17.736 "abort": true, 00:04:17.736 "nvme_admin": false, 00:04:17.736 "nvme_io": false 00:04:17.736 }, 00:04:17.736 "memory_domains": [ 00:04:17.736 { 00:04:17.736 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.736 "dma_device_type": 2 00:04:17.736 } 00:04:17.736 ], 00:04:17.736 "driver_specific": {} 00:04:17.736 }, 00:04:17.736 { 00:04:17.736 "name": "Passthru0", 00:04:17.736 "aliases": [ 00:04:17.736 "27accdcf-c0a0-59b7-82e4-0c6fa18dc8a2" 00:04:17.736 ], 00:04:17.736 "product_name": "passthru", 00:04:17.736 "block_size": 512, 00:04:17.736 "num_blocks": 16384, 00:04:17.736 "uuid": "27accdcf-c0a0-59b7-82e4-0c6fa18dc8a2", 00:04:17.736 "assigned_rate_limits": { 00:04:17.736 "rw_ios_per_sec": 0, 00:04:17.736 "rw_mbytes_per_sec": 0, 00:04:17.736 "r_mbytes_per_sec": 0, 00:04:17.736 "w_mbytes_per_sec": 0 00:04:17.736 }, 00:04:17.736 "claimed": false, 00:04:17.736 "zoned": false, 00:04:17.736 "supported_io_types": { 00:04:17.736 "read": true, 00:04:17.736 "write": true, 00:04:17.736 "unmap": true, 00:04:17.736 "write_zeroes": true, 00:04:17.736 "flush": true, 00:04:17.736 "reset": true, 00:04:17.736 "compare": false, 00:04:17.736 "compare_and_write": false, 00:04:17.736 "abort": true, 00:04:17.736 "nvme_admin": false, 00:04:17.736 "nvme_io": false 00:04:17.736 }, 00:04:17.736 "memory_domains": [ 00:04:17.736 { 00:04:17.736 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.736 "dma_device_type": 2 00:04:17.736 } 00:04:17.736 ], 00:04:17.736 "driver_specific": { 00:04:17.736 "passthru": { 00:04:17.736 "name": "Passthru0", 00:04:17.736 "base_bdev_name": "Malloc0" 00:04:17.736 } 00:04:17.736 } 00:04:17.736 } 00:04:17.736 ]' 00:04:17.736 01:40:06 -- rpc/rpc.sh@21 -- # jq length 00:04:17.736 01:40:06 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:17.736 01:40:06 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:17.736 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.736 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.736 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.736 01:40:06 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:17.736 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.736 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.736 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.736 01:40:06 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:17.736 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.736 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.736 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.736 01:40:06 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:17.736 01:40:06 -- rpc/rpc.sh@26 -- # jq length 00:04:17.736 01:40:06 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:17.736 00:04:17.736 real 0m0.232s 00:04:17.736 user 0m0.154s 00:04:17.736 sys 0m0.023s 00:04:17.736 01:40:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.736 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.736 ************************************ 00:04:17.736 END TEST rpc_integrity 00:04:17.736 ************************************ 00:04:17.994 01:40:06 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:17.994 01:40:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.994 01:40:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.994 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.994 ************************************ 00:04:17.994 START TEST rpc_plugins 00:04:17.994 ************************************ 00:04:17.994 01:40:06 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:17.994 01:40:06 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:17.994 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.994 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.994 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.994 01:40:06 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:17.994 01:40:06 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:17.994 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.994 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.994 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.994 01:40:06 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:17.994 { 00:04:17.994 "name": "Malloc1", 00:04:17.994 "aliases": [ 00:04:17.994 "a591f5b6-2dcd-421c-a47c-e8ae65b11d81" 00:04:17.994 ], 00:04:17.994 "product_name": "Malloc disk", 00:04:17.994 "block_size": 4096, 00:04:17.994 "num_blocks": 256, 00:04:17.994 "uuid": "a591f5b6-2dcd-421c-a47c-e8ae65b11d81", 00:04:17.994 "assigned_rate_limits": { 00:04:17.994 "rw_ios_per_sec": 0, 00:04:17.994 "rw_mbytes_per_sec": 0, 00:04:17.994 "r_mbytes_per_sec": 0, 00:04:17.994 "w_mbytes_per_sec": 0 00:04:17.994 }, 00:04:17.994 "claimed": false, 00:04:17.994 "zoned": false, 00:04:17.994 "supported_io_types": { 00:04:17.994 "read": true, 00:04:17.994 "write": true, 00:04:17.994 "unmap": true, 00:04:17.994 "write_zeroes": true, 00:04:17.994 "flush": true, 00:04:17.994 "reset": true, 00:04:17.994 "compare": false, 00:04:17.994 "compare_and_write": false, 00:04:17.994 "abort": true, 00:04:17.994 "nvme_admin": false, 00:04:17.995 "nvme_io": false 00:04:17.995 }, 00:04:17.995 "memory_domains": [ 00:04:17.995 { 00:04:17.995 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.995 "dma_device_type": 2 00:04:17.995 } 00:04:17.995 ], 00:04:17.995 "driver_specific": {} 00:04:17.995 } 00:04:17.995 ]' 00:04:17.995 01:40:06 -- rpc/rpc.sh@32 -- # jq length 00:04:17.995 01:40:06 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:17.995 01:40:06 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:17.995 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.995 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.995 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.995 01:40:06 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:17.995 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.995 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.995 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.995 01:40:06 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:17.995 01:40:06 -- rpc/rpc.sh@36 -- # jq length 00:04:17.995 01:40:06 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:17.995 00:04:17.995 real 0m0.115s 00:04:17.995 user 0m0.080s 00:04:17.995 sys 0m0.006s 00:04:17.995 01:40:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.995 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.995 ************************************ 00:04:17.995 END TEST rpc_plugins 00:04:17.995 ************************************ 00:04:17.995 01:40:06 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:17.995 01:40:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.995 01:40:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.995 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.995 ************************************ 00:04:17.995 START TEST rpc_trace_cmd_test 00:04:17.995 ************************************ 00:04:17.995 01:40:06 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:17.995 01:40:06 -- rpc/rpc.sh@40 -- # local info 00:04:17.995 01:40:06 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:17.995 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.995 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:17.995 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.995 01:40:06 -- rpc/rpc.sh@42 -- # info='{ 00:04:17.995 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3318440", 00:04:17.995 "tpoint_group_mask": "0x8", 00:04:17.995 "iscsi_conn": { 00:04:17.995 "mask": "0x2", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "scsi": { 00:04:17.995 "mask": "0x4", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "bdev": { 00:04:17.995 "mask": "0x8", 00:04:17.995 "tpoint_mask": "0xffffffffffffffff" 00:04:17.995 }, 00:04:17.995 "nvmf_rdma": { 00:04:17.995 "mask": "0x10", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "nvmf_tcp": { 00:04:17.995 "mask": "0x20", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "ftl": { 00:04:17.995 "mask": "0x40", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "blobfs": { 00:04:17.995 "mask": "0x80", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "dsa": { 00:04:17.995 "mask": "0x200", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "thread": { 00:04:17.995 "mask": "0x400", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "nvme_pcie": { 00:04:17.995 "mask": "0x800", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "iaa": { 00:04:17.995 "mask": "0x1000", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "nvme_tcp": { 00:04:17.995 "mask": "0x2000", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 }, 00:04:17.995 "bdev_nvme": { 00:04:17.995 "mask": "0x4000", 00:04:17.995 "tpoint_mask": "0x0" 00:04:17.995 } 00:04:17.995 }' 00:04:17.995 01:40:06 -- rpc/rpc.sh@43 -- # jq length 00:04:17.995 01:40:06 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:17.995 01:40:06 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:17.995 01:40:06 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:17.995 01:40:06 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:18.254 01:40:06 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:18.254 01:40:06 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:18.254 01:40:06 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:18.254 01:40:06 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:18.254 01:40:06 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:18.254 00:04:18.254 real 0m0.195s 00:04:18.254 user 0m0.174s 00:04:18.254 sys 0m0.015s 00:04:18.254 01:40:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:18.254 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.254 ************************************ 00:04:18.254 END TEST rpc_trace_cmd_test 00:04:18.254 ************************************ 00:04:18.254 01:40:06 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:18.254 01:40:06 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:18.254 01:40:06 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:18.254 01:40:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:18.254 01:40:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:18.254 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.254 ************************************ 00:04:18.254 START TEST rpc_daemon_integrity 00:04:18.254 ************************************ 00:04:18.254 01:40:06 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:18.254 01:40:06 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:18.254 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.254 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.254 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.254 01:40:06 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:18.254 01:40:06 -- rpc/rpc.sh@13 -- # jq length 00:04:18.254 01:40:06 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:18.254 01:40:06 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:18.254 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.254 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.254 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.254 01:40:06 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:18.254 01:40:06 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:18.254 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.254 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.254 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.254 01:40:06 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:18.254 { 00:04:18.254 "name": "Malloc2", 00:04:18.254 "aliases": [ 00:04:18.254 "8f548a3a-539a-4de1-97a7-810c8a15b107" 00:04:18.254 ], 00:04:18.254 "product_name": "Malloc disk", 00:04:18.254 "block_size": 512, 00:04:18.254 "num_blocks": 16384, 00:04:18.254 "uuid": "8f548a3a-539a-4de1-97a7-810c8a15b107", 00:04:18.254 "assigned_rate_limits": { 00:04:18.254 "rw_ios_per_sec": 0, 00:04:18.254 "rw_mbytes_per_sec": 0, 00:04:18.254 "r_mbytes_per_sec": 0, 00:04:18.254 "w_mbytes_per_sec": 0 00:04:18.254 }, 00:04:18.254 "claimed": false, 00:04:18.254 "zoned": false, 00:04:18.254 "supported_io_types": { 00:04:18.254 "read": true, 00:04:18.254 "write": true, 00:04:18.254 "unmap": true, 00:04:18.254 "write_zeroes": true, 00:04:18.254 "flush": true, 00:04:18.254 "reset": true, 00:04:18.254 "compare": false, 00:04:18.254 "compare_and_write": false, 00:04:18.254 "abort": true, 00:04:18.254 "nvme_admin": false, 00:04:18.254 "nvme_io": false 00:04:18.254 }, 00:04:18.254 "memory_domains": [ 00:04:18.254 { 00:04:18.254 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:18.254 "dma_device_type": 2 00:04:18.254 } 00:04:18.254 ], 00:04:18.254 "driver_specific": {} 00:04:18.254 } 00:04:18.254 ]' 00:04:18.254 01:40:06 -- rpc/rpc.sh@17 -- # jq length 00:04:18.254 01:40:06 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:18.254 01:40:06 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:18.254 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.254 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.254 [2024-11-19 01:40:06.764952] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:18.254 [2024-11-19 01:40:06.765002] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:18.254 [2024-11-19 01:40:06.765029] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x5be590 00:04:18.254 [2024-11-19 01:40:06.765044] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:18.254 [2024-11-19 01:40:06.766333] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:18.254 [2024-11-19 01:40:06.766361] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:18.254 Passthru0 00:04:18.254 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.254 01:40:06 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:18.254 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.254 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.254 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.254 01:40:06 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:18.254 { 00:04:18.254 "name": "Malloc2", 00:04:18.254 "aliases": [ 00:04:18.254 "8f548a3a-539a-4de1-97a7-810c8a15b107" 00:04:18.254 ], 00:04:18.254 "product_name": "Malloc disk", 00:04:18.254 "block_size": 512, 00:04:18.254 "num_blocks": 16384, 00:04:18.254 "uuid": "8f548a3a-539a-4de1-97a7-810c8a15b107", 00:04:18.254 "assigned_rate_limits": { 00:04:18.254 "rw_ios_per_sec": 0, 00:04:18.254 "rw_mbytes_per_sec": 0, 00:04:18.254 "r_mbytes_per_sec": 0, 00:04:18.254 "w_mbytes_per_sec": 0 00:04:18.254 }, 00:04:18.254 "claimed": true, 00:04:18.254 "claim_type": "exclusive_write", 00:04:18.254 "zoned": false, 00:04:18.254 "supported_io_types": { 00:04:18.254 "read": true, 00:04:18.254 "write": true, 00:04:18.254 "unmap": true, 00:04:18.254 "write_zeroes": true, 00:04:18.254 "flush": true, 00:04:18.254 "reset": true, 00:04:18.254 "compare": false, 00:04:18.254 "compare_and_write": false, 00:04:18.254 "abort": true, 00:04:18.254 "nvme_admin": false, 00:04:18.254 "nvme_io": false 00:04:18.254 }, 00:04:18.254 "memory_domains": [ 00:04:18.254 { 00:04:18.254 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:18.254 "dma_device_type": 2 00:04:18.254 } 00:04:18.254 ], 00:04:18.254 "driver_specific": {} 00:04:18.254 }, 00:04:18.254 { 00:04:18.254 "name": "Passthru0", 00:04:18.254 "aliases": [ 00:04:18.254 "b4514543-560e-5f66-a06f-0f2c5ade92d1" 00:04:18.254 ], 00:04:18.254 "product_name": "passthru", 00:04:18.254 "block_size": 512, 00:04:18.254 "num_blocks": 16384, 00:04:18.254 "uuid": "b4514543-560e-5f66-a06f-0f2c5ade92d1", 00:04:18.254 "assigned_rate_limits": { 00:04:18.254 "rw_ios_per_sec": 0, 00:04:18.254 "rw_mbytes_per_sec": 0, 00:04:18.254 "r_mbytes_per_sec": 0, 00:04:18.254 "w_mbytes_per_sec": 0 00:04:18.254 }, 00:04:18.254 "claimed": false, 00:04:18.254 "zoned": false, 00:04:18.254 "supported_io_types": { 00:04:18.254 "read": true, 00:04:18.254 "write": true, 00:04:18.254 "unmap": true, 00:04:18.254 "write_zeroes": true, 00:04:18.254 "flush": true, 00:04:18.254 "reset": true, 00:04:18.254 "compare": false, 00:04:18.254 "compare_and_write": false, 00:04:18.254 "abort": true, 00:04:18.254 "nvme_admin": false, 00:04:18.254 "nvme_io": false 00:04:18.254 }, 00:04:18.254 "memory_domains": [ 00:04:18.254 { 00:04:18.254 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:18.255 "dma_device_type": 2 00:04:18.255 } 00:04:18.255 ], 00:04:18.255 "driver_specific": { 00:04:18.255 "passthru": { 00:04:18.255 "name": "Passthru0", 00:04:18.255 "base_bdev_name": "Malloc2" 00:04:18.255 } 00:04:18.255 } 00:04:18.255 } 00:04:18.255 ]' 00:04:18.255 01:40:06 -- rpc/rpc.sh@21 -- # jq length 00:04:18.513 01:40:06 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:18.513 01:40:06 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:18.513 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.513 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.513 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.513 01:40:06 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:18.513 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.513 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.513 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.513 01:40:06 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:18.513 01:40:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:18.513 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.513 01:40:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:18.513 01:40:06 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:18.513 01:40:06 -- rpc/rpc.sh@26 -- # jq length 00:04:18.513 01:40:06 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:18.513 00:04:18.513 real 0m0.220s 00:04:18.513 user 0m0.147s 00:04:18.513 sys 0m0.017s 00:04:18.513 01:40:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:18.513 01:40:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.513 ************************************ 00:04:18.513 END TEST rpc_daemon_integrity 00:04:18.513 ************************************ 00:04:18.513 01:40:06 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:18.513 01:40:06 -- rpc/rpc.sh@84 -- # killprocess 3318440 00:04:18.513 01:40:06 -- common/autotest_common.sh@936 -- # '[' -z 3318440 ']' 00:04:18.513 01:40:06 -- common/autotest_common.sh@940 -- # kill -0 3318440 00:04:18.513 01:40:06 -- common/autotest_common.sh@941 -- # uname 00:04:18.513 01:40:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:18.513 01:40:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3318440 00:04:18.513 01:40:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:18.513 01:40:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:18.513 01:40:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3318440' 00:04:18.513 killing process with pid 3318440 00:04:18.513 01:40:06 -- common/autotest_common.sh@955 -- # kill 3318440 00:04:18.513 01:40:06 -- common/autotest_common.sh@960 -- # wait 3318440 00:04:19.079 00:04:19.079 real 0m2.491s 00:04:19.079 user 0m3.141s 00:04:19.079 sys 0m0.582s 00:04:19.079 01:40:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.079 01:40:07 -- common/autotest_common.sh@10 -- # set +x 00:04:19.079 ************************************ 00:04:19.079 END TEST rpc 00:04:19.079 ************************************ 00:04:19.079 01:40:07 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:19.079 01:40:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.079 01:40:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.079 01:40:07 -- common/autotest_common.sh@10 -- # set +x 00:04:19.079 ************************************ 00:04:19.079 START TEST rpc_client 00:04:19.079 ************************************ 00:04:19.079 01:40:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:19.079 * Looking for test storage... 00:04:19.079 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:19.079 01:40:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:19.079 01:40:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:19.079 01:40:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:19.079 01:40:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:19.079 01:40:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:19.079 01:40:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:19.079 01:40:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:19.079 01:40:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:19.079 01:40:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:19.079 01:40:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:19.079 01:40:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:19.079 01:40:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:19.079 01:40:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:19.079 01:40:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:19.079 01:40:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:19.079 01:40:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:19.079 01:40:07 -- scripts/common.sh@344 -- # : 1 00:04:19.079 01:40:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:19.079 01:40:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:19.079 01:40:07 -- scripts/common.sh@364 -- # decimal 1 00:04:19.080 01:40:07 -- scripts/common.sh@352 -- # local d=1 00:04:19.080 01:40:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:19.080 01:40:07 -- scripts/common.sh@354 -- # echo 1 00:04:19.080 01:40:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:19.080 01:40:07 -- scripts/common.sh@365 -- # decimal 2 00:04:19.080 01:40:07 -- scripts/common.sh@352 -- # local d=2 00:04:19.080 01:40:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:19.080 01:40:07 -- scripts/common.sh@354 -- # echo 2 00:04:19.080 01:40:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:19.080 01:40:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:19.080 01:40:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:19.080 01:40:07 -- scripts/common.sh@367 -- # return 0 00:04:19.080 01:40:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:19.080 01:40:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:19.080 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.080 --rc genhtml_branch_coverage=1 00:04:19.080 --rc genhtml_function_coverage=1 00:04:19.080 --rc genhtml_legend=1 00:04:19.080 --rc geninfo_all_blocks=1 00:04:19.080 --rc geninfo_unexecuted_blocks=1 00:04:19.080 00:04:19.080 ' 00:04:19.080 01:40:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:19.080 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.080 --rc genhtml_branch_coverage=1 00:04:19.080 --rc genhtml_function_coverage=1 00:04:19.080 --rc genhtml_legend=1 00:04:19.080 --rc geninfo_all_blocks=1 00:04:19.080 --rc geninfo_unexecuted_blocks=1 00:04:19.080 00:04:19.080 ' 00:04:19.080 01:40:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:19.080 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.080 --rc genhtml_branch_coverage=1 00:04:19.080 --rc genhtml_function_coverage=1 00:04:19.080 --rc genhtml_legend=1 00:04:19.080 --rc geninfo_all_blocks=1 00:04:19.080 --rc geninfo_unexecuted_blocks=1 00:04:19.080 00:04:19.080 ' 00:04:19.080 01:40:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:19.080 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.080 --rc genhtml_branch_coverage=1 00:04:19.080 --rc genhtml_function_coverage=1 00:04:19.080 --rc genhtml_legend=1 00:04:19.080 --rc geninfo_all_blocks=1 00:04:19.080 --rc geninfo_unexecuted_blocks=1 00:04:19.080 00:04:19.080 ' 00:04:19.080 01:40:07 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:19.080 OK 00:04:19.080 01:40:07 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:19.080 00:04:19.080 real 0m0.154s 00:04:19.080 user 0m0.119s 00:04:19.080 sys 0m0.043s 00:04:19.080 01:40:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.080 01:40:07 -- common/autotest_common.sh@10 -- # set +x 00:04:19.080 ************************************ 00:04:19.080 END TEST rpc_client 00:04:19.080 ************************************ 00:04:19.080 01:40:07 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:19.080 01:40:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.080 01:40:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.080 01:40:07 -- common/autotest_common.sh@10 -- # set +x 00:04:19.080 ************************************ 00:04:19.080 START TEST json_config 00:04:19.080 ************************************ 00:04:19.080 01:40:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:19.339 01:40:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:19.339 01:40:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:19.339 01:40:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:19.339 01:40:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:19.339 01:40:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:19.339 01:40:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:19.339 01:40:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:19.339 01:40:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:19.339 01:40:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:19.339 01:40:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:19.339 01:40:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:19.339 01:40:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:19.339 01:40:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:19.339 01:40:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:19.339 01:40:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:19.339 01:40:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:19.339 01:40:07 -- scripts/common.sh@344 -- # : 1 00:04:19.339 01:40:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:19.339 01:40:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:19.339 01:40:07 -- scripts/common.sh@364 -- # decimal 1 00:04:19.339 01:40:07 -- scripts/common.sh@352 -- # local d=1 00:04:19.339 01:40:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:19.339 01:40:07 -- scripts/common.sh@354 -- # echo 1 00:04:19.339 01:40:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:19.339 01:40:07 -- scripts/common.sh@365 -- # decimal 2 00:04:19.339 01:40:07 -- scripts/common.sh@352 -- # local d=2 00:04:19.339 01:40:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:19.339 01:40:07 -- scripts/common.sh@354 -- # echo 2 00:04:19.339 01:40:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:19.339 01:40:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:19.339 01:40:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:19.339 01:40:07 -- scripts/common.sh@367 -- # return 0 00:04:19.339 01:40:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:19.339 01:40:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:19.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.339 --rc genhtml_branch_coverage=1 00:04:19.339 --rc genhtml_function_coverage=1 00:04:19.339 --rc genhtml_legend=1 00:04:19.339 --rc geninfo_all_blocks=1 00:04:19.339 --rc geninfo_unexecuted_blocks=1 00:04:19.339 00:04:19.339 ' 00:04:19.339 01:40:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:19.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.339 --rc genhtml_branch_coverage=1 00:04:19.339 --rc genhtml_function_coverage=1 00:04:19.339 --rc genhtml_legend=1 00:04:19.339 --rc geninfo_all_blocks=1 00:04:19.339 --rc geninfo_unexecuted_blocks=1 00:04:19.339 00:04:19.339 ' 00:04:19.339 01:40:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:19.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.339 --rc genhtml_branch_coverage=1 00:04:19.339 --rc genhtml_function_coverage=1 00:04:19.339 --rc genhtml_legend=1 00:04:19.339 --rc geninfo_all_blocks=1 00:04:19.339 --rc geninfo_unexecuted_blocks=1 00:04:19.339 00:04:19.339 ' 00:04:19.339 01:40:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:19.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:19.339 --rc genhtml_branch_coverage=1 00:04:19.339 --rc genhtml_function_coverage=1 00:04:19.339 --rc genhtml_legend=1 00:04:19.339 --rc geninfo_all_blocks=1 00:04:19.339 --rc geninfo_unexecuted_blocks=1 00:04:19.339 00:04:19.339 ' 00:04:19.339 01:40:07 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:19.339 01:40:07 -- nvmf/common.sh@7 -- # uname -s 00:04:19.339 01:40:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:19.339 01:40:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:19.339 01:40:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:19.339 01:40:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:19.339 01:40:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:19.339 01:40:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:19.339 01:40:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:19.339 01:40:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:19.339 01:40:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:19.339 01:40:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:19.339 01:40:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:19.339 01:40:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:19.339 01:40:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:19.339 01:40:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:19.339 01:40:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:19.339 01:40:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:19.339 01:40:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:19.339 01:40:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:19.339 01:40:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:19.339 01:40:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:19.340 01:40:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:19.340 01:40:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:19.340 01:40:07 -- paths/export.sh@5 -- # export PATH 00:04:19.340 01:40:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:19.340 01:40:07 -- nvmf/common.sh@46 -- # : 0 00:04:19.340 01:40:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:19.340 01:40:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:19.340 01:40:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:19.340 01:40:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:19.340 01:40:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:19.340 01:40:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:19.340 01:40:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:19.340 01:40:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:19.340 01:40:07 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:19.340 01:40:07 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:19.340 01:40:07 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:19.340 01:40:07 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:19.340 01:40:07 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:19.340 01:40:07 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:19.340 01:40:07 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:19.340 01:40:07 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:19.340 01:40:07 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:19.340 01:40:07 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:19.340 01:40:07 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:19.340 01:40:07 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:19.340 01:40:07 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:19.340 01:40:07 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:19.340 01:40:07 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:19.340 INFO: JSON configuration test init 00:04:19.340 01:40:07 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:19.340 01:40:07 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:19.340 01:40:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:19.340 01:40:07 -- common/autotest_common.sh@10 -- # set +x 00:04:19.340 01:40:07 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:19.340 01:40:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:19.340 01:40:07 -- common/autotest_common.sh@10 -- # set +x 00:04:19.340 01:40:07 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:19.340 01:40:07 -- json_config/json_config.sh@98 -- # local app=target 00:04:19.340 01:40:07 -- json_config/json_config.sh@99 -- # shift 00:04:19.340 01:40:07 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:19.340 01:40:07 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:19.340 01:40:07 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:19.340 01:40:07 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:19.340 01:40:07 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:19.340 01:40:07 -- json_config/json_config.sh@111 -- # app_pid[$app]=3318977 00:04:19.340 01:40:07 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:19.340 01:40:07 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:19.340 Waiting for target to run... 00:04:19.340 01:40:07 -- json_config/json_config.sh@114 -- # waitforlisten 3318977 /var/tmp/spdk_tgt.sock 00:04:19.340 01:40:07 -- common/autotest_common.sh@829 -- # '[' -z 3318977 ']' 00:04:19.340 01:40:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:19.340 01:40:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:19.340 01:40:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:19.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:19.340 01:40:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:19.340 01:40:07 -- common/autotest_common.sh@10 -- # set +x 00:04:19.340 [2024-11-19 01:40:07.805042] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:19.340 [2024-11-19 01:40:07.805143] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3318977 ] 00:04:19.340 EAL: No free 2048 kB hugepages reported on node 1 00:04:19.906 [2024-11-19 01:40:08.320797] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:19.907 [2024-11-19 01:40:08.425830] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:19.907 [2024-11-19 01:40:08.426001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:20.473 01:40:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:20.473 01:40:08 -- common/autotest_common.sh@862 -- # return 0 00:04:20.474 01:40:08 -- json_config/json_config.sh@115 -- # echo '' 00:04:20.474 00:04:20.474 01:40:08 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:20.474 01:40:08 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:20.474 01:40:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.474 01:40:08 -- common/autotest_common.sh@10 -- # set +x 00:04:20.474 01:40:08 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:20.474 01:40:08 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:20.474 01:40:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:20.474 01:40:08 -- common/autotest_common.sh@10 -- # set +x 00:04:20.474 01:40:08 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:20.474 01:40:08 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:20.474 01:40:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:23.761 01:40:12 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:23.761 01:40:12 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:23.761 01:40:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:23.761 01:40:12 -- common/autotest_common.sh@10 -- # set +x 00:04:23.761 01:40:12 -- json_config/json_config.sh@48 -- # local ret=0 00:04:23.761 01:40:12 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:23.761 01:40:12 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:23.761 01:40:12 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:23.761 01:40:12 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:23.761 01:40:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:23.761 01:40:12 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:23.761 01:40:12 -- json_config/json_config.sh@51 -- # local get_types 00:04:23.761 01:40:12 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:23.761 01:40:12 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:23.761 01:40:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:23.761 01:40:12 -- common/autotest_common.sh@10 -- # set +x 00:04:23.761 01:40:12 -- json_config/json_config.sh@58 -- # return 0 00:04:23.761 01:40:12 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:23.761 01:40:12 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:23.761 01:40:12 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:23.761 01:40:12 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:23.761 01:40:12 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:23.761 01:40:12 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:23.761 01:40:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:23.761 01:40:12 -- common/autotest_common.sh@10 -- # set +x 00:04:23.761 01:40:12 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:23.761 01:40:12 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:23.761 01:40:12 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:23.761 01:40:12 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:23.761 01:40:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:24.020 MallocForNvmf0 00:04:24.020 01:40:12 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:24.020 01:40:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:24.278 MallocForNvmf1 00:04:24.278 01:40:12 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:24.278 01:40:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:24.536 [2024-11-19 01:40:13.018767] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:24.536 01:40:13 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:24.536 01:40:13 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:24.794 01:40:13 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:24.794 01:40:13 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:25.051 01:40:13 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:25.051 01:40:13 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:25.308 01:40:13 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:25.308 01:40:13 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:25.566 [2024-11-19 01:40:14.022143] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:25.566 01:40:14 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:25.566 01:40:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:25.566 01:40:14 -- common/autotest_common.sh@10 -- # set +x 00:04:25.566 01:40:14 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:25.566 01:40:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:25.566 01:40:14 -- common/autotest_common.sh@10 -- # set +x 00:04:25.566 01:40:14 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:25.566 01:40:14 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:25.566 01:40:14 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:25.824 MallocBdevForConfigChangeCheck 00:04:25.824 01:40:14 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:25.824 01:40:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:25.824 01:40:14 -- common/autotest_common.sh@10 -- # set +x 00:04:25.824 01:40:14 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:25.824 01:40:14 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:26.394 01:40:14 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:26.394 INFO: shutting down applications... 00:04:26.394 01:40:14 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:26.394 01:40:14 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:26.394 01:40:14 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:26.394 01:40:14 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:28.301 Calling clear_iscsi_subsystem 00:04:28.301 Calling clear_nvmf_subsystem 00:04:28.301 Calling clear_nbd_subsystem 00:04:28.301 Calling clear_ublk_subsystem 00:04:28.301 Calling clear_vhost_blk_subsystem 00:04:28.301 Calling clear_vhost_scsi_subsystem 00:04:28.301 Calling clear_scheduler_subsystem 00:04:28.301 Calling clear_bdev_subsystem 00:04:28.301 Calling clear_accel_subsystem 00:04:28.301 Calling clear_vmd_subsystem 00:04:28.301 Calling clear_sock_subsystem 00:04:28.301 Calling clear_iobuf_subsystem 00:04:28.301 01:40:16 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:28.301 01:40:16 -- json_config/json_config.sh@396 -- # count=100 00:04:28.301 01:40:16 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:28.301 01:40:16 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:28.301 01:40:16 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:28.301 01:40:16 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:28.301 01:40:16 -- json_config/json_config.sh@398 -- # break 00:04:28.301 01:40:16 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:28.301 01:40:16 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:28.301 01:40:16 -- json_config/json_config.sh@120 -- # local app=target 00:04:28.301 01:40:16 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:28.301 01:40:16 -- json_config/json_config.sh@124 -- # [[ -n 3318977 ]] 00:04:28.301 01:40:16 -- json_config/json_config.sh@127 -- # kill -SIGINT 3318977 00:04:28.301 01:40:16 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:28.301 01:40:16 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:28.301 01:40:16 -- json_config/json_config.sh@130 -- # kill -0 3318977 00:04:28.301 01:40:16 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:28.871 01:40:17 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:28.871 01:40:17 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:28.871 01:40:17 -- json_config/json_config.sh@130 -- # kill -0 3318977 00:04:28.871 01:40:17 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:28.871 01:40:17 -- json_config/json_config.sh@132 -- # break 00:04:28.871 01:40:17 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:28.871 01:40:17 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:28.871 SPDK target shutdown done 00:04:28.871 01:40:17 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:28.871 INFO: relaunching applications... 00:04:28.871 01:40:17 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:28.871 01:40:17 -- json_config/json_config.sh@98 -- # local app=target 00:04:28.871 01:40:17 -- json_config/json_config.sh@99 -- # shift 00:04:28.871 01:40:17 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:28.871 01:40:17 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:28.871 01:40:17 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:28.871 01:40:17 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:28.871 01:40:17 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:28.871 01:40:17 -- json_config/json_config.sh@111 -- # app_pid[$app]=3320286 00:04:28.871 01:40:17 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:28.871 Waiting for target to run... 00:04:28.871 01:40:17 -- json_config/json_config.sh@114 -- # waitforlisten 3320286 /var/tmp/spdk_tgt.sock 00:04:28.871 01:40:17 -- common/autotest_common.sh@829 -- # '[' -z 3320286 ']' 00:04:28.871 01:40:17 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:28.871 01:40:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:28.871 01:40:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:28.871 01:40:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:28.871 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:28.871 01:40:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:28.871 01:40:17 -- common/autotest_common.sh@10 -- # set +x 00:04:28.871 [2024-11-19 01:40:17.309134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:28.871 [2024-11-19 01:40:17.309219] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3320286 ] 00:04:28.871 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.130 [2024-11-19 01:40:17.639620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.389 [2024-11-19 01:40:17.726994] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:29.389 [2024-11-19 01:40:17.727183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:32.686 [2024-11-19 01:40:20.758581] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:32.686 [2024-11-19 01:40:20.791083] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:32.686 01:40:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:32.686 01:40:21 -- common/autotest_common.sh@862 -- # return 0 00:04:32.686 01:40:21 -- json_config/json_config.sh@115 -- # echo '' 00:04:32.686 00:04:32.686 01:40:21 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:32.686 01:40:21 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:32.686 INFO: Checking if target configuration is the same... 00:04:32.686 01:40:21 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.686 01:40:21 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:32.686 01:40:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:32.686 + '[' 2 -ne 2 ']' 00:04:32.686 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:32.686 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:32.686 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:32.686 +++ basename /dev/fd/62 00:04:32.686 ++ mktemp /tmp/62.XXX 00:04:32.686 + tmp_file_1=/tmp/62.6A8 00:04:32.686 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.686 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:32.686 + tmp_file_2=/tmp/spdk_tgt_config.json.PVK 00:04:32.686 + ret=0 00:04:32.686 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:33.256 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:33.256 + diff -u /tmp/62.6A8 /tmp/spdk_tgt_config.json.PVK 00:04:33.256 + echo 'INFO: JSON config files are the same' 00:04:33.256 INFO: JSON config files are the same 00:04:33.256 + rm /tmp/62.6A8 /tmp/spdk_tgt_config.json.PVK 00:04:33.256 + exit 0 00:04:33.256 01:40:21 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:33.256 01:40:21 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:33.256 INFO: changing configuration and checking if this can be detected... 00:04:33.256 01:40:21 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:33.256 01:40:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:33.517 01:40:21 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:33.517 01:40:21 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:33.517 01:40:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:33.517 + '[' 2 -ne 2 ']' 00:04:33.517 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:33.517 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:33.517 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:33.517 +++ basename /dev/fd/62 00:04:33.517 ++ mktemp /tmp/62.XXX 00:04:33.517 + tmp_file_1=/tmp/62.wLd 00:04:33.517 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:33.517 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:33.517 + tmp_file_2=/tmp/spdk_tgt_config.json.0QD 00:04:33.517 + ret=0 00:04:33.517 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:33.776 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:33.776 + diff -u /tmp/62.wLd /tmp/spdk_tgt_config.json.0QD 00:04:33.776 + ret=1 00:04:33.776 + echo '=== Start of file: /tmp/62.wLd ===' 00:04:33.776 + cat /tmp/62.wLd 00:04:33.776 + echo '=== End of file: /tmp/62.wLd ===' 00:04:33.776 + echo '' 00:04:33.776 + echo '=== Start of file: /tmp/spdk_tgt_config.json.0QD ===' 00:04:33.776 + cat /tmp/spdk_tgt_config.json.0QD 00:04:33.776 + echo '=== End of file: /tmp/spdk_tgt_config.json.0QD ===' 00:04:33.776 + echo '' 00:04:33.776 + rm /tmp/62.wLd /tmp/spdk_tgt_config.json.0QD 00:04:33.776 + exit 1 00:04:33.776 01:40:22 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:33.776 INFO: configuration change detected. 00:04:33.776 01:40:22 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:33.776 01:40:22 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:33.776 01:40:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:33.776 01:40:22 -- common/autotest_common.sh@10 -- # set +x 00:04:33.776 01:40:22 -- json_config/json_config.sh@360 -- # local ret=0 00:04:33.776 01:40:22 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:33.776 01:40:22 -- json_config/json_config.sh@370 -- # [[ -n 3320286 ]] 00:04:33.776 01:40:22 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:33.776 01:40:22 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:33.776 01:40:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:33.776 01:40:22 -- common/autotest_common.sh@10 -- # set +x 00:04:33.776 01:40:22 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:33.776 01:40:22 -- json_config/json_config.sh@246 -- # uname -s 00:04:33.776 01:40:22 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:33.776 01:40:22 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:34.036 01:40:22 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:34.036 01:40:22 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:34.037 01:40:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:34.037 01:40:22 -- common/autotest_common.sh@10 -- # set +x 00:04:34.037 01:40:22 -- json_config/json_config.sh@376 -- # killprocess 3320286 00:04:34.037 01:40:22 -- common/autotest_common.sh@936 -- # '[' -z 3320286 ']' 00:04:34.037 01:40:22 -- common/autotest_common.sh@940 -- # kill -0 3320286 00:04:34.037 01:40:22 -- common/autotest_common.sh@941 -- # uname 00:04:34.037 01:40:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:34.037 01:40:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3320286 00:04:34.037 01:40:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:34.037 01:40:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:34.037 01:40:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3320286' 00:04:34.037 killing process with pid 3320286 00:04:34.037 01:40:22 -- common/autotest_common.sh@955 -- # kill 3320286 00:04:34.037 01:40:22 -- common/autotest_common.sh@960 -- # wait 3320286 00:04:35.947 01:40:24 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:35.947 01:40:24 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:35.947 01:40:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:35.947 01:40:24 -- common/autotest_common.sh@10 -- # set +x 00:04:35.947 01:40:24 -- json_config/json_config.sh@381 -- # return 0 00:04:35.947 01:40:24 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:35.947 INFO: Success 00:04:35.947 00:04:35.947 real 0m16.426s 00:04:35.947 user 0m18.997s 00:04:35.947 sys 0m2.138s 00:04:35.947 01:40:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.947 01:40:24 -- common/autotest_common.sh@10 -- # set +x 00:04:35.947 ************************************ 00:04:35.947 END TEST json_config 00:04:35.947 ************************************ 00:04:35.947 01:40:24 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:35.947 01:40:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.947 01:40:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.947 01:40:24 -- common/autotest_common.sh@10 -- # set +x 00:04:35.947 ************************************ 00:04:35.947 START TEST json_config_extra_key 00:04:35.947 ************************************ 00:04:35.947 01:40:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:35.947 01:40:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:35.947 01:40:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:35.947 01:40:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:35.947 01:40:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:35.947 01:40:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:35.947 01:40:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:35.947 01:40:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:35.947 01:40:24 -- scripts/common.sh@335 -- # IFS=.-: 00:04:35.947 01:40:24 -- scripts/common.sh@335 -- # read -ra ver1 00:04:35.947 01:40:24 -- scripts/common.sh@336 -- # IFS=.-: 00:04:35.947 01:40:24 -- scripts/common.sh@336 -- # read -ra ver2 00:04:35.947 01:40:24 -- scripts/common.sh@337 -- # local 'op=<' 00:04:35.947 01:40:24 -- scripts/common.sh@339 -- # ver1_l=2 00:04:35.947 01:40:24 -- scripts/common.sh@340 -- # ver2_l=1 00:04:35.947 01:40:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:35.947 01:40:24 -- scripts/common.sh@343 -- # case "$op" in 00:04:35.947 01:40:24 -- scripts/common.sh@344 -- # : 1 00:04:35.947 01:40:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:35.947 01:40:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:35.947 01:40:24 -- scripts/common.sh@364 -- # decimal 1 00:04:35.947 01:40:24 -- scripts/common.sh@352 -- # local d=1 00:04:35.947 01:40:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:35.947 01:40:24 -- scripts/common.sh@354 -- # echo 1 00:04:35.947 01:40:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:35.947 01:40:24 -- scripts/common.sh@365 -- # decimal 2 00:04:35.947 01:40:24 -- scripts/common.sh@352 -- # local d=2 00:04:35.947 01:40:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:35.947 01:40:24 -- scripts/common.sh@354 -- # echo 2 00:04:35.947 01:40:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:35.947 01:40:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:35.947 01:40:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:35.947 01:40:24 -- scripts/common.sh@367 -- # return 0 00:04:35.947 01:40:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:35.947 01:40:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:35.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.947 --rc genhtml_branch_coverage=1 00:04:35.947 --rc genhtml_function_coverage=1 00:04:35.947 --rc genhtml_legend=1 00:04:35.947 --rc geninfo_all_blocks=1 00:04:35.947 --rc geninfo_unexecuted_blocks=1 00:04:35.947 00:04:35.947 ' 00:04:35.947 01:40:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:35.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.947 --rc genhtml_branch_coverage=1 00:04:35.947 --rc genhtml_function_coverage=1 00:04:35.947 --rc genhtml_legend=1 00:04:35.947 --rc geninfo_all_blocks=1 00:04:35.947 --rc geninfo_unexecuted_blocks=1 00:04:35.947 00:04:35.947 ' 00:04:35.947 01:40:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:35.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.947 --rc genhtml_branch_coverage=1 00:04:35.947 --rc genhtml_function_coverage=1 00:04:35.947 --rc genhtml_legend=1 00:04:35.947 --rc geninfo_all_blocks=1 00:04:35.947 --rc geninfo_unexecuted_blocks=1 00:04:35.947 00:04:35.947 ' 00:04:35.947 01:40:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:35.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.947 --rc genhtml_branch_coverage=1 00:04:35.947 --rc genhtml_function_coverage=1 00:04:35.947 --rc genhtml_legend=1 00:04:35.947 --rc geninfo_all_blocks=1 00:04:35.947 --rc geninfo_unexecuted_blocks=1 00:04:35.947 00:04:35.947 ' 00:04:35.947 01:40:24 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:35.947 01:40:24 -- nvmf/common.sh@7 -- # uname -s 00:04:35.947 01:40:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:35.947 01:40:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:35.947 01:40:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:35.947 01:40:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:35.947 01:40:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:35.947 01:40:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:35.947 01:40:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:35.947 01:40:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:35.947 01:40:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:35.947 01:40:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:35.947 01:40:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:35.947 01:40:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:35.947 01:40:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:35.948 01:40:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:35.948 01:40:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:35.948 01:40:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:35.948 01:40:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:35.948 01:40:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:35.948 01:40:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:35.948 01:40:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:35.948 01:40:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:35.948 01:40:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:35.948 01:40:24 -- paths/export.sh@5 -- # export PATH 00:04:35.948 01:40:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:35.948 01:40:24 -- nvmf/common.sh@46 -- # : 0 00:04:35.948 01:40:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:35.948 01:40:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:35.948 01:40:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:35.948 01:40:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:35.948 01:40:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:35.948 01:40:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:35.948 01:40:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:35.948 01:40:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:35.948 INFO: launching applications... 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3321236 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:35.948 Waiting for target to run... 00:04:35.948 01:40:24 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3321236 /var/tmp/spdk_tgt.sock 00:04:35.948 01:40:24 -- common/autotest_common.sh@829 -- # '[' -z 3321236 ']' 00:04:35.948 01:40:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:35.948 01:40:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:35.948 01:40:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:35.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:35.948 01:40:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:35.948 01:40:24 -- common/autotest_common.sh@10 -- # set +x 00:04:35.948 [2024-11-19 01:40:24.242343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:35.948 [2024-11-19 01:40:24.242434] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3321236 ] 00:04:35.948 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.209 [2024-11-19 01:40:24.604979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.209 [2024-11-19 01:40:24.691692] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:36.209 [2024-11-19 01:40:24.691867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.779 01:40:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.779 01:40:25 -- common/autotest_common.sh@862 -- # return 0 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:36.779 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:36.779 INFO: shutting down applications... 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3321236 ]] 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3321236 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3321236 00:04:36.779 01:40:25 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3321236 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:37.345 SPDK target shutdown done 00:04:37.345 01:40:25 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:37.345 Success 00:04:37.345 00:04:37.345 real 0m1.705s 00:04:37.345 user 0m1.753s 00:04:37.345 sys 0m0.457s 00:04:37.345 01:40:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.345 01:40:25 -- common/autotest_common.sh@10 -- # set +x 00:04:37.345 ************************************ 00:04:37.345 END TEST json_config_extra_key 00:04:37.345 ************************************ 00:04:37.345 01:40:25 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:37.345 01:40:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.345 01:40:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.345 01:40:25 -- common/autotest_common.sh@10 -- # set +x 00:04:37.345 ************************************ 00:04:37.345 START TEST alias_rpc 00:04:37.345 ************************************ 00:04:37.345 01:40:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:37.345 * Looking for test storage... 00:04:37.346 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:37.346 01:40:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:37.346 01:40:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:37.346 01:40:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:37.606 01:40:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:37.606 01:40:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:37.606 01:40:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:37.606 01:40:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:37.606 01:40:25 -- scripts/common.sh@335 -- # IFS=.-: 00:04:37.606 01:40:25 -- scripts/common.sh@335 -- # read -ra ver1 00:04:37.606 01:40:25 -- scripts/common.sh@336 -- # IFS=.-: 00:04:37.606 01:40:25 -- scripts/common.sh@336 -- # read -ra ver2 00:04:37.606 01:40:25 -- scripts/common.sh@337 -- # local 'op=<' 00:04:37.606 01:40:25 -- scripts/common.sh@339 -- # ver1_l=2 00:04:37.606 01:40:25 -- scripts/common.sh@340 -- # ver2_l=1 00:04:37.606 01:40:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:37.606 01:40:25 -- scripts/common.sh@343 -- # case "$op" in 00:04:37.606 01:40:25 -- scripts/common.sh@344 -- # : 1 00:04:37.606 01:40:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:37.606 01:40:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:37.606 01:40:25 -- scripts/common.sh@364 -- # decimal 1 00:04:37.606 01:40:25 -- scripts/common.sh@352 -- # local d=1 00:04:37.606 01:40:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:37.606 01:40:25 -- scripts/common.sh@354 -- # echo 1 00:04:37.606 01:40:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:37.606 01:40:25 -- scripts/common.sh@365 -- # decimal 2 00:04:37.606 01:40:25 -- scripts/common.sh@352 -- # local d=2 00:04:37.606 01:40:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:37.606 01:40:25 -- scripts/common.sh@354 -- # echo 2 00:04:37.606 01:40:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:37.606 01:40:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:37.606 01:40:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:37.606 01:40:25 -- scripts/common.sh@367 -- # return 0 00:04:37.606 01:40:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:37.606 01:40:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.606 --rc genhtml_branch_coverage=1 00:04:37.606 --rc genhtml_function_coverage=1 00:04:37.606 --rc genhtml_legend=1 00:04:37.606 --rc geninfo_all_blocks=1 00:04:37.606 --rc geninfo_unexecuted_blocks=1 00:04:37.606 00:04:37.606 ' 00:04:37.606 01:40:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.606 --rc genhtml_branch_coverage=1 00:04:37.606 --rc genhtml_function_coverage=1 00:04:37.606 --rc genhtml_legend=1 00:04:37.606 --rc geninfo_all_blocks=1 00:04:37.606 --rc geninfo_unexecuted_blocks=1 00:04:37.606 00:04:37.606 ' 00:04:37.606 01:40:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.606 --rc genhtml_branch_coverage=1 00:04:37.606 --rc genhtml_function_coverage=1 00:04:37.606 --rc genhtml_legend=1 00:04:37.606 --rc geninfo_all_blocks=1 00:04:37.606 --rc geninfo_unexecuted_blocks=1 00:04:37.606 00:04:37.606 ' 00:04:37.606 01:40:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.606 --rc genhtml_branch_coverage=1 00:04:37.606 --rc genhtml_function_coverage=1 00:04:37.606 --rc genhtml_legend=1 00:04:37.606 --rc geninfo_all_blocks=1 00:04:37.606 --rc geninfo_unexecuted_blocks=1 00:04:37.606 00:04:37.606 ' 00:04:37.606 01:40:25 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:37.606 01:40:25 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3321552 00:04:37.606 01:40:25 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:37.606 01:40:25 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3321552 00:04:37.606 01:40:25 -- common/autotest_common.sh@829 -- # '[' -z 3321552 ']' 00:04:37.606 01:40:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:37.606 01:40:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.606 01:40:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:37.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:37.606 01:40:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.606 01:40:25 -- common/autotest_common.sh@10 -- # set +x 00:04:37.606 [2024-11-19 01:40:25.986440] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.606 [2024-11-19 01:40:25.986531] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3321552 ] 00:04:37.606 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.606 [2024-11-19 01:40:26.042547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:37.606 [2024-11-19 01:40:26.150152] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:37.606 [2024-11-19 01:40:26.150324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.545 01:40:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.545 01:40:26 -- common/autotest_common.sh@862 -- # return 0 00:04:38.545 01:40:26 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:38.806 01:40:27 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3321552 00:04:38.806 01:40:27 -- common/autotest_common.sh@936 -- # '[' -z 3321552 ']' 00:04:38.806 01:40:27 -- common/autotest_common.sh@940 -- # kill -0 3321552 00:04:38.806 01:40:27 -- common/autotest_common.sh@941 -- # uname 00:04:38.806 01:40:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:38.806 01:40:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3321552 00:04:38.806 01:40:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:38.806 01:40:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:38.806 01:40:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3321552' 00:04:38.806 killing process with pid 3321552 00:04:38.806 01:40:27 -- common/autotest_common.sh@955 -- # kill 3321552 00:04:38.806 01:40:27 -- common/autotest_common.sh@960 -- # wait 3321552 00:04:39.375 00:04:39.375 real 0m1.967s 00:04:39.375 user 0m2.304s 00:04:39.375 sys 0m0.477s 00:04:39.375 01:40:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.375 01:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:39.375 ************************************ 00:04:39.375 END TEST alias_rpc 00:04:39.375 ************************************ 00:04:39.375 01:40:27 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:39.375 01:40:27 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:39.375 01:40:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.375 01:40:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.375 01:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:39.375 ************************************ 00:04:39.375 START TEST spdkcli_tcp 00:04:39.375 ************************************ 00:04:39.375 01:40:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:39.375 * Looking for test storage... 00:04:39.375 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:39.375 01:40:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:39.375 01:40:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:39.375 01:40:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:39.375 01:40:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:39.375 01:40:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:39.375 01:40:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:39.375 01:40:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:39.375 01:40:27 -- scripts/common.sh@335 -- # IFS=.-: 00:04:39.375 01:40:27 -- scripts/common.sh@335 -- # read -ra ver1 00:04:39.375 01:40:27 -- scripts/common.sh@336 -- # IFS=.-: 00:04:39.375 01:40:27 -- scripts/common.sh@336 -- # read -ra ver2 00:04:39.375 01:40:27 -- scripts/common.sh@337 -- # local 'op=<' 00:04:39.375 01:40:27 -- scripts/common.sh@339 -- # ver1_l=2 00:04:39.375 01:40:27 -- scripts/common.sh@340 -- # ver2_l=1 00:04:39.375 01:40:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:39.375 01:40:27 -- scripts/common.sh@343 -- # case "$op" in 00:04:39.375 01:40:27 -- scripts/common.sh@344 -- # : 1 00:04:39.375 01:40:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:39.375 01:40:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:39.375 01:40:27 -- scripts/common.sh@364 -- # decimal 1 00:04:39.375 01:40:27 -- scripts/common.sh@352 -- # local d=1 00:04:39.375 01:40:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:39.375 01:40:27 -- scripts/common.sh@354 -- # echo 1 00:04:39.375 01:40:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:39.375 01:40:27 -- scripts/common.sh@365 -- # decimal 2 00:04:39.635 01:40:27 -- scripts/common.sh@352 -- # local d=2 00:04:39.635 01:40:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:39.635 01:40:27 -- scripts/common.sh@354 -- # echo 2 00:04:39.635 01:40:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:39.635 01:40:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:39.635 01:40:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:39.635 01:40:27 -- scripts/common.sh@367 -- # return 0 00:04:39.635 01:40:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:39.635 01:40:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:39.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.635 --rc genhtml_branch_coverage=1 00:04:39.635 --rc genhtml_function_coverage=1 00:04:39.635 --rc genhtml_legend=1 00:04:39.635 --rc geninfo_all_blocks=1 00:04:39.635 --rc geninfo_unexecuted_blocks=1 00:04:39.635 00:04:39.635 ' 00:04:39.635 01:40:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:39.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.635 --rc genhtml_branch_coverage=1 00:04:39.635 --rc genhtml_function_coverage=1 00:04:39.635 --rc genhtml_legend=1 00:04:39.635 --rc geninfo_all_blocks=1 00:04:39.635 --rc geninfo_unexecuted_blocks=1 00:04:39.635 00:04:39.635 ' 00:04:39.635 01:40:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:39.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.635 --rc genhtml_branch_coverage=1 00:04:39.635 --rc genhtml_function_coverage=1 00:04:39.635 --rc genhtml_legend=1 00:04:39.635 --rc geninfo_all_blocks=1 00:04:39.635 --rc geninfo_unexecuted_blocks=1 00:04:39.635 00:04:39.635 ' 00:04:39.635 01:40:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:39.635 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.635 --rc genhtml_branch_coverage=1 00:04:39.635 --rc genhtml_function_coverage=1 00:04:39.635 --rc genhtml_legend=1 00:04:39.635 --rc geninfo_all_blocks=1 00:04:39.635 --rc geninfo_unexecuted_blocks=1 00:04:39.635 00:04:39.635 ' 00:04:39.635 01:40:27 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:39.635 01:40:27 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:39.635 01:40:27 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:39.635 01:40:27 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:39.635 01:40:27 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:39.635 01:40:27 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:39.635 01:40:27 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:39.635 01:40:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:39.636 01:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:39.636 01:40:27 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3321771 00:04:39.636 01:40:27 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:39.636 01:40:27 -- spdkcli/tcp.sh@27 -- # waitforlisten 3321771 00:04:39.636 01:40:27 -- common/autotest_common.sh@829 -- # '[' -z 3321771 ']' 00:04:39.636 01:40:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:39.636 01:40:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.636 01:40:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:39.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:39.636 01:40:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.636 01:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:39.636 [2024-11-19 01:40:27.975954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.636 [2024-11-19 01:40:27.976040] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3321771 ] 00:04:39.636 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.636 [2024-11-19 01:40:28.035759] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:39.636 [2024-11-19 01:40:28.148324] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:39.636 [2024-11-19 01:40:28.148559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:39.636 [2024-11-19 01:40:28.148565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.573 01:40:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.574 01:40:28 -- common/autotest_common.sh@862 -- # return 0 00:04:40.574 01:40:28 -- spdkcli/tcp.sh@31 -- # socat_pid=3321907 00:04:40.574 01:40:28 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:40.574 01:40:28 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:40.840 [ 00:04:40.840 "bdev_malloc_delete", 00:04:40.840 "bdev_malloc_create", 00:04:40.840 "bdev_null_resize", 00:04:40.841 "bdev_null_delete", 00:04:40.841 "bdev_null_create", 00:04:40.841 "bdev_nvme_cuse_unregister", 00:04:40.841 "bdev_nvme_cuse_register", 00:04:40.841 "bdev_opal_new_user", 00:04:40.841 "bdev_opal_set_lock_state", 00:04:40.841 "bdev_opal_delete", 00:04:40.841 "bdev_opal_get_info", 00:04:40.841 "bdev_opal_create", 00:04:40.841 "bdev_nvme_opal_revert", 00:04:40.841 "bdev_nvme_opal_init", 00:04:40.841 "bdev_nvme_send_cmd", 00:04:40.841 "bdev_nvme_get_path_iostat", 00:04:40.841 "bdev_nvme_get_mdns_discovery_info", 00:04:40.841 "bdev_nvme_stop_mdns_discovery", 00:04:40.841 "bdev_nvme_start_mdns_discovery", 00:04:40.841 "bdev_nvme_set_multipath_policy", 00:04:40.841 "bdev_nvme_set_preferred_path", 00:04:40.841 "bdev_nvme_get_io_paths", 00:04:40.841 "bdev_nvme_remove_error_injection", 00:04:40.841 "bdev_nvme_add_error_injection", 00:04:40.841 "bdev_nvme_get_discovery_info", 00:04:40.841 "bdev_nvme_stop_discovery", 00:04:40.841 "bdev_nvme_start_discovery", 00:04:40.841 "bdev_nvme_get_controller_health_info", 00:04:40.841 "bdev_nvme_disable_controller", 00:04:40.841 "bdev_nvme_enable_controller", 00:04:40.841 "bdev_nvme_reset_controller", 00:04:40.841 "bdev_nvme_get_transport_statistics", 00:04:40.841 "bdev_nvme_apply_firmware", 00:04:40.841 "bdev_nvme_detach_controller", 00:04:40.841 "bdev_nvme_get_controllers", 00:04:40.841 "bdev_nvme_attach_controller", 00:04:40.841 "bdev_nvme_set_hotplug", 00:04:40.841 "bdev_nvme_set_options", 00:04:40.841 "bdev_passthru_delete", 00:04:40.841 "bdev_passthru_create", 00:04:40.841 "bdev_lvol_grow_lvstore", 00:04:40.841 "bdev_lvol_get_lvols", 00:04:40.841 "bdev_lvol_get_lvstores", 00:04:40.841 "bdev_lvol_delete", 00:04:40.841 "bdev_lvol_set_read_only", 00:04:40.841 "bdev_lvol_resize", 00:04:40.841 "bdev_lvol_decouple_parent", 00:04:40.841 "bdev_lvol_inflate", 00:04:40.841 "bdev_lvol_rename", 00:04:40.842 "bdev_lvol_clone_bdev", 00:04:40.842 "bdev_lvol_clone", 00:04:40.842 "bdev_lvol_snapshot", 00:04:40.842 "bdev_lvol_create", 00:04:40.842 "bdev_lvol_delete_lvstore", 00:04:40.842 "bdev_lvol_rename_lvstore", 00:04:40.842 "bdev_lvol_create_lvstore", 00:04:40.842 "bdev_raid_set_options", 00:04:40.842 "bdev_raid_remove_base_bdev", 00:04:40.842 "bdev_raid_add_base_bdev", 00:04:40.842 "bdev_raid_delete", 00:04:40.842 "bdev_raid_create", 00:04:40.842 "bdev_raid_get_bdevs", 00:04:40.842 "bdev_error_inject_error", 00:04:40.842 "bdev_error_delete", 00:04:40.842 "bdev_error_create", 00:04:40.842 "bdev_split_delete", 00:04:40.842 "bdev_split_create", 00:04:40.842 "bdev_delay_delete", 00:04:40.842 "bdev_delay_create", 00:04:40.842 "bdev_delay_update_latency", 00:04:40.842 "bdev_zone_block_delete", 00:04:40.842 "bdev_zone_block_create", 00:04:40.842 "blobfs_create", 00:04:40.842 "blobfs_detect", 00:04:40.842 "blobfs_set_cache_size", 00:04:40.842 "bdev_aio_delete", 00:04:40.842 "bdev_aio_rescan", 00:04:40.842 "bdev_aio_create", 00:04:40.842 "bdev_ftl_set_property", 00:04:40.842 "bdev_ftl_get_properties", 00:04:40.842 "bdev_ftl_get_stats", 00:04:40.842 "bdev_ftl_unmap", 00:04:40.842 "bdev_ftl_unload", 00:04:40.842 "bdev_ftl_delete", 00:04:40.842 "bdev_ftl_load", 00:04:40.842 "bdev_ftl_create", 00:04:40.842 "bdev_virtio_attach_controller", 00:04:40.842 "bdev_virtio_scsi_get_devices", 00:04:40.842 "bdev_virtio_detach_controller", 00:04:40.842 "bdev_virtio_blk_set_hotplug", 00:04:40.842 "bdev_iscsi_delete", 00:04:40.842 "bdev_iscsi_create", 00:04:40.842 "bdev_iscsi_set_options", 00:04:40.842 "accel_error_inject_error", 00:04:40.842 "ioat_scan_accel_module", 00:04:40.842 "dsa_scan_accel_module", 00:04:40.842 "iaa_scan_accel_module", 00:04:40.842 "iscsi_set_options", 00:04:40.842 "iscsi_get_auth_groups", 00:04:40.842 "iscsi_auth_group_remove_secret", 00:04:40.842 "iscsi_auth_group_add_secret", 00:04:40.842 "iscsi_delete_auth_group", 00:04:40.842 "iscsi_create_auth_group", 00:04:40.842 "iscsi_set_discovery_auth", 00:04:40.842 "iscsi_get_options", 00:04:40.842 "iscsi_target_node_request_logout", 00:04:40.842 "iscsi_target_node_set_redirect", 00:04:40.842 "iscsi_target_node_set_auth", 00:04:40.842 "iscsi_target_node_add_lun", 00:04:40.842 "iscsi_get_connections", 00:04:40.842 "iscsi_portal_group_set_auth", 00:04:40.842 "iscsi_start_portal_group", 00:04:40.842 "iscsi_delete_portal_group", 00:04:40.842 "iscsi_create_portal_group", 00:04:40.842 "iscsi_get_portal_groups", 00:04:40.842 "iscsi_delete_target_node", 00:04:40.842 "iscsi_target_node_remove_pg_ig_maps", 00:04:40.842 "iscsi_target_node_add_pg_ig_maps", 00:04:40.842 "iscsi_create_target_node", 00:04:40.842 "iscsi_get_target_nodes", 00:04:40.842 "iscsi_delete_initiator_group", 00:04:40.842 "iscsi_initiator_group_remove_initiators", 00:04:40.843 "iscsi_initiator_group_add_initiators", 00:04:40.843 "iscsi_create_initiator_group", 00:04:40.843 "iscsi_get_initiator_groups", 00:04:40.843 "nvmf_set_crdt", 00:04:40.843 "nvmf_set_config", 00:04:40.843 "nvmf_set_max_subsystems", 00:04:40.843 "nvmf_subsystem_get_listeners", 00:04:40.843 "nvmf_subsystem_get_qpairs", 00:04:40.843 "nvmf_subsystem_get_controllers", 00:04:40.843 "nvmf_get_stats", 00:04:40.843 "nvmf_get_transports", 00:04:40.843 "nvmf_create_transport", 00:04:40.843 "nvmf_get_targets", 00:04:40.843 "nvmf_delete_target", 00:04:40.843 "nvmf_create_target", 00:04:40.843 "nvmf_subsystem_allow_any_host", 00:04:40.843 "nvmf_subsystem_remove_host", 00:04:40.843 "nvmf_subsystem_add_host", 00:04:40.843 "nvmf_subsystem_remove_ns", 00:04:40.843 "nvmf_subsystem_add_ns", 00:04:40.843 "nvmf_subsystem_listener_set_ana_state", 00:04:40.843 "nvmf_discovery_get_referrals", 00:04:40.843 "nvmf_discovery_remove_referral", 00:04:40.843 "nvmf_discovery_add_referral", 00:04:40.843 "nvmf_subsystem_remove_listener", 00:04:40.843 "nvmf_subsystem_add_listener", 00:04:40.843 "nvmf_delete_subsystem", 00:04:40.843 "nvmf_create_subsystem", 00:04:40.843 "nvmf_get_subsystems", 00:04:40.843 "env_dpdk_get_mem_stats", 00:04:40.843 "nbd_get_disks", 00:04:40.843 "nbd_stop_disk", 00:04:40.843 "nbd_start_disk", 00:04:40.843 "ublk_recover_disk", 00:04:40.843 "ublk_get_disks", 00:04:40.843 "ublk_stop_disk", 00:04:40.843 "ublk_start_disk", 00:04:40.843 "ublk_destroy_target", 00:04:40.843 "ublk_create_target", 00:04:40.843 "virtio_blk_create_transport", 00:04:40.843 "virtio_blk_get_transports", 00:04:40.843 "vhost_controller_set_coalescing", 00:04:40.843 "vhost_get_controllers", 00:04:40.843 "vhost_delete_controller", 00:04:40.843 "vhost_create_blk_controller", 00:04:40.843 "vhost_scsi_controller_remove_target", 00:04:40.843 "vhost_scsi_controller_add_target", 00:04:40.843 "vhost_start_scsi_controller", 00:04:40.843 "vhost_create_scsi_controller", 00:04:40.843 "thread_set_cpumask", 00:04:40.843 "framework_get_scheduler", 00:04:40.843 "framework_set_scheduler", 00:04:40.843 "framework_get_reactors", 00:04:40.843 "thread_get_io_channels", 00:04:40.843 "thread_get_pollers", 00:04:40.843 "thread_get_stats", 00:04:40.843 "framework_monitor_context_switch", 00:04:40.843 "spdk_kill_instance", 00:04:40.843 "log_enable_timestamps", 00:04:40.843 "log_get_flags", 00:04:40.843 "log_clear_flag", 00:04:40.843 "log_set_flag", 00:04:40.843 "log_get_level", 00:04:40.843 "log_set_level", 00:04:40.843 "log_get_print_level", 00:04:40.843 "log_set_print_level", 00:04:40.843 "framework_enable_cpumask_locks", 00:04:40.843 "framework_disable_cpumask_locks", 00:04:40.843 "framework_wait_init", 00:04:40.843 "framework_start_init", 00:04:40.843 "scsi_get_devices", 00:04:40.843 "bdev_get_histogram", 00:04:40.843 "bdev_enable_histogram", 00:04:40.843 "bdev_set_qos_limit", 00:04:40.844 "bdev_set_qd_sampling_period", 00:04:40.844 "bdev_get_bdevs", 00:04:40.844 "bdev_reset_iostat", 00:04:40.844 "bdev_get_iostat", 00:04:40.844 "bdev_examine", 00:04:40.844 "bdev_wait_for_examine", 00:04:40.844 "bdev_set_options", 00:04:40.844 "notify_get_notifications", 00:04:40.844 "notify_get_types", 00:04:40.844 "accel_get_stats", 00:04:40.844 "accel_set_options", 00:04:40.844 "accel_set_driver", 00:04:40.844 "accel_crypto_key_destroy", 00:04:40.844 "accel_crypto_keys_get", 00:04:40.844 "accel_crypto_key_create", 00:04:40.844 "accel_assign_opc", 00:04:40.844 "accel_get_module_info", 00:04:40.844 "accel_get_opc_assignments", 00:04:40.844 "vmd_rescan", 00:04:40.844 "vmd_remove_device", 00:04:40.844 "vmd_enable", 00:04:40.844 "sock_set_default_impl", 00:04:40.844 "sock_impl_set_options", 00:04:40.844 "sock_impl_get_options", 00:04:40.844 "iobuf_get_stats", 00:04:40.844 "iobuf_set_options", 00:04:40.844 "framework_get_pci_devices", 00:04:40.844 "framework_get_config", 00:04:40.844 "framework_get_subsystems", 00:04:40.844 "trace_get_info", 00:04:40.844 "trace_get_tpoint_group_mask", 00:04:40.844 "trace_disable_tpoint_group", 00:04:40.844 "trace_enable_tpoint_group", 00:04:40.844 "trace_clear_tpoint_mask", 00:04:40.844 "trace_set_tpoint_mask", 00:04:40.844 "spdk_get_version", 00:04:40.844 "rpc_get_methods" 00:04:40.844 ] 00:04:40.844 01:40:29 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:40.844 01:40:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:40.844 01:40:29 -- common/autotest_common.sh@10 -- # set +x 00:04:40.844 01:40:29 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:40.844 01:40:29 -- spdkcli/tcp.sh@38 -- # killprocess 3321771 00:04:40.844 01:40:29 -- common/autotest_common.sh@936 -- # '[' -z 3321771 ']' 00:04:40.845 01:40:29 -- common/autotest_common.sh@940 -- # kill -0 3321771 00:04:40.845 01:40:29 -- common/autotest_common.sh@941 -- # uname 00:04:40.845 01:40:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:40.845 01:40:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3321771 00:04:40.845 01:40:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.845 01:40:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.845 01:40:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3321771' 00:04:40.845 killing process with pid 3321771 00:04:40.845 01:40:29 -- common/autotest_common.sh@955 -- # kill 3321771 00:04:40.845 01:40:29 -- common/autotest_common.sh@960 -- # wait 3321771 00:04:41.419 00:04:41.419 real 0m1.937s 00:04:41.419 user 0m3.652s 00:04:41.419 sys 0m0.521s 00:04:41.419 01:40:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.419 01:40:29 -- common/autotest_common.sh@10 -- # set +x 00:04:41.419 ************************************ 00:04:41.419 END TEST spdkcli_tcp 00:04:41.419 ************************************ 00:04:41.419 01:40:29 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:41.419 01:40:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.419 01:40:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.419 01:40:29 -- common/autotest_common.sh@10 -- # set +x 00:04:41.419 ************************************ 00:04:41.419 START TEST dpdk_mem_utility 00:04:41.419 ************************************ 00:04:41.419 01:40:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:41.419 * Looking for test storage... 00:04:41.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:41.419 01:40:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:41.419 01:40:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:41.419 01:40:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:41.419 01:40:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:41.419 01:40:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:41.419 01:40:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:41.419 01:40:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:41.419 01:40:29 -- scripts/common.sh@335 -- # IFS=.-: 00:04:41.419 01:40:29 -- scripts/common.sh@335 -- # read -ra ver1 00:04:41.419 01:40:29 -- scripts/common.sh@336 -- # IFS=.-: 00:04:41.419 01:40:29 -- scripts/common.sh@336 -- # read -ra ver2 00:04:41.419 01:40:29 -- scripts/common.sh@337 -- # local 'op=<' 00:04:41.419 01:40:29 -- scripts/common.sh@339 -- # ver1_l=2 00:04:41.419 01:40:29 -- scripts/common.sh@340 -- # ver2_l=1 00:04:41.419 01:40:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:41.419 01:40:29 -- scripts/common.sh@343 -- # case "$op" in 00:04:41.419 01:40:29 -- scripts/common.sh@344 -- # : 1 00:04:41.419 01:40:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:41.419 01:40:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:41.419 01:40:29 -- scripts/common.sh@364 -- # decimal 1 00:04:41.419 01:40:29 -- scripts/common.sh@352 -- # local d=1 00:04:41.419 01:40:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:41.419 01:40:29 -- scripts/common.sh@354 -- # echo 1 00:04:41.419 01:40:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:41.419 01:40:29 -- scripts/common.sh@365 -- # decimal 2 00:04:41.419 01:40:29 -- scripts/common.sh@352 -- # local d=2 00:04:41.419 01:40:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:41.419 01:40:29 -- scripts/common.sh@354 -- # echo 2 00:04:41.419 01:40:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:41.419 01:40:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:41.419 01:40:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:41.419 01:40:29 -- scripts/common.sh@367 -- # return 0 00:04:41.419 01:40:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:41.419 01:40:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:41.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.419 --rc genhtml_branch_coverage=1 00:04:41.419 --rc genhtml_function_coverage=1 00:04:41.419 --rc genhtml_legend=1 00:04:41.419 --rc geninfo_all_blocks=1 00:04:41.419 --rc geninfo_unexecuted_blocks=1 00:04:41.419 00:04:41.419 ' 00:04:41.419 01:40:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:41.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.419 --rc genhtml_branch_coverage=1 00:04:41.419 --rc genhtml_function_coverage=1 00:04:41.419 --rc genhtml_legend=1 00:04:41.419 --rc geninfo_all_blocks=1 00:04:41.419 --rc geninfo_unexecuted_blocks=1 00:04:41.419 00:04:41.419 ' 00:04:41.419 01:40:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:41.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.419 --rc genhtml_branch_coverage=1 00:04:41.419 --rc genhtml_function_coverage=1 00:04:41.419 --rc genhtml_legend=1 00:04:41.419 --rc geninfo_all_blocks=1 00:04:41.419 --rc geninfo_unexecuted_blocks=1 00:04:41.419 00:04:41.419 ' 00:04:41.419 01:40:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:41.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:41.420 --rc genhtml_branch_coverage=1 00:04:41.420 --rc genhtml_function_coverage=1 00:04:41.420 --rc genhtml_legend=1 00:04:41.420 --rc geninfo_all_blocks=1 00:04:41.420 --rc geninfo_unexecuted_blocks=1 00:04:41.420 00:04:41.420 ' 00:04:41.420 01:40:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:41.420 01:40:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3322108 00:04:41.420 01:40:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:41.420 01:40:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3322108 00:04:41.420 01:40:29 -- common/autotest_common.sh@829 -- # '[' -z 3322108 ']' 00:04:41.420 01:40:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:41.420 01:40:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:41.420 01:40:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:41.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:41.420 01:40:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:41.420 01:40:29 -- common/autotest_common.sh@10 -- # set +x 00:04:41.420 [2024-11-19 01:40:29.942536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:41.420 [2024-11-19 01:40:29.942628] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3322108 ] 00:04:41.678 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.678 [2024-11-19 01:40:30.004400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:41.678 [2024-11-19 01:40:30.126865] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:41.678 [2024-11-19 01:40:30.127054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.619 01:40:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:42.619 01:40:30 -- common/autotest_common.sh@862 -- # return 0 00:04:42.619 01:40:30 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:42.619 01:40:30 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:42.619 01:40:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.619 01:40:30 -- common/autotest_common.sh@10 -- # set +x 00:04:42.619 { 00:04:42.619 "filename": "/tmp/spdk_mem_dump.txt" 00:04:42.619 } 00:04:42.619 01:40:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.619 01:40:30 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:42.619 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:42.619 1 heaps totaling size 814.000000 MiB 00:04:42.619 size: 814.000000 MiB heap id: 0 00:04:42.619 end heaps---------- 00:04:42.619 8 mempools totaling size 598.116089 MiB 00:04:42.619 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:42.619 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:42.619 size: 84.521057 MiB name: bdev_io_3322108 00:04:42.619 size: 51.011292 MiB name: evtpool_3322108 00:04:42.619 size: 50.003479 MiB name: msgpool_3322108 00:04:42.619 size: 21.763794 MiB name: PDU_Pool 00:04:42.619 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:42.619 size: 0.026123 MiB name: Session_Pool 00:04:42.619 end mempools------- 00:04:42.619 6 memzones totaling size 4.142822 MiB 00:04:42.619 size: 1.000366 MiB name: RG_ring_0_3322108 00:04:42.619 size: 1.000366 MiB name: RG_ring_1_3322108 00:04:42.619 size: 1.000366 MiB name: RG_ring_4_3322108 00:04:42.619 size: 1.000366 MiB name: RG_ring_5_3322108 00:04:42.619 size: 0.125366 MiB name: RG_ring_2_3322108 00:04:42.619 size: 0.015991 MiB name: RG_ring_3_3322108 00:04:42.619 end memzones------- 00:04:42.619 01:40:31 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:42.619 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:42.619 list of free elements. size: 12.519348 MiB 00:04:42.619 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:42.619 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:42.619 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:42.619 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:42.619 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:42.619 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:42.619 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:42.619 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:42.619 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:42.619 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:42.619 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:42.619 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:42.619 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:42.619 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:42.619 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:42.619 list of standard malloc elements. size: 199.218079 MiB 00:04:42.619 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:42.619 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:42.619 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:42.619 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:42.619 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:42.619 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:42.619 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:42.619 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:42.619 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:42.619 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:42.619 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:42.619 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:42.619 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:42.619 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:42.619 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:42.619 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:42.619 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:42.619 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:42.619 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:42.619 list of memzone associated elements. size: 602.262573 MiB 00:04:42.619 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:42.619 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:42.619 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:42.619 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:42.619 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:42.619 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3322108_0 00:04:42.619 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:42.619 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3322108_0 00:04:42.619 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:42.619 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3322108_0 00:04:42.619 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:42.619 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:42.619 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:42.619 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:42.619 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:42.619 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3322108 00:04:42.619 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:42.619 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3322108 00:04:42.619 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:42.619 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3322108 00:04:42.619 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:42.619 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:42.619 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:42.619 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:42.619 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:42.619 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:42.619 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:42.619 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:42.619 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:42.619 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3322108 00:04:42.619 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:42.619 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3322108 00:04:42.619 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:42.619 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3322108 00:04:42.619 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:42.619 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3322108 00:04:42.619 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:42.619 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3322108 00:04:42.619 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:42.619 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:42.619 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:42.619 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:42.619 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:42.619 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:42.619 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:42.619 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3322108 00:04:42.619 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:42.619 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:42.619 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:42.619 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:42.619 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:42.619 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3322108 00:04:42.619 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:42.619 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:42.619 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:42.619 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3322108 00:04:42.619 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:42.619 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3322108 00:04:42.619 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:42.619 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:42.619 01:40:31 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:42.619 01:40:31 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3322108 00:04:42.619 01:40:31 -- common/autotest_common.sh@936 -- # '[' -z 3322108 ']' 00:04:42.619 01:40:31 -- common/autotest_common.sh@940 -- # kill -0 3322108 00:04:42.619 01:40:31 -- common/autotest_common.sh@941 -- # uname 00:04:42.619 01:40:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:42.619 01:40:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3322108 00:04:42.619 01:40:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:42.619 01:40:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:42.619 01:40:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3322108' 00:04:42.619 killing process with pid 3322108 00:04:42.619 01:40:31 -- common/autotest_common.sh@955 -- # kill 3322108 00:04:42.619 01:40:31 -- common/autotest_common.sh@960 -- # wait 3322108 00:04:43.263 00:04:43.263 real 0m1.814s 00:04:43.263 user 0m1.994s 00:04:43.263 sys 0m0.488s 00:04:43.263 01:40:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.263 01:40:31 -- common/autotest_common.sh@10 -- # set +x 00:04:43.263 ************************************ 00:04:43.263 END TEST dpdk_mem_utility 00:04:43.263 ************************************ 00:04:43.263 01:40:31 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:43.263 01:40:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.263 01:40:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.263 01:40:31 -- common/autotest_common.sh@10 -- # set +x 00:04:43.263 ************************************ 00:04:43.263 START TEST event 00:04:43.263 ************************************ 00:04:43.263 01:40:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:43.263 * Looking for test storage... 00:04:43.263 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:43.263 01:40:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:43.263 01:40:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:43.263 01:40:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:43.263 01:40:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:43.263 01:40:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:43.263 01:40:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:43.263 01:40:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:43.263 01:40:31 -- scripts/common.sh@335 -- # IFS=.-: 00:04:43.263 01:40:31 -- scripts/common.sh@335 -- # read -ra ver1 00:04:43.263 01:40:31 -- scripts/common.sh@336 -- # IFS=.-: 00:04:43.263 01:40:31 -- scripts/common.sh@336 -- # read -ra ver2 00:04:43.263 01:40:31 -- scripts/common.sh@337 -- # local 'op=<' 00:04:43.263 01:40:31 -- scripts/common.sh@339 -- # ver1_l=2 00:04:43.263 01:40:31 -- scripts/common.sh@340 -- # ver2_l=1 00:04:43.263 01:40:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:43.263 01:40:31 -- scripts/common.sh@343 -- # case "$op" in 00:04:43.263 01:40:31 -- scripts/common.sh@344 -- # : 1 00:04:43.263 01:40:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:43.263 01:40:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:43.263 01:40:31 -- scripts/common.sh@364 -- # decimal 1 00:04:43.263 01:40:31 -- scripts/common.sh@352 -- # local d=1 00:04:43.263 01:40:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:43.263 01:40:31 -- scripts/common.sh@354 -- # echo 1 00:04:43.263 01:40:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:43.263 01:40:31 -- scripts/common.sh@365 -- # decimal 2 00:04:43.263 01:40:31 -- scripts/common.sh@352 -- # local d=2 00:04:43.263 01:40:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:43.263 01:40:31 -- scripts/common.sh@354 -- # echo 2 00:04:43.263 01:40:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:43.263 01:40:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:43.263 01:40:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:43.263 01:40:31 -- scripts/common.sh@367 -- # return 0 00:04:43.263 01:40:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:43.263 01:40:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:43.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.263 --rc genhtml_branch_coverage=1 00:04:43.263 --rc genhtml_function_coverage=1 00:04:43.263 --rc genhtml_legend=1 00:04:43.263 --rc geninfo_all_blocks=1 00:04:43.263 --rc geninfo_unexecuted_blocks=1 00:04:43.263 00:04:43.263 ' 00:04:43.263 01:40:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:43.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.263 --rc genhtml_branch_coverage=1 00:04:43.263 --rc genhtml_function_coverage=1 00:04:43.263 --rc genhtml_legend=1 00:04:43.263 --rc geninfo_all_blocks=1 00:04:43.263 --rc geninfo_unexecuted_blocks=1 00:04:43.263 00:04:43.263 ' 00:04:43.263 01:40:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:43.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.263 --rc genhtml_branch_coverage=1 00:04:43.263 --rc genhtml_function_coverage=1 00:04:43.263 --rc genhtml_legend=1 00:04:43.263 --rc geninfo_all_blocks=1 00:04:43.263 --rc geninfo_unexecuted_blocks=1 00:04:43.264 00:04:43.264 ' 00:04:43.264 01:40:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:43.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.264 --rc genhtml_branch_coverage=1 00:04:43.264 --rc genhtml_function_coverage=1 00:04:43.264 --rc genhtml_legend=1 00:04:43.264 --rc geninfo_all_blocks=1 00:04:43.264 --rc geninfo_unexecuted_blocks=1 00:04:43.264 00:04:43.264 ' 00:04:43.264 01:40:31 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:43.264 01:40:31 -- bdev/nbd_common.sh@6 -- # set -e 00:04:43.264 01:40:31 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:43.264 01:40:31 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:43.264 01:40:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.264 01:40:31 -- common/autotest_common.sh@10 -- # set +x 00:04:43.264 ************************************ 00:04:43.264 START TEST event_perf 00:04:43.264 ************************************ 00:04:43.264 01:40:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:43.264 Running I/O for 1 seconds...[2024-11-19 01:40:31.764023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.264 [2024-11-19 01:40:31.764100] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3322440 ] 00:04:43.264 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.521 [2024-11-19 01:40:31.826194] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:43.521 [2024-11-19 01:40:31.944422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:43.521 [2024-11-19 01:40:31.944491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:43.521 [2024-11-19 01:40:31.944584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:43.521 [2024-11-19 01:40:31.944587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.906 Running I/O for 1 seconds... 00:04:44.906 lcore 0: 233423 00:04:44.906 lcore 1: 233422 00:04:44.906 lcore 2: 233423 00:04:44.906 lcore 3: 233423 00:04:44.906 done. 00:04:44.906 00:04:44.906 real 0m1.319s 00:04:44.906 user 0m4.224s 00:04:44.906 sys 0m0.090s 00:04:44.906 01:40:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.906 01:40:33 -- common/autotest_common.sh@10 -- # set +x 00:04:44.906 ************************************ 00:04:44.906 END TEST event_perf 00:04:44.906 ************************************ 00:04:44.906 01:40:33 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:44.906 01:40:33 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:44.906 01:40:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.906 01:40:33 -- common/autotest_common.sh@10 -- # set +x 00:04:44.906 ************************************ 00:04:44.906 START TEST event_reactor 00:04:44.906 ************************************ 00:04:44.906 01:40:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:44.906 [2024-11-19 01:40:33.109796] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:44.906 [2024-11-19 01:40:33.109868] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3322597 ] 00:04:44.906 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.906 [2024-11-19 01:40:33.171939] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:44.906 [2024-11-19 01:40:33.286287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.283 test_start 00:04:46.283 oneshot 00:04:46.283 tick 100 00:04:46.283 tick 100 00:04:46.283 tick 250 00:04:46.283 tick 100 00:04:46.283 tick 100 00:04:46.283 tick 250 00:04:46.283 tick 500 00:04:46.283 tick 100 00:04:46.283 tick 100 00:04:46.283 tick 100 00:04:46.283 tick 250 00:04:46.283 tick 100 00:04:46.283 tick 100 00:04:46.283 test_end 00:04:46.283 00:04:46.283 real 0m1.310s 00:04:46.283 user 0m1.224s 00:04:46.283 sys 0m0.080s 00:04:46.283 01:40:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.283 01:40:34 -- common/autotest_common.sh@10 -- # set +x 00:04:46.283 ************************************ 00:04:46.283 END TEST event_reactor 00:04:46.283 ************************************ 00:04:46.283 01:40:34 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:46.283 01:40:34 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:46.283 01:40:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.283 01:40:34 -- common/autotest_common.sh@10 -- # set +x 00:04:46.283 ************************************ 00:04:46.283 START TEST event_reactor_perf 00:04:46.283 ************************************ 00:04:46.283 01:40:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:46.283 [2024-11-19 01:40:34.442728] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.283 [2024-11-19 01:40:34.442799] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3322768 ] 00:04:46.283 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.283 [2024-11-19 01:40:34.506295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.283 [2024-11-19 01:40:34.622956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.220 test_start 00:04:47.220 test_end 00:04:47.220 Performance: 355128 events per second 00:04:47.220 00:04:47.220 real 0m1.316s 00:04:47.220 user 0m1.230s 00:04:47.220 sys 0m0.080s 00:04:47.220 01:40:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.220 01:40:35 -- common/autotest_common.sh@10 -- # set +x 00:04:47.220 ************************************ 00:04:47.220 END TEST event_reactor_perf 00:04:47.220 ************************************ 00:04:47.478 01:40:35 -- event/event.sh@49 -- # uname -s 00:04:47.478 01:40:35 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:47.478 01:40:35 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:47.478 01:40:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.478 01:40:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.479 01:40:35 -- common/autotest_common.sh@10 -- # set +x 00:04:47.479 ************************************ 00:04:47.479 START TEST event_scheduler 00:04:47.479 ************************************ 00:04:47.479 01:40:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:47.479 * Looking for test storage... 00:04:47.479 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:47.479 01:40:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:47.479 01:40:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:47.479 01:40:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:47.479 01:40:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:47.479 01:40:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:47.479 01:40:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:47.479 01:40:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:47.479 01:40:35 -- scripts/common.sh@335 -- # IFS=.-: 00:04:47.479 01:40:35 -- scripts/common.sh@335 -- # read -ra ver1 00:04:47.479 01:40:35 -- scripts/common.sh@336 -- # IFS=.-: 00:04:47.479 01:40:35 -- scripts/common.sh@336 -- # read -ra ver2 00:04:47.479 01:40:35 -- scripts/common.sh@337 -- # local 'op=<' 00:04:47.479 01:40:35 -- scripts/common.sh@339 -- # ver1_l=2 00:04:47.479 01:40:35 -- scripts/common.sh@340 -- # ver2_l=1 00:04:47.479 01:40:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:47.479 01:40:35 -- scripts/common.sh@343 -- # case "$op" in 00:04:47.479 01:40:35 -- scripts/common.sh@344 -- # : 1 00:04:47.479 01:40:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:47.479 01:40:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:47.479 01:40:35 -- scripts/common.sh@364 -- # decimal 1 00:04:47.479 01:40:35 -- scripts/common.sh@352 -- # local d=1 00:04:47.479 01:40:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:47.479 01:40:35 -- scripts/common.sh@354 -- # echo 1 00:04:47.479 01:40:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:47.479 01:40:35 -- scripts/common.sh@365 -- # decimal 2 00:04:47.479 01:40:35 -- scripts/common.sh@352 -- # local d=2 00:04:47.479 01:40:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:47.479 01:40:35 -- scripts/common.sh@354 -- # echo 2 00:04:47.479 01:40:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:47.479 01:40:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:47.479 01:40:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:47.479 01:40:35 -- scripts/common.sh@367 -- # return 0 00:04:47.479 01:40:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:47.479 01:40:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:47.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.479 --rc genhtml_branch_coverage=1 00:04:47.479 --rc genhtml_function_coverage=1 00:04:47.479 --rc genhtml_legend=1 00:04:47.479 --rc geninfo_all_blocks=1 00:04:47.479 --rc geninfo_unexecuted_blocks=1 00:04:47.479 00:04:47.479 ' 00:04:47.479 01:40:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:47.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.479 --rc genhtml_branch_coverage=1 00:04:47.479 --rc genhtml_function_coverage=1 00:04:47.479 --rc genhtml_legend=1 00:04:47.479 --rc geninfo_all_blocks=1 00:04:47.479 --rc geninfo_unexecuted_blocks=1 00:04:47.479 00:04:47.479 ' 00:04:47.479 01:40:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:47.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.479 --rc genhtml_branch_coverage=1 00:04:47.479 --rc genhtml_function_coverage=1 00:04:47.479 --rc genhtml_legend=1 00:04:47.479 --rc geninfo_all_blocks=1 00:04:47.479 --rc geninfo_unexecuted_blocks=1 00:04:47.479 00:04:47.479 ' 00:04:47.479 01:40:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:47.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.479 --rc genhtml_branch_coverage=1 00:04:47.479 --rc genhtml_function_coverage=1 00:04:47.479 --rc genhtml_legend=1 00:04:47.479 --rc geninfo_all_blocks=1 00:04:47.479 --rc geninfo_unexecuted_blocks=1 00:04:47.479 00:04:47.479 ' 00:04:47.479 01:40:35 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:47.479 01:40:35 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3323031 00:04:47.479 01:40:35 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:47.479 01:40:35 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:47.479 01:40:35 -- scheduler/scheduler.sh@37 -- # waitforlisten 3323031 00:04:47.479 01:40:35 -- common/autotest_common.sh@829 -- # '[' -z 3323031 ']' 00:04:47.479 01:40:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:47.479 01:40:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:47.479 01:40:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:47.479 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:47.479 01:40:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:47.479 01:40:35 -- common/autotest_common.sh@10 -- # set +x 00:04:47.479 [2024-11-19 01:40:35.943035] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:47.479 [2024-11-19 01:40:35.943122] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3323031 ] 00:04:47.479 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.479 [2024-11-19 01:40:36.000756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:47.738 [2024-11-19 01:40:36.105520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.738 [2024-11-19 01:40:36.105585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:47.738 [2024-11-19 01:40:36.105715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:47.738 [2024-11-19 01:40:36.105719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:47.738 01:40:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.738 01:40:36 -- common/autotest_common.sh@862 -- # return 0 00:04:47.738 01:40:36 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:47.738 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.738 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.738 POWER: Env isn't set yet! 00:04:47.738 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:47.738 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:47.738 POWER: Cannot get available frequencies of lcore 0 00:04:47.738 POWER: Attempting to initialise PSTAT power management... 00:04:47.738 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:47.738 POWER: Initialized successfully for lcore 0 power management 00:04:47.738 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:47.738 POWER: Initialized successfully for lcore 1 power management 00:04:47.738 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:47.738 POWER: Initialized successfully for lcore 2 power management 00:04:47.738 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:47.739 POWER: Initialized successfully for lcore 3 power management 00:04:47.739 [2024-11-19 01:40:36.194864] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:47.739 [2024-11-19 01:40:36.194882] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:47.739 [2024-11-19 01:40:36.194893] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:47.739 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.739 01:40:36 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:47.739 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.739 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.997 [2024-11-19 01:40:36.299932] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:47.997 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.997 01:40:36 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:47.997 01:40:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.997 01:40:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.997 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.997 ************************************ 00:04:47.997 START TEST scheduler_create_thread 00:04:47.997 ************************************ 00:04:47.997 01:40:36 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 2 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 3 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 4 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 5 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 6 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 7 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 8 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 9 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 10 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:47.998 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:47.998 01:40:36 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:47.998 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.998 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:48.566 01:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.566 01:40:36 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:48.566 01:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.566 01:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.945 01:40:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:49.945 01:40:38 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:49.945 01:40:38 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:49.945 01:40:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:49.945 01:40:38 -- common/autotest_common.sh@10 -- # set +x 00:04:50.885 01:40:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:50.885 00:04:50.885 real 0m3.098s 00:04:50.885 user 0m0.010s 00:04:50.885 sys 0m0.004s 00:04:50.885 01:40:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.885 01:40:39 -- common/autotest_common.sh@10 -- # set +x 00:04:50.885 ************************************ 00:04:50.885 END TEST scheduler_create_thread 00:04:50.885 ************************************ 00:04:50.885 01:40:39 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:50.885 01:40:39 -- scheduler/scheduler.sh@46 -- # killprocess 3323031 00:04:50.885 01:40:39 -- common/autotest_common.sh@936 -- # '[' -z 3323031 ']' 00:04:50.885 01:40:39 -- common/autotest_common.sh@940 -- # kill -0 3323031 00:04:50.885 01:40:39 -- common/autotest_common.sh@941 -- # uname 00:04:50.885 01:40:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:51.144 01:40:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3323031 00:04:51.144 01:40:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:51.144 01:40:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:51.144 01:40:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3323031' 00:04:51.144 killing process with pid 3323031 00:04:51.144 01:40:39 -- common/autotest_common.sh@955 -- # kill 3323031 00:04:51.144 01:40:39 -- common/autotest_common.sh@960 -- # wait 3323031 00:04:51.403 [2024-11-19 01:40:39.784409] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:51.403 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:51.403 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:51.403 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:51.403 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:51.403 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:51.403 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:51.403 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:51.403 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:51.661 00:04:51.661 real 0m4.296s 00:04:51.661 user 0m6.910s 00:04:51.661 sys 0m0.334s 00:04:51.661 01:40:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.661 01:40:40 -- common/autotest_common.sh@10 -- # set +x 00:04:51.661 ************************************ 00:04:51.661 END TEST event_scheduler 00:04:51.661 ************************************ 00:04:51.661 01:40:40 -- event/event.sh@51 -- # modprobe -n nbd 00:04:51.661 01:40:40 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:51.661 01:40:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.661 01:40:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.661 01:40:40 -- common/autotest_common.sh@10 -- # set +x 00:04:51.661 ************************************ 00:04:51.661 START TEST app_repeat 00:04:51.661 ************************************ 00:04:51.661 01:40:40 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:51.661 01:40:40 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.661 01:40:40 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.661 01:40:40 -- event/event.sh@13 -- # local nbd_list 00:04:51.661 01:40:40 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.661 01:40:40 -- event/event.sh@14 -- # local bdev_list 00:04:51.661 01:40:40 -- event/event.sh@15 -- # local repeat_times=4 00:04:51.661 01:40:40 -- event/event.sh@17 -- # modprobe nbd 00:04:51.661 01:40:40 -- event/event.sh@19 -- # repeat_pid=3323548 00:04:51.661 01:40:40 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:51.661 01:40:40 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:51.661 01:40:40 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3323548' 00:04:51.661 Process app_repeat pid: 3323548 00:04:51.661 01:40:40 -- event/event.sh@23 -- # for i in {0..2} 00:04:51.661 01:40:40 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:51.661 spdk_app_start Round 0 00:04:51.661 01:40:40 -- event/event.sh@25 -- # waitforlisten 3323548 /var/tmp/spdk-nbd.sock 00:04:51.661 01:40:40 -- common/autotest_common.sh@829 -- # '[' -z 3323548 ']' 00:04:51.661 01:40:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:51.661 01:40:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.661 01:40:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:51.661 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:51.661 01:40:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.662 01:40:40 -- common/autotest_common.sh@10 -- # set +x 00:04:51.662 [2024-11-19 01:40:40.127849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.662 [2024-11-19 01:40:40.127932] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3323548 ] 00:04:51.662 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.662 [2024-11-19 01:40:40.191451] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:51.920 [2024-11-19 01:40:40.306277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:51.920 [2024-11-19 01:40:40.306282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.856 01:40:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.856 01:40:41 -- common/autotest_common.sh@862 -- # return 0 00:04:52.856 01:40:41 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:52.856 Malloc0 00:04:52.856 01:40:41 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:53.116 Malloc1 00:04:53.116 01:40:41 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:53.116 01:40:41 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.116 01:40:41 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@12 -- # local i 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.375 01:40:41 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:53.375 /dev/nbd0 00:04:53.634 01:40:41 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:53.634 01:40:41 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:53.634 01:40:41 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:53.634 01:40:41 -- common/autotest_common.sh@867 -- # local i 00:04:53.634 01:40:41 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:53.634 01:40:41 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:53.634 01:40:41 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:53.634 01:40:41 -- common/autotest_common.sh@871 -- # break 00:04:53.634 01:40:41 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:53.634 01:40:41 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:53.634 01:40:41 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:53.634 1+0 records in 00:04:53.634 1+0 records out 00:04:53.634 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000183254 s, 22.4 MB/s 00:04:53.634 01:40:41 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.634 01:40:41 -- common/autotest_common.sh@884 -- # size=4096 00:04:53.634 01:40:41 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.634 01:40:41 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:53.634 01:40:41 -- common/autotest_common.sh@887 -- # return 0 00:04:53.634 01:40:41 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:53.634 01:40:41 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.634 01:40:41 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:53.893 /dev/nbd1 00:04:53.893 01:40:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:53.893 01:40:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:53.893 01:40:42 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:53.893 01:40:42 -- common/autotest_common.sh@867 -- # local i 00:04:53.893 01:40:42 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:53.893 01:40:42 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:53.893 01:40:42 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:53.893 01:40:42 -- common/autotest_common.sh@871 -- # break 00:04:53.893 01:40:42 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:53.893 01:40:42 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:53.893 01:40:42 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:53.893 1+0 records in 00:04:53.893 1+0 records out 00:04:53.893 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000195546 s, 20.9 MB/s 00:04:53.893 01:40:42 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.893 01:40:42 -- common/autotest_common.sh@884 -- # size=4096 00:04:53.893 01:40:42 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.893 01:40:42 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:53.893 01:40:42 -- common/autotest_common.sh@887 -- # return 0 00:04:53.893 01:40:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:53.893 01:40:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.893 01:40:42 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:53.893 01:40:42 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.893 01:40:42 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:54.152 { 00:04:54.152 "nbd_device": "/dev/nbd0", 00:04:54.152 "bdev_name": "Malloc0" 00:04:54.152 }, 00:04:54.152 { 00:04:54.152 "nbd_device": "/dev/nbd1", 00:04:54.152 "bdev_name": "Malloc1" 00:04:54.152 } 00:04:54.152 ]' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:54.152 { 00:04:54.152 "nbd_device": "/dev/nbd0", 00:04:54.152 "bdev_name": "Malloc0" 00:04:54.152 }, 00:04:54.152 { 00:04:54.152 "nbd_device": "/dev/nbd1", 00:04:54.152 "bdev_name": "Malloc1" 00:04:54.152 } 00:04:54.152 ]' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:54.152 /dev/nbd1' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:54.152 /dev/nbd1' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@65 -- # count=2 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@95 -- # count=2 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:54.152 256+0 records in 00:04:54.152 256+0 records out 00:04:54.152 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00518251 s, 202 MB/s 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:54.152 256+0 records in 00:04:54.152 256+0 records out 00:04:54.152 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220542 s, 47.5 MB/s 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:54.152 256+0 records in 00:04:54.152 256+0 records out 00:04:54.152 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240449 s, 43.6 MB/s 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@51 -- # local i 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:54.152 01:40:42 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@41 -- # break 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@45 -- # return 0 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:54.411 01:40:42 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@41 -- # break 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@45 -- # return 0 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.669 01:40:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:54.927 01:40:43 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:54.927 01:40:43 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:54.927 01:40:43 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@65 -- # true 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@65 -- # count=0 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@104 -- # count=0 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:55.185 01:40:43 -- bdev/nbd_common.sh@109 -- # return 0 00:04:55.185 01:40:43 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:55.444 01:40:43 -- event/event.sh@35 -- # sleep 3 00:04:55.704 [2024-11-19 01:40:44.038615] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:55.704 [2024-11-19 01:40:44.151866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.704 [2024-11-19 01:40:44.151867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:55.704 [2024-11-19 01:40:44.213875] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:55.704 [2024-11-19 01:40:44.213960] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:58.242 01:40:46 -- event/event.sh@23 -- # for i in {0..2} 00:04:58.242 01:40:46 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:58.242 spdk_app_start Round 1 00:04:58.242 01:40:46 -- event/event.sh@25 -- # waitforlisten 3323548 /var/tmp/spdk-nbd.sock 00:04:58.242 01:40:46 -- common/autotest_common.sh@829 -- # '[' -z 3323548 ']' 00:04:58.242 01:40:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:58.242 01:40:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:58.243 01:40:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:58.243 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:58.243 01:40:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:58.243 01:40:46 -- common/autotest_common.sh@10 -- # set +x 00:04:58.501 01:40:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.501 01:40:47 -- common/autotest_common.sh@862 -- # return 0 00:04:58.501 01:40:47 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:58.760 Malloc0 00:04:58.760 01:40:47 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:59.021 Malloc1 00:04:59.281 01:40:47 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@12 -- # local i 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.281 01:40:47 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:59.281 /dev/nbd0 00:04:59.541 01:40:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:59.541 01:40:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:59.541 01:40:47 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:59.541 01:40:47 -- common/autotest_common.sh@867 -- # local i 00:04:59.541 01:40:47 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:59.541 01:40:47 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:59.541 01:40:47 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:59.541 01:40:47 -- common/autotest_common.sh@871 -- # break 00:04:59.541 01:40:47 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:59.541 01:40:47 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:59.541 01:40:47 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:59.541 1+0 records in 00:04:59.541 1+0 records out 00:04:59.541 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000202841 s, 20.2 MB/s 00:04:59.541 01:40:47 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.541 01:40:47 -- common/autotest_common.sh@884 -- # size=4096 00:04:59.541 01:40:47 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.541 01:40:47 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:59.541 01:40:47 -- common/autotest_common.sh@887 -- # return 0 00:04:59.541 01:40:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:59.541 01:40:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.541 01:40:47 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:59.800 /dev/nbd1 00:04:59.800 01:40:48 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:59.800 01:40:48 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:59.800 01:40:48 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:59.800 01:40:48 -- common/autotest_common.sh@867 -- # local i 00:04:59.800 01:40:48 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:59.800 01:40:48 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:59.800 01:40:48 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:59.800 01:40:48 -- common/autotest_common.sh@871 -- # break 00:04:59.800 01:40:48 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:59.800 01:40:48 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:59.800 01:40:48 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:59.800 1+0 records in 00:04:59.800 1+0 records out 00:04:59.800 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000182403 s, 22.5 MB/s 00:04:59.800 01:40:48 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.800 01:40:48 -- common/autotest_common.sh@884 -- # size=4096 00:04:59.800 01:40:48 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.800 01:40:48 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:59.800 01:40:48 -- common/autotest_common.sh@887 -- # return 0 00:04:59.800 01:40:48 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:59.800 01:40:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.800 01:40:48 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:59.800 01:40:48 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.800 01:40:48 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:00.058 01:40:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:00.058 { 00:05:00.058 "nbd_device": "/dev/nbd0", 00:05:00.059 "bdev_name": "Malloc0" 00:05:00.059 }, 00:05:00.059 { 00:05:00.059 "nbd_device": "/dev/nbd1", 00:05:00.059 "bdev_name": "Malloc1" 00:05:00.059 } 00:05:00.059 ]' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:00.059 { 00:05:00.059 "nbd_device": "/dev/nbd0", 00:05:00.059 "bdev_name": "Malloc0" 00:05:00.059 }, 00:05:00.059 { 00:05:00.059 "nbd_device": "/dev/nbd1", 00:05:00.059 "bdev_name": "Malloc1" 00:05:00.059 } 00:05:00.059 ]' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:00.059 /dev/nbd1' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:00.059 /dev/nbd1' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@65 -- # count=2 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@95 -- # count=2 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:00.059 256+0 records in 00:05:00.059 256+0 records out 00:05:00.059 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00500649 s, 209 MB/s 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:00.059 256+0 records in 00:05:00.059 256+0 records out 00:05:00.059 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194745 s, 53.8 MB/s 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:00.059 256+0 records in 00:05:00.059 256+0 records out 00:05:00.059 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233418 s, 44.9 MB/s 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@51 -- # local i 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.059 01:40:48 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@41 -- # break 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@45 -- # return 0 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.317 01:40:48 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@41 -- # break 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@45 -- # return 0 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.575 01:40:49 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@65 -- # true 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@65 -- # count=0 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@104 -- # count=0 00:05:00.836 01:40:49 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:00.837 01:40:49 -- bdev/nbd_common.sh@109 -- # return 0 00:05:00.837 01:40:49 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:01.411 01:40:49 -- event/event.sh@35 -- # sleep 3 00:05:01.411 [2024-11-19 01:40:49.929049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:01.670 [2024-11-19 01:40:50.045437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:01.670 [2024-11-19 01:40:50.045441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.670 [2024-11-19 01:40:50.103553] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:01.670 [2024-11-19 01:40:50.103628] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:04.203 01:40:52 -- event/event.sh@23 -- # for i in {0..2} 00:05:04.203 01:40:52 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:04.203 spdk_app_start Round 2 00:05:04.203 01:40:52 -- event/event.sh@25 -- # waitforlisten 3323548 /var/tmp/spdk-nbd.sock 00:05:04.203 01:40:52 -- common/autotest_common.sh@829 -- # '[' -z 3323548 ']' 00:05:04.203 01:40:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:04.203 01:40:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.203 01:40:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:04.203 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:04.203 01:40:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.203 01:40:52 -- common/autotest_common.sh@10 -- # set +x 00:05:04.462 01:40:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:04.462 01:40:52 -- common/autotest_common.sh@862 -- # return 0 00:05:04.462 01:40:52 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:04.720 Malloc0 00:05:04.720 01:40:53 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:04.978 Malloc1 00:05:04.978 01:40:53 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@12 -- # local i 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:04.978 01:40:53 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:05.236 /dev/nbd0 00:05:05.236 01:40:53 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:05.236 01:40:53 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:05.236 01:40:53 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:05.236 01:40:53 -- common/autotest_common.sh@867 -- # local i 00:05:05.236 01:40:53 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:05.236 01:40:53 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:05.236 01:40:53 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:05.236 01:40:53 -- common/autotest_common.sh@871 -- # break 00:05:05.236 01:40:53 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:05.236 01:40:53 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:05.236 01:40:53 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:05.236 1+0 records in 00:05:05.236 1+0 records out 00:05:05.236 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000200098 s, 20.5 MB/s 00:05:05.236 01:40:53 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.236 01:40:53 -- common/autotest_common.sh@884 -- # size=4096 00:05:05.236 01:40:53 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.236 01:40:53 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:05.236 01:40:53 -- common/autotest_common.sh@887 -- # return 0 00:05:05.236 01:40:53 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:05.236 01:40:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:05.236 01:40:53 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:05.494 /dev/nbd1 00:05:05.494 01:40:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:05.494 01:40:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:05.494 01:40:54 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:05.494 01:40:54 -- common/autotest_common.sh@867 -- # local i 00:05:05.494 01:40:54 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:05.494 01:40:54 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:05.494 01:40:54 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:05.494 01:40:54 -- common/autotest_common.sh@871 -- # break 00:05:05.494 01:40:54 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:05.494 01:40:54 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:05.494 01:40:54 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:05.494 1+0 records in 00:05:05.494 1+0 records out 00:05:05.494 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000192669 s, 21.3 MB/s 00:05:05.494 01:40:54 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.494 01:40:54 -- common/autotest_common.sh@884 -- # size=4096 00:05:05.494 01:40:54 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.494 01:40:54 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:05.494 01:40:54 -- common/autotest_common.sh@887 -- # return 0 00:05:05.494 01:40:54 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:05.494 01:40:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:05.494 01:40:54 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:05.494 01:40:54 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.494 01:40:54 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:05.752 01:40:54 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:05.752 { 00:05:05.752 "nbd_device": "/dev/nbd0", 00:05:05.752 "bdev_name": "Malloc0" 00:05:05.752 }, 00:05:05.752 { 00:05:05.752 "nbd_device": "/dev/nbd1", 00:05:05.752 "bdev_name": "Malloc1" 00:05:05.752 } 00:05:05.752 ]' 00:05:05.752 01:40:54 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:05.752 { 00:05:05.752 "nbd_device": "/dev/nbd0", 00:05:05.752 "bdev_name": "Malloc0" 00:05:05.752 }, 00:05:05.752 { 00:05:05.752 "nbd_device": "/dev/nbd1", 00:05:05.752 "bdev_name": "Malloc1" 00:05:05.752 } 00:05:05.752 ]' 00:05:05.752 01:40:54 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:06.010 /dev/nbd1' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:06.010 /dev/nbd1' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@65 -- # count=2 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@95 -- # count=2 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:06.010 256+0 records in 00:05:06.010 256+0 records out 00:05:06.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00512315 s, 205 MB/s 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:06.010 256+0 records in 00:05:06.010 256+0 records out 00:05:06.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222228 s, 47.2 MB/s 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:06.010 256+0 records in 00:05:06.010 256+0 records out 00:05:06.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204367 s, 51.3 MB/s 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@51 -- # local i 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:06.010 01:40:54 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@41 -- # break 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@45 -- # return 0 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:06.269 01:40:54 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@41 -- # break 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@45 -- # return 0 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.527 01:40:54 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@65 -- # true 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@65 -- # count=0 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@104 -- # count=0 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:06.785 01:40:55 -- bdev/nbd_common.sh@109 -- # return 0 00:05:06.785 01:40:55 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:07.043 01:40:55 -- event/event.sh@35 -- # sleep 3 00:05:07.301 [2024-11-19 01:40:55.784096] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:07.558 [2024-11-19 01:40:55.897454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:07.558 [2024-11-19 01:40:55.897458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.558 [2024-11-19 01:40:55.959085] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:07.558 [2024-11-19 01:40:55.959161] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:10.092 01:40:58 -- event/event.sh@38 -- # waitforlisten 3323548 /var/tmp/spdk-nbd.sock 00:05:10.092 01:40:58 -- common/autotest_common.sh@829 -- # '[' -z 3323548 ']' 00:05:10.092 01:40:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:10.092 01:40:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.092 01:40:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:10.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:10.092 01:40:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.092 01:40:58 -- common/autotest_common.sh@10 -- # set +x 00:05:10.350 01:40:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.350 01:40:58 -- common/autotest_common.sh@862 -- # return 0 00:05:10.350 01:40:58 -- event/event.sh@39 -- # killprocess 3323548 00:05:10.350 01:40:58 -- common/autotest_common.sh@936 -- # '[' -z 3323548 ']' 00:05:10.350 01:40:58 -- common/autotest_common.sh@940 -- # kill -0 3323548 00:05:10.350 01:40:58 -- common/autotest_common.sh@941 -- # uname 00:05:10.350 01:40:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.350 01:40:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3323548 00:05:10.350 01:40:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.350 01:40:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.350 01:40:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3323548' 00:05:10.350 killing process with pid 3323548 00:05:10.350 01:40:58 -- common/autotest_common.sh@955 -- # kill 3323548 00:05:10.350 01:40:58 -- common/autotest_common.sh@960 -- # wait 3323548 00:05:10.608 spdk_app_start is called in Round 0. 00:05:10.608 Shutdown signal received, stop current app iteration 00:05:10.608 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.608 spdk_app_start is called in Round 1. 00:05:10.608 Shutdown signal received, stop current app iteration 00:05:10.608 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.608 spdk_app_start is called in Round 2. 00:05:10.608 Shutdown signal received, stop current app iteration 00:05:10.608 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.608 spdk_app_start is called in Round 3. 00:05:10.608 Shutdown signal received, stop current app iteration 00:05:10.608 01:40:59 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:10.608 01:40:59 -- event/event.sh@42 -- # return 0 00:05:10.608 00:05:10.608 real 0m18.951s 00:05:10.608 user 0m41.403s 00:05:10.608 sys 0m3.074s 00:05:10.608 01:40:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.608 01:40:59 -- common/autotest_common.sh@10 -- # set +x 00:05:10.608 ************************************ 00:05:10.608 END TEST app_repeat 00:05:10.608 ************************************ 00:05:10.608 01:40:59 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:10.608 01:40:59 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:10.608 01:40:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.608 01:40:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.608 01:40:59 -- common/autotest_common.sh@10 -- # set +x 00:05:10.608 ************************************ 00:05:10.608 START TEST cpu_locks 00:05:10.608 ************************************ 00:05:10.608 01:40:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:10.608 * Looking for test storage... 00:05:10.608 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:10.608 01:40:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:10.608 01:40:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:10.608 01:40:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:10.865 01:40:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:10.865 01:40:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:10.865 01:40:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:10.865 01:40:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:10.865 01:40:59 -- scripts/common.sh@335 -- # IFS=.-: 00:05:10.865 01:40:59 -- scripts/common.sh@335 -- # read -ra ver1 00:05:10.865 01:40:59 -- scripts/common.sh@336 -- # IFS=.-: 00:05:10.865 01:40:59 -- scripts/common.sh@336 -- # read -ra ver2 00:05:10.865 01:40:59 -- scripts/common.sh@337 -- # local 'op=<' 00:05:10.865 01:40:59 -- scripts/common.sh@339 -- # ver1_l=2 00:05:10.865 01:40:59 -- scripts/common.sh@340 -- # ver2_l=1 00:05:10.865 01:40:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:10.865 01:40:59 -- scripts/common.sh@343 -- # case "$op" in 00:05:10.865 01:40:59 -- scripts/common.sh@344 -- # : 1 00:05:10.865 01:40:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:10.865 01:40:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:10.865 01:40:59 -- scripts/common.sh@364 -- # decimal 1 00:05:10.865 01:40:59 -- scripts/common.sh@352 -- # local d=1 00:05:10.865 01:40:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:10.865 01:40:59 -- scripts/common.sh@354 -- # echo 1 00:05:10.865 01:40:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:10.865 01:40:59 -- scripts/common.sh@365 -- # decimal 2 00:05:10.865 01:40:59 -- scripts/common.sh@352 -- # local d=2 00:05:10.865 01:40:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:10.865 01:40:59 -- scripts/common.sh@354 -- # echo 2 00:05:10.865 01:40:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:10.865 01:40:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:10.865 01:40:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:10.865 01:40:59 -- scripts/common.sh@367 -- # return 0 00:05:10.865 01:40:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:10.865 01:40:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:10.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.865 --rc genhtml_branch_coverage=1 00:05:10.865 --rc genhtml_function_coverage=1 00:05:10.865 --rc genhtml_legend=1 00:05:10.865 --rc geninfo_all_blocks=1 00:05:10.865 --rc geninfo_unexecuted_blocks=1 00:05:10.865 00:05:10.865 ' 00:05:10.865 01:40:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:10.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.865 --rc genhtml_branch_coverage=1 00:05:10.865 --rc genhtml_function_coverage=1 00:05:10.865 --rc genhtml_legend=1 00:05:10.865 --rc geninfo_all_blocks=1 00:05:10.865 --rc geninfo_unexecuted_blocks=1 00:05:10.865 00:05:10.865 ' 00:05:10.865 01:40:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:10.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.865 --rc genhtml_branch_coverage=1 00:05:10.865 --rc genhtml_function_coverage=1 00:05:10.865 --rc genhtml_legend=1 00:05:10.865 --rc geninfo_all_blocks=1 00:05:10.865 --rc geninfo_unexecuted_blocks=1 00:05:10.865 00:05:10.865 ' 00:05:10.865 01:40:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:10.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.865 --rc genhtml_branch_coverage=1 00:05:10.865 --rc genhtml_function_coverage=1 00:05:10.865 --rc genhtml_legend=1 00:05:10.865 --rc geninfo_all_blocks=1 00:05:10.865 --rc geninfo_unexecuted_blocks=1 00:05:10.865 00:05:10.865 ' 00:05:10.865 01:40:59 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:10.865 01:40:59 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:10.865 01:40:59 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:10.865 01:40:59 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:10.865 01:40:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.865 01:40:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.865 01:40:59 -- common/autotest_common.sh@10 -- # set +x 00:05:10.865 ************************************ 00:05:10.865 START TEST default_locks 00:05:10.865 ************************************ 00:05:10.865 01:40:59 -- common/autotest_common.sh@1114 -- # default_locks 00:05:10.865 01:40:59 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3326099 00:05:10.865 01:40:59 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:10.865 01:40:59 -- event/cpu_locks.sh@47 -- # waitforlisten 3326099 00:05:10.865 01:40:59 -- common/autotest_common.sh@829 -- # '[' -z 3326099 ']' 00:05:10.865 01:40:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.865 01:40:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.865 01:40:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.865 01:40:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.865 01:40:59 -- common/autotest_common.sh@10 -- # set +x 00:05:10.865 [2024-11-19 01:40:59.281680] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.865 [2024-11-19 01:40:59.281774] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326099 ] 00:05:10.865 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.865 [2024-11-19 01:40:59.337748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.123 [2024-11-19 01:40:59.449814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.123 [2024-11-19 01:40:59.449988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.692 01:41:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.692 01:41:00 -- common/autotest_common.sh@862 -- # return 0 00:05:11.692 01:41:00 -- event/cpu_locks.sh@49 -- # locks_exist 3326099 00:05:11.692 01:41:00 -- event/cpu_locks.sh@22 -- # lslocks -p 3326099 00:05:11.692 01:41:00 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:12.260 lslocks: write error 00:05:12.260 01:41:00 -- event/cpu_locks.sh@50 -- # killprocess 3326099 00:05:12.260 01:41:00 -- common/autotest_common.sh@936 -- # '[' -z 3326099 ']' 00:05:12.260 01:41:00 -- common/autotest_common.sh@940 -- # kill -0 3326099 00:05:12.260 01:41:00 -- common/autotest_common.sh@941 -- # uname 00:05:12.260 01:41:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:12.260 01:41:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326099 00:05:12.260 01:41:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:12.260 01:41:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:12.260 01:41:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326099' 00:05:12.260 killing process with pid 3326099 00:05:12.260 01:41:00 -- common/autotest_common.sh@955 -- # kill 3326099 00:05:12.260 01:41:00 -- common/autotest_common.sh@960 -- # wait 3326099 00:05:12.828 01:41:01 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3326099 00:05:12.828 01:41:01 -- common/autotest_common.sh@650 -- # local es=0 00:05:12.828 01:41:01 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3326099 00:05:12.828 01:41:01 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:12.828 01:41:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.828 01:41:01 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:12.828 01:41:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.828 01:41:01 -- common/autotest_common.sh@653 -- # waitforlisten 3326099 00:05:12.828 01:41:01 -- common/autotest_common.sh@829 -- # '[' -z 3326099 ']' 00:05:12.828 01:41:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.828 01:41:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.828 01:41:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.828 01:41:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.828 01:41:01 -- common/autotest_common.sh@10 -- # set +x 00:05:12.828 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3326099) - No such process 00:05:12.828 ERROR: process (pid: 3326099) is no longer running 00:05:12.828 01:41:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.828 01:41:01 -- common/autotest_common.sh@862 -- # return 1 00:05:12.828 01:41:01 -- common/autotest_common.sh@653 -- # es=1 00:05:12.828 01:41:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:12.828 01:41:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:12.828 01:41:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:12.828 01:41:01 -- event/cpu_locks.sh@54 -- # no_locks 00:05:12.828 01:41:01 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:12.828 01:41:01 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:12.828 01:41:01 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:12.828 00:05:12.828 real 0m1.886s 00:05:12.828 user 0m2.042s 00:05:12.828 sys 0m0.567s 00:05:12.828 01:41:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.828 01:41:01 -- common/autotest_common.sh@10 -- # set +x 00:05:12.828 ************************************ 00:05:12.828 END TEST default_locks 00:05:12.828 ************************************ 00:05:12.828 01:41:01 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:12.828 01:41:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.828 01:41:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.828 01:41:01 -- common/autotest_common.sh@10 -- # set +x 00:05:12.828 ************************************ 00:05:12.828 START TEST default_locks_via_rpc 00:05:12.828 ************************************ 00:05:12.828 01:41:01 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:12.828 01:41:01 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3326400 00:05:12.828 01:41:01 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:12.828 01:41:01 -- event/cpu_locks.sh@63 -- # waitforlisten 3326400 00:05:12.828 01:41:01 -- common/autotest_common.sh@829 -- # '[' -z 3326400 ']' 00:05:12.828 01:41:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.828 01:41:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.828 01:41:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.828 01:41:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.828 01:41:01 -- common/autotest_common.sh@10 -- # set +x 00:05:12.828 [2024-11-19 01:41:01.198192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.829 [2024-11-19 01:41:01.198278] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326400 ] 00:05:12.829 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.829 [2024-11-19 01:41:01.254324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.829 [2024-11-19 01:41:01.366812] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.829 [2024-11-19 01:41:01.366996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.763 01:41:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.763 01:41:02 -- common/autotest_common.sh@862 -- # return 0 00:05:13.763 01:41:02 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:13.763 01:41:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.763 01:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:13.763 01:41:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.763 01:41:02 -- event/cpu_locks.sh@67 -- # no_locks 00:05:13.763 01:41:02 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:13.763 01:41:02 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:13.763 01:41:02 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:13.763 01:41:02 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:13.763 01:41:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.763 01:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:13.763 01:41:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.763 01:41:02 -- event/cpu_locks.sh@71 -- # locks_exist 3326400 00:05:13.763 01:41:02 -- event/cpu_locks.sh@22 -- # lslocks -p 3326400 00:05:13.763 01:41:02 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:14.023 01:41:02 -- event/cpu_locks.sh@73 -- # killprocess 3326400 00:05:14.023 01:41:02 -- common/autotest_common.sh@936 -- # '[' -z 3326400 ']' 00:05:14.023 01:41:02 -- common/autotest_common.sh@940 -- # kill -0 3326400 00:05:14.023 01:41:02 -- common/autotest_common.sh@941 -- # uname 00:05:14.023 01:41:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:14.023 01:41:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326400 00:05:14.023 01:41:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:14.023 01:41:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:14.023 01:41:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326400' 00:05:14.023 killing process with pid 3326400 00:05:14.023 01:41:02 -- common/autotest_common.sh@955 -- # kill 3326400 00:05:14.023 01:41:02 -- common/autotest_common.sh@960 -- # wait 3326400 00:05:14.592 00:05:14.592 real 0m1.794s 00:05:14.592 user 0m1.932s 00:05:14.592 sys 0m0.553s 00:05:14.592 01:41:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.592 01:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:14.592 ************************************ 00:05:14.592 END TEST default_locks_via_rpc 00:05:14.592 ************************************ 00:05:14.592 01:41:02 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:14.592 01:41:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.592 01:41:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.592 01:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:14.592 ************************************ 00:05:14.592 START TEST non_locking_app_on_locked_coremask 00:05:14.592 ************************************ 00:05:14.592 01:41:02 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:14.592 01:41:02 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3326679 00:05:14.592 01:41:02 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.592 01:41:02 -- event/cpu_locks.sh@81 -- # waitforlisten 3326679 /var/tmp/spdk.sock 00:05:14.592 01:41:02 -- common/autotest_common.sh@829 -- # '[' -z 3326679 ']' 00:05:14.592 01:41:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.592 01:41:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.592 01:41:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.592 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.592 01:41:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.592 01:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:14.592 [2024-11-19 01:41:03.016250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.592 [2024-11-19 01:41:03.016336] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326679 ] 00:05:14.592 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.592 [2024-11-19 01:41:03.077820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.849 [2024-11-19 01:41:03.193211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.849 [2024-11-19 01:41:03.193402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.419 01:41:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.419 01:41:03 -- common/autotest_common.sh@862 -- # return 0 00:05:15.419 01:41:03 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3326714 00:05:15.419 01:41:03 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:15.419 01:41:03 -- event/cpu_locks.sh@85 -- # waitforlisten 3326714 /var/tmp/spdk2.sock 00:05:15.419 01:41:03 -- common/autotest_common.sh@829 -- # '[' -z 3326714 ']' 00:05:15.419 01:41:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:15.419 01:41:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.419 01:41:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:15.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:15.419 01:41:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.419 01:41:03 -- common/autotest_common.sh@10 -- # set +x 00:05:15.730 [2024-11-19 01:41:04.011420] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.730 [2024-11-19 01:41:04.011493] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326714 ] 00:05:15.730 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.730 [2024-11-19 01:41:04.101078] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:15.730 [2024-11-19 01:41:04.101122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.019 [2024-11-19 01:41:04.330972] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.019 [2024-11-19 01:41:04.331162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.587 01:41:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.587 01:41:04 -- common/autotest_common.sh@862 -- # return 0 00:05:16.587 01:41:04 -- event/cpu_locks.sh@87 -- # locks_exist 3326679 00:05:16.587 01:41:04 -- event/cpu_locks.sh@22 -- # lslocks -p 3326679 00:05:16.587 01:41:04 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:17.153 lslocks: write error 00:05:17.153 01:41:05 -- event/cpu_locks.sh@89 -- # killprocess 3326679 00:05:17.153 01:41:05 -- common/autotest_common.sh@936 -- # '[' -z 3326679 ']' 00:05:17.153 01:41:05 -- common/autotest_common.sh@940 -- # kill -0 3326679 00:05:17.153 01:41:05 -- common/autotest_common.sh@941 -- # uname 00:05:17.153 01:41:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:17.153 01:41:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326679 00:05:17.153 01:41:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:17.153 01:41:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:17.153 01:41:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326679' 00:05:17.153 killing process with pid 3326679 00:05:17.153 01:41:05 -- common/autotest_common.sh@955 -- # kill 3326679 00:05:17.153 01:41:05 -- common/autotest_common.sh@960 -- # wait 3326679 00:05:18.090 01:41:06 -- event/cpu_locks.sh@90 -- # killprocess 3326714 00:05:18.090 01:41:06 -- common/autotest_common.sh@936 -- # '[' -z 3326714 ']' 00:05:18.090 01:41:06 -- common/autotest_common.sh@940 -- # kill -0 3326714 00:05:18.090 01:41:06 -- common/autotest_common.sh@941 -- # uname 00:05:18.090 01:41:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.090 01:41:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326714 00:05:18.090 01:41:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.090 01:41:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.090 01:41:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326714' 00:05:18.090 killing process with pid 3326714 00:05:18.090 01:41:06 -- common/autotest_common.sh@955 -- # kill 3326714 00:05:18.090 01:41:06 -- common/autotest_common.sh@960 -- # wait 3326714 00:05:18.659 00:05:18.659 real 0m3.975s 00:05:18.659 user 0m4.340s 00:05:18.659 sys 0m1.093s 00:05:18.659 01:41:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.659 01:41:06 -- common/autotest_common.sh@10 -- # set +x 00:05:18.659 ************************************ 00:05:18.659 END TEST non_locking_app_on_locked_coremask 00:05:18.659 ************************************ 00:05:18.659 01:41:06 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:18.659 01:41:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.659 01:41:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.659 01:41:06 -- common/autotest_common.sh@10 -- # set +x 00:05:18.659 ************************************ 00:05:18.659 START TEST locking_app_on_unlocked_coremask 00:05:18.659 ************************************ 00:05:18.659 01:41:06 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:18.659 01:41:06 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3327159 00:05:18.659 01:41:06 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:18.659 01:41:06 -- event/cpu_locks.sh@99 -- # waitforlisten 3327159 /var/tmp/spdk.sock 00:05:18.659 01:41:06 -- common/autotest_common.sh@829 -- # '[' -z 3327159 ']' 00:05:18.659 01:41:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.659 01:41:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.659 01:41:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.659 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.659 01:41:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.659 01:41:06 -- common/autotest_common.sh@10 -- # set +x 00:05:18.659 [2024-11-19 01:41:07.025819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.659 [2024-11-19 01:41:07.025909] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327159 ] 00:05:18.659 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.659 [2024-11-19 01:41:07.086383] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:18.659 [2024-11-19 01:41:07.086432] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.659 [2024-11-19 01:41:07.197275] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.659 [2024-11-19 01:41:07.197463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.595 01:41:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.595 01:41:07 -- common/autotest_common.sh@862 -- # return 0 00:05:19.595 01:41:07 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3327298 00:05:19.595 01:41:07 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:19.595 01:41:07 -- event/cpu_locks.sh@103 -- # waitforlisten 3327298 /var/tmp/spdk2.sock 00:05:19.595 01:41:07 -- common/autotest_common.sh@829 -- # '[' -z 3327298 ']' 00:05:19.595 01:41:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:19.595 01:41:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.595 01:41:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:19.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:19.595 01:41:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.595 01:41:07 -- common/autotest_common.sh@10 -- # set +x 00:05:19.595 [2024-11-19 01:41:08.011757] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.595 [2024-11-19 01:41:08.011829] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327298 ] 00:05:19.595 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.595 [2024-11-19 01:41:08.097863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.855 [2024-11-19 01:41:08.322995] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.855 [2024-11-19 01:41:08.323187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.790 01:41:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.790 01:41:08 -- common/autotest_common.sh@862 -- # return 0 00:05:20.790 01:41:08 -- event/cpu_locks.sh@105 -- # locks_exist 3327298 00:05:20.790 01:41:08 -- event/cpu_locks.sh@22 -- # lslocks -p 3327298 00:05:20.790 01:41:08 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:21.050 lslocks: write error 00:05:21.050 01:41:09 -- event/cpu_locks.sh@107 -- # killprocess 3327159 00:05:21.050 01:41:09 -- common/autotest_common.sh@936 -- # '[' -z 3327159 ']' 00:05:21.050 01:41:09 -- common/autotest_common.sh@940 -- # kill -0 3327159 00:05:21.050 01:41:09 -- common/autotest_common.sh@941 -- # uname 00:05:21.050 01:41:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.050 01:41:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3327159 00:05:21.050 01:41:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.050 01:41:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.050 01:41:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3327159' 00:05:21.050 killing process with pid 3327159 00:05:21.050 01:41:09 -- common/autotest_common.sh@955 -- # kill 3327159 00:05:21.050 01:41:09 -- common/autotest_common.sh@960 -- # wait 3327159 00:05:21.986 01:41:10 -- event/cpu_locks.sh@108 -- # killprocess 3327298 00:05:21.986 01:41:10 -- common/autotest_common.sh@936 -- # '[' -z 3327298 ']' 00:05:21.986 01:41:10 -- common/autotest_common.sh@940 -- # kill -0 3327298 00:05:21.986 01:41:10 -- common/autotest_common.sh@941 -- # uname 00:05:21.986 01:41:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.986 01:41:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3327298 00:05:21.986 01:41:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.986 01:41:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.986 01:41:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3327298' 00:05:21.986 killing process with pid 3327298 00:05:21.986 01:41:10 -- common/autotest_common.sh@955 -- # kill 3327298 00:05:21.986 01:41:10 -- common/autotest_common.sh@960 -- # wait 3327298 00:05:22.554 00:05:22.554 real 0m3.905s 00:05:22.554 user 0m4.276s 00:05:22.554 sys 0m1.080s 00:05:22.554 01:41:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.554 01:41:10 -- common/autotest_common.sh@10 -- # set +x 00:05:22.554 ************************************ 00:05:22.554 END TEST locking_app_on_unlocked_coremask 00:05:22.554 ************************************ 00:05:22.554 01:41:10 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:22.554 01:41:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:22.554 01:41:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.554 01:41:10 -- common/autotest_common.sh@10 -- # set +x 00:05:22.554 ************************************ 00:05:22.554 START TEST locking_app_on_locked_coremask 00:05:22.554 ************************************ 00:05:22.554 01:41:10 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:22.554 01:41:10 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3327701 00:05:22.554 01:41:10 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:22.554 01:41:10 -- event/cpu_locks.sh@116 -- # waitforlisten 3327701 /var/tmp/spdk.sock 00:05:22.554 01:41:10 -- common/autotest_common.sh@829 -- # '[' -z 3327701 ']' 00:05:22.554 01:41:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.554 01:41:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.554 01:41:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.554 01:41:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.554 01:41:10 -- common/autotest_common.sh@10 -- # set +x 00:05:22.554 [2024-11-19 01:41:10.955712] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.554 [2024-11-19 01:41:10.955800] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327701 ] 00:05:22.554 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.554 [2024-11-19 01:41:11.011413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.812 [2024-11-19 01:41:11.126830] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.812 [2024-11-19 01:41:11.127006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.380 01:41:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.380 01:41:11 -- common/autotest_common.sh@862 -- # return 0 00:05:23.380 01:41:11 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3327751 00:05:23.380 01:41:11 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:23.380 01:41:11 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3327751 /var/tmp/spdk2.sock 00:05:23.380 01:41:11 -- common/autotest_common.sh@650 -- # local es=0 00:05:23.380 01:41:11 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3327751 /var/tmp/spdk2.sock 00:05:23.380 01:41:11 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:23.380 01:41:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.380 01:41:11 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:23.380 01:41:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.380 01:41:11 -- common/autotest_common.sh@653 -- # waitforlisten 3327751 /var/tmp/spdk2.sock 00:05:23.380 01:41:11 -- common/autotest_common.sh@829 -- # '[' -z 3327751 ']' 00:05:23.380 01:41:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:23.380 01:41:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.380 01:41:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:23.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:23.380 01:41:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.380 01:41:11 -- common/autotest_common.sh@10 -- # set +x 00:05:23.640 [2024-11-19 01:41:11.952472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.640 [2024-11-19 01:41:11.952558] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327751 ] 00:05:23.640 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.640 [2024-11-19 01:41:12.050569] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3327701 has claimed it. 00:05:23.640 [2024-11-19 01:41:12.050646] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:24.205 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3327751) - No such process 00:05:24.205 ERROR: process (pid: 3327751) is no longer running 00:05:24.205 01:41:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:24.205 01:41:12 -- common/autotest_common.sh@862 -- # return 1 00:05:24.205 01:41:12 -- common/autotest_common.sh@653 -- # es=1 00:05:24.205 01:41:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:24.205 01:41:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:24.205 01:41:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:24.206 01:41:12 -- event/cpu_locks.sh@122 -- # locks_exist 3327701 00:05:24.206 01:41:12 -- event/cpu_locks.sh@22 -- # lslocks -p 3327701 00:05:24.206 01:41:12 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:24.773 lslocks: write error 00:05:24.773 01:41:13 -- event/cpu_locks.sh@124 -- # killprocess 3327701 00:05:24.773 01:41:13 -- common/autotest_common.sh@936 -- # '[' -z 3327701 ']' 00:05:24.773 01:41:13 -- common/autotest_common.sh@940 -- # kill -0 3327701 00:05:24.773 01:41:13 -- common/autotest_common.sh@941 -- # uname 00:05:24.773 01:41:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.773 01:41:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3327701 00:05:24.773 01:41:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.773 01:41:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.773 01:41:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3327701' 00:05:24.773 killing process with pid 3327701 00:05:24.773 01:41:13 -- common/autotest_common.sh@955 -- # kill 3327701 00:05:24.773 01:41:13 -- common/autotest_common.sh@960 -- # wait 3327701 00:05:25.337 00:05:25.337 real 0m2.707s 00:05:25.337 user 0m3.089s 00:05:25.337 sys 0m0.679s 00:05:25.337 01:41:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.337 01:41:13 -- common/autotest_common.sh@10 -- # set +x 00:05:25.337 ************************************ 00:05:25.337 END TEST locking_app_on_locked_coremask 00:05:25.337 ************************************ 00:05:25.337 01:41:13 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:25.337 01:41:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.337 01:41:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.337 01:41:13 -- common/autotest_common.sh@10 -- # set +x 00:05:25.337 ************************************ 00:05:25.337 START TEST locking_overlapped_coremask 00:05:25.337 ************************************ 00:05:25.337 01:41:13 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:25.337 01:41:13 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3328046 00:05:25.337 01:41:13 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:25.337 01:41:13 -- event/cpu_locks.sh@133 -- # waitforlisten 3328046 /var/tmp/spdk.sock 00:05:25.337 01:41:13 -- common/autotest_common.sh@829 -- # '[' -z 3328046 ']' 00:05:25.337 01:41:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:25.337 01:41:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:25.337 01:41:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:25.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:25.337 01:41:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:25.337 01:41:13 -- common/autotest_common.sh@10 -- # set +x 00:05:25.337 [2024-11-19 01:41:13.693935] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.337 [2024-11-19 01:41:13.694046] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328046 ] 00:05:25.337 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.337 [2024-11-19 01:41:13.755740] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:25.337 [2024-11-19 01:41:13.868996] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.337 [2024-11-19 01:41:13.869247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:25.337 [2024-11-19 01:41:13.869316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:25.337 [2024-11-19 01:41:13.869319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.273 01:41:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.273 01:41:14 -- common/autotest_common.sh@862 -- # return 0 00:05:26.273 01:41:14 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3328187 00:05:26.273 01:41:14 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:26.273 01:41:14 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3328187 /var/tmp/spdk2.sock 00:05:26.273 01:41:14 -- common/autotest_common.sh@650 -- # local es=0 00:05:26.273 01:41:14 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3328187 /var/tmp/spdk2.sock 00:05:26.273 01:41:14 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:26.273 01:41:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.273 01:41:14 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:26.273 01:41:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.273 01:41:14 -- common/autotest_common.sh@653 -- # waitforlisten 3328187 /var/tmp/spdk2.sock 00:05:26.273 01:41:14 -- common/autotest_common.sh@829 -- # '[' -z 3328187 ']' 00:05:26.273 01:41:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:26.273 01:41:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.273 01:41:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:26.273 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:26.273 01:41:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.273 01:41:14 -- common/autotest_common.sh@10 -- # set +x 00:05:26.273 [2024-11-19 01:41:14.690914] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.273 [2024-11-19 01:41:14.691005] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328187 ] 00:05:26.273 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.273 [2024-11-19 01:41:14.781364] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3328046 has claimed it. 00:05:26.273 [2024-11-19 01:41:14.781433] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:27.209 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3328187) - No such process 00:05:27.209 ERROR: process (pid: 3328187) is no longer running 00:05:27.209 01:41:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.210 01:41:15 -- common/autotest_common.sh@862 -- # return 1 00:05:27.210 01:41:15 -- common/autotest_common.sh@653 -- # es=1 00:05:27.210 01:41:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:27.210 01:41:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:27.210 01:41:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:27.210 01:41:15 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:27.210 01:41:15 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:27.210 01:41:15 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:27.210 01:41:15 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:27.210 01:41:15 -- event/cpu_locks.sh@141 -- # killprocess 3328046 00:05:27.210 01:41:15 -- common/autotest_common.sh@936 -- # '[' -z 3328046 ']' 00:05:27.210 01:41:15 -- common/autotest_common.sh@940 -- # kill -0 3328046 00:05:27.210 01:41:15 -- common/autotest_common.sh@941 -- # uname 00:05:27.210 01:41:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.210 01:41:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3328046 00:05:27.210 01:41:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.210 01:41:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.210 01:41:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3328046' 00:05:27.210 killing process with pid 3328046 00:05:27.210 01:41:15 -- common/autotest_common.sh@955 -- # kill 3328046 00:05:27.210 01:41:15 -- common/autotest_common.sh@960 -- # wait 3328046 00:05:27.468 00:05:27.468 real 0m2.238s 00:05:27.468 user 0m6.304s 00:05:27.468 sys 0m0.502s 00:05:27.468 01:41:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.468 01:41:15 -- common/autotest_common.sh@10 -- # set +x 00:05:27.468 ************************************ 00:05:27.468 END TEST locking_overlapped_coremask 00:05:27.468 ************************************ 00:05:27.468 01:41:15 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:27.468 01:41:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.468 01:41:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.468 01:41:15 -- common/autotest_common.sh@10 -- # set +x 00:05:27.468 ************************************ 00:05:27.468 START TEST locking_overlapped_coremask_via_rpc 00:05:27.468 ************************************ 00:05:27.468 01:41:15 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:27.468 01:41:15 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3328360 00:05:27.468 01:41:15 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:27.468 01:41:15 -- event/cpu_locks.sh@149 -- # waitforlisten 3328360 /var/tmp/spdk.sock 00:05:27.468 01:41:15 -- common/autotest_common.sh@829 -- # '[' -z 3328360 ']' 00:05:27.468 01:41:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:27.468 01:41:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:27.468 01:41:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:27.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:27.468 01:41:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:27.468 01:41:15 -- common/autotest_common.sh@10 -- # set +x 00:05:27.468 [2024-11-19 01:41:15.956744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.468 [2024-11-19 01:41:15.956833] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328360 ] 00:05:27.468 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.727 [2024-11-19 01:41:16.018792] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:27.727 [2024-11-19 01:41:16.018838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:27.727 [2024-11-19 01:41:16.130881] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:27.727 [2024-11-19 01:41:16.131116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:27.727 [2024-11-19 01:41:16.131188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:27.727 [2024-11-19 01:41:16.131191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.664 01:41:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.664 01:41:16 -- common/autotest_common.sh@862 -- # return 0 00:05:28.664 01:41:16 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3328501 00:05:28.664 01:41:16 -- event/cpu_locks.sh@153 -- # waitforlisten 3328501 /var/tmp/spdk2.sock 00:05:28.664 01:41:16 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:28.664 01:41:16 -- common/autotest_common.sh@829 -- # '[' -z 3328501 ']' 00:05:28.664 01:41:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:28.664 01:41:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.664 01:41:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:28.664 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:28.664 01:41:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.664 01:41:16 -- common/autotest_common.sh@10 -- # set +x 00:05:28.664 [2024-11-19 01:41:16.950689] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.664 [2024-11-19 01:41:16.950774] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328501 ] 00:05:28.664 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.664 [2024-11-19 01:41:17.037767] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:28.664 [2024-11-19 01:41:17.037808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:28.924 [2024-11-19 01:41:17.253223] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.924 [2024-11-19 01:41:17.253517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:28.924 [2024-11-19 01:41:17.256731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:28.924 [2024-11-19 01:41:17.256734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:29.491 01:41:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.491 01:41:17 -- common/autotest_common.sh@862 -- # return 0 00:05:29.491 01:41:17 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:29.491 01:41:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:29.491 01:41:17 -- common/autotest_common.sh@10 -- # set +x 00:05:29.491 01:41:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:29.491 01:41:17 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:29.491 01:41:17 -- common/autotest_common.sh@650 -- # local es=0 00:05:29.491 01:41:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:29.491 01:41:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:29.491 01:41:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.491 01:41:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:29.491 01:41:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.491 01:41:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:29.491 01:41:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:29.491 01:41:17 -- common/autotest_common.sh@10 -- # set +x 00:05:29.491 [2024-11-19 01:41:17.923742] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3328360 has claimed it. 00:05:29.491 request: 00:05:29.491 { 00:05:29.491 "method": "framework_enable_cpumask_locks", 00:05:29.491 "req_id": 1 00:05:29.491 } 00:05:29.491 Got JSON-RPC error response 00:05:29.491 response: 00:05:29.491 { 00:05:29.491 "code": -32603, 00:05:29.491 "message": "Failed to claim CPU core: 2" 00:05:29.491 } 00:05:29.491 01:41:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:29.491 01:41:17 -- common/autotest_common.sh@653 -- # es=1 00:05:29.491 01:41:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:29.491 01:41:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:29.491 01:41:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:29.491 01:41:17 -- event/cpu_locks.sh@158 -- # waitforlisten 3328360 /var/tmp/spdk.sock 00:05:29.491 01:41:17 -- common/autotest_common.sh@829 -- # '[' -z 3328360 ']' 00:05:29.491 01:41:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:29.491 01:41:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.491 01:41:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:29.491 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:29.491 01:41:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.491 01:41:17 -- common/autotest_common.sh@10 -- # set +x 00:05:29.749 01:41:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.749 01:41:18 -- common/autotest_common.sh@862 -- # return 0 00:05:29.749 01:41:18 -- event/cpu_locks.sh@159 -- # waitforlisten 3328501 /var/tmp/spdk2.sock 00:05:29.749 01:41:18 -- common/autotest_common.sh@829 -- # '[' -z 3328501 ']' 00:05:29.749 01:41:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:29.749 01:41:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.749 01:41:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:29.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:29.749 01:41:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.749 01:41:18 -- common/autotest_common.sh@10 -- # set +x 00:05:30.009 01:41:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:30.009 01:41:18 -- common/autotest_common.sh@862 -- # return 0 00:05:30.009 01:41:18 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:30.009 01:41:18 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:30.009 01:41:18 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:30.009 01:41:18 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:30.009 00:05:30.009 real 0m2.530s 00:05:30.009 user 0m1.263s 00:05:30.009 sys 0m0.192s 00:05:30.009 01:41:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.009 01:41:18 -- common/autotest_common.sh@10 -- # set +x 00:05:30.009 ************************************ 00:05:30.009 END TEST locking_overlapped_coremask_via_rpc 00:05:30.009 ************************************ 00:05:30.009 01:41:18 -- event/cpu_locks.sh@174 -- # cleanup 00:05:30.009 01:41:18 -- event/cpu_locks.sh@15 -- # [[ -z 3328360 ]] 00:05:30.009 01:41:18 -- event/cpu_locks.sh@15 -- # killprocess 3328360 00:05:30.009 01:41:18 -- common/autotest_common.sh@936 -- # '[' -z 3328360 ']' 00:05:30.009 01:41:18 -- common/autotest_common.sh@940 -- # kill -0 3328360 00:05:30.009 01:41:18 -- common/autotest_common.sh@941 -- # uname 00:05:30.009 01:41:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:30.009 01:41:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3328360 00:05:30.009 01:41:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:30.009 01:41:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:30.009 01:41:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3328360' 00:05:30.009 killing process with pid 3328360 00:05:30.009 01:41:18 -- common/autotest_common.sh@955 -- # kill 3328360 00:05:30.009 01:41:18 -- common/autotest_common.sh@960 -- # wait 3328360 00:05:30.575 01:41:18 -- event/cpu_locks.sh@16 -- # [[ -z 3328501 ]] 00:05:30.575 01:41:18 -- event/cpu_locks.sh@16 -- # killprocess 3328501 00:05:30.575 01:41:18 -- common/autotest_common.sh@936 -- # '[' -z 3328501 ']' 00:05:30.575 01:41:18 -- common/autotest_common.sh@940 -- # kill -0 3328501 00:05:30.575 01:41:18 -- common/autotest_common.sh@941 -- # uname 00:05:30.575 01:41:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:30.575 01:41:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3328501 00:05:30.575 01:41:18 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:30.575 01:41:18 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:30.575 01:41:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3328501' 00:05:30.575 killing process with pid 3328501 00:05:30.575 01:41:18 -- common/autotest_common.sh@955 -- # kill 3328501 00:05:30.575 01:41:18 -- common/autotest_common.sh@960 -- # wait 3328501 00:05:31.148 01:41:19 -- event/cpu_locks.sh@18 -- # rm -f 00:05:31.148 01:41:19 -- event/cpu_locks.sh@1 -- # cleanup 00:05:31.148 01:41:19 -- event/cpu_locks.sh@15 -- # [[ -z 3328360 ]] 00:05:31.148 01:41:19 -- event/cpu_locks.sh@15 -- # killprocess 3328360 00:05:31.148 01:41:19 -- common/autotest_common.sh@936 -- # '[' -z 3328360 ']' 00:05:31.148 01:41:19 -- common/autotest_common.sh@940 -- # kill -0 3328360 00:05:31.148 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3328360) - No such process 00:05:31.148 01:41:19 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3328360 is not found' 00:05:31.148 Process with pid 3328360 is not found 00:05:31.148 01:41:19 -- event/cpu_locks.sh@16 -- # [[ -z 3328501 ]] 00:05:31.148 01:41:19 -- event/cpu_locks.sh@16 -- # killprocess 3328501 00:05:31.148 01:41:19 -- common/autotest_common.sh@936 -- # '[' -z 3328501 ']' 00:05:31.148 01:41:19 -- common/autotest_common.sh@940 -- # kill -0 3328501 00:05:31.148 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3328501) - No such process 00:05:31.148 01:41:19 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3328501 is not found' 00:05:31.148 Process with pid 3328501 is not found 00:05:31.148 01:41:19 -- event/cpu_locks.sh@18 -- # rm -f 00:05:31.148 00:05:31.148 real 0m20.342s 00:05:31.148 user 0m35.939s 00:05:31.148 sys 0m5.547s 00:05:31.148 01:41:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.148 01:41:19 -- common/autotest_common.sh@10 -- # set +x 00:05:31.148 ************************************ 00:05:31.148 END TEST cpu_locks 00:05:31.148 ************************************ 00:05:31.148 00:05:31.148 real 0m47.858s 00:05:31.148 user 1m31.108s 00:05:31.148 sys 0m9.384s 00:05:31.148 01:41:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.148 01:41:19 -- common/autotest_common.sh@10 -- # set +x 00:05:31.148 ************************************ 00:05:31.148 END TEST event 00:05:31.148 ************************************ 00:05:31.148 01:41:19 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:31.148 01:41:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.148 01:41:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.148 01:41:19 -- common/autotest_common.sh@10 -- # set +x 00:05:31.148 ************************************ 00:05:31.148 START TEST thread 00:05:31.148 ************************************ 00:05:31.148 01:41:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:31.148 * Looking for test storage... 00:05:31.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:31.148 01:41:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:31.148 01:41:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:31.148 01:41:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:31.148 01:41:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:31.148 01:41:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:31.148 01:41:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:31.148 01:41:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:31.148 01:41:19 -- scripts/common.sh@335 -- # IFS=.-: 00:05:31.148 01:41:19 -- scripts/common.sh@335 -- # read -ra ver1 00:05:31.148 01:41:19 -- scripts/common.sh@336 -- # IFS=.-: 00:05:31.148 01:41:19 -- scripts/common.sh@336 -- # read -ra ver2 00:05:31.148 01:41:19 -- scripts/common.sh@337 -- # local 'op=<' 00:05:31.148 01:41:19 -- scripts/common.sh@339 -- # ver1_l=2 00:05:31.148 01:41:19 -- scripts/common.sh@340 -- # ver2_l=1 00:05:31.148 01:41:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:31.148 01:41:19 -- scripts/common.sh@343 -- # case "$op" in 00:05:31.148 01:41:19 -- scripts/common.sh@344 -- # : 1 00:05:31.148 01:41:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:31.148 01:41:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:31.148 01:41:19 -- scripts/common.sh@364 -- # decimal 1 00:05:31.148 01:41:19 -- scripts/common.sh@352 -- # local d=1 00:05:31.148 01:41:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:31.148 01:41:19 -- scripts/common.sh@354 -- # echo 1 00:05:31.148 01:41:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:31.148 01:41:19 -- scripts/common.sh@365 -- # decimal 2 00:05:31.148 01:41:19 -- scripts/common.sh@352 -- # local d=2 00:05:31.148 01:41:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:31.148 01:41:19 -- scripts/common.sh@354 -- # echo 2 00:05:31.148 01:41:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:31.148 01:41:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:31.148 01:41:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:31.148 01:41:19 -- scripts/common.sh@367 -- # return 0 00:05:31.148 01:41:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:31.148 01:41:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:31.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.148 --rc genhtml_branch_coverage=1 00:05:31.148 --rc genhtml_function_coverage=1 00:05:31.148 --rc genhtml_legend=1 00:05:31.148 --rc geninfo_all_blocks=1 00:05:31.148 --rc geninfo_unexecuted_blocks=1 00:05:31.148 00:05:31.148 ' 00:05:31.148 01:41:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:31.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.148 --rc genhtml_branch_coverage=1 00:05:31.148 --rc genhtml_function_coverage=1 00:05:31.148 --rc genhtml_legend=1 00:05:31.148 --rc geninfo_all_blocks=1 00:05:31.148 --rc geninfo_unexecuted_blocks=1 00:05:31.148 00:05:31.148 ' 00:05:31.148 01:41:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:31.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.148 --rc genhtml_branch_coverage=1 00:05:31.148 --rc genhtml_function_coverage=1 00:05:31.148 --rc genhtml_legend=1 00:05:31.148 --rc geninfo_all_blocks=1 00:05:31.148 --rc geninfo_unexecuted_blocks=1 00:05:31.148 00:05:31.148 ' 00:05:31.148 01:41:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:31.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.148 --rc genhtml_branch_coverage=1 00:05:31.148 --rc genhtml_function_coverage=1 00:05:31.148 --rc genhtml_legend=1 00:05:31.148 --rc geninfo_all_blocks=1 00:05:31.148 --rc geninfo_unexecuted_blocks=1 00:05:31.148 00:05:31.148 ' 00:05:31.148 01:41:19 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:31.148 01:41:19 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:31.148 01:41:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.148 01:41:19 -- common/autotest_common.sh@10 -- # set +x 00:05:31.148 ************************************ 00:05:31.148 START TEST thread_poller_perf 00:05:31.148 ************************************ 00:05:31.148 01:41:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:31.149 [2024-11-19 01:41:19.628544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.149 [2024-11-19 01:41:19.628633] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328876 ] 00:05:31.149 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.149 [2024-11-19 01:41:19.687582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.407 [2024-11-19 01:41:19.799928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.407 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:32.785 [2024-11-19T00:41:21.328Z] ====================================== 00:05:32.785 [2024-11-19T00:41:21.328Z] busy:2718413828 (cyc) 00:05:32.785 [2024-11-19T00:41:21.328Z] total_run_count: 280000 00:05:32.785 [2024-11-19T00:41:21.328Z] tsc_hz: 2700000000 (cyc) 00:05:32.785 [2024-11-19T00:41:21.328Z] ====================================== 00:05:32.785 [2024-11-19T00:41:21.328Z] poller_cost: 9708 (cyc), 3595 (nsec) 00:05:32.785 00:05:32.785 real 0m1.321s 00:05:32.785 user 0m1.232s 00:05:32.785 sys 0m0.082s 00:05:32.785 01:41:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.785 01:41:20 -- common/autotest_common.sh@10 -- # set +x 00:05:32.785 ************************************ 00:05:32.785 END TEST thread_poller_perf 00:05:32.785 ************************************ 00:05:32.785 01:41:20 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:32.785 01:41:20 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:32.785 01:41:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.785 01:41:20 -- common/autotest_common.sh@10 -- # set +x 00:05:32.785 ************************************ 00:05:32.785 START TEST thread_poller_perf 00:05:32.785 ************************************ 00:05:32.785 01:41:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:32.785 [2024-11-19 01:41:20.979293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.785 [2024-11-19 01:41:20.979383] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329036 ] 00:05:32.785 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.785 [2024-11-19 01:41:21.043983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.785 [2024-11-19 01:41:21.159589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.785 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:34.163 [2024-11-19T00:41:22.706Z] ====================================== 00:05:34.163 [2024-11-19T00:41:22.706Z] busy:2703658559 (cyc) 00:05:34.163 [2024-11-19T00:41:22.706Z] total_run_count: 3825000 00:05:34.163 [2024-11-19T00:41:22.706Z] tsc_hz: 2700000000 (cyc) 00:05:34.163 [2024-11-19T00:41:22.706Z] ====================================== 00:05:34.163 [2024-11-19T00:41:22.706Z] poller_cost: 706 (cyc), 261 (nsec) 00:05:34.163 00:05:34.163 real 0m1.316s 00:05:34.163 user 0m1.232s 00:05:34.163 sys 0m0.076s 00:05:34.163 01:41:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.163 01:41:22 -- common/autotest_common.sh@10 -- # set +x 00:05:34.163 ************************************ 00:05:34.163 END TEST thread_poller_perf 00:05:34.163 ************************************ 00:05:34.163 01:41:22 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:34.163 00:05:34.163 real 0m2.830s 00:05:34.163 user 0m2.580s 00:05:34.163 sys 0m0.253s 00:05:34.163 01:41:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.163 01:41:22 -- common/autotest_common.sh@10 -- # set +x 00:05:34.163 ************************************ 00:05:34.163 END TEST thread 00:05:34.163 ************************************ 00:05:34.163 01:41:22 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:34.163 01:41:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.163 01:41:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.163 01:41:22 -- common/autotest_common.sh@10 -- # set +x 00:05:34.163 ************************************ 00:05:34.163 START TEST accel 00:05:34.163 ************************************ 00:05:34.163 01:41:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:34.163 * Looking for test storage... 00:05:34.163 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:34.163 01:41:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:34.163 01:41:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:34.163 01:41:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:34.163 01:41:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:34.163 01:41:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:34.163 01:41:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:34.163 01:41:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:34.163 01:41:22 -- scripts/common.sh@335 -- # IFS=.-: 00:05:34.163 01:41:22 -- scripts/common.sh@335 -- # read -ra ver1 00:05:34.163 01:41:22 -- scripts/common.sh@336 -- # IFS=.-: 00:05:34.163 01:41:22 -- scripts/common.sh@336 -- # read -ra ver2 00:05:34.163 01:41:22 -- scripts/common.sh@337 -- # local 'op=<' 00:05:34.163 01:41:22 -- scripts/common.sh@339 -- # ver1_l=2 00:05:34.163 01:41:22 -- scripts/common.sh@340 -- # ver2_l=1 00:05:34.163 01:41:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:34.163 01:41:22 -- scripts/common.sh@343 -- # case "$op" in 00:05:34.163 01:41:22 -- scripts/common.sh@344 -- # : 1 00:05:34.163 01:41:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:34.163 01:41:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:34.163 01:41:22 -- scripts/common.sh@364 -- # decimal 1 00:05:34.163 01:41:22 -- scripts/common.sh@352 -- # local d=1 00:05:34.163 01:41:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:34.163 01:41:22 -- scripts/common.sh@354 -- # echo 1 00:05:34.163 01:41:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:34.164 01:41:22 -- scripts/common.sh@365 -- # decimal 2 00:05:34.164 01:41:22 -- scripts/common.sh@352 -- # local d=2 00:05:34.164 01:41:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:34.164 01:41:22 -- scripts/common.sh@354 -- # echo 2 00:05:34.164 01:41:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:34.164 01:41:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:34.164 01:41:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:34.164 01:41:22 -- scripts/common.sh@367 -- # return 0 00:05:34.164 01:41:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:34.164 01:41:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:34.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.164 --rc genhtml_branch_coverage=1 00:05:34.164 --rc genhtml_function_coverage=1 00:05:34.164 --rc genhtml_legend=1 00:05:34.164 --rc geninfo_all_blocks=1 00:05:34.164 --rc geninfo_unexecuted_blocks=1 00:05:34.164 00:05:34.164 ' 00:05:34.164 01:41:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:34.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.164 --rc genhtml_branch_coverage=1 00:05:34.164 --rc genhtml_function_coverage=1 00:05:34.164 --rc genhtml_legend=1 00:05:34.164 --rc geninfo_all_blocks=1 00:05:34.164 --rc geninfo_unexecuted_blocks=1 00:05:34.164 00:05:34.164 ' 00:05:34.164 01:41:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:34.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.164 --rc genhtml_branch_coverage=1 00:05:34.164 --rc genhtml_function_coverage=1 00:05:34.164 --rc genhtml_legend=1 00:05:34.164 --rc geninfo_all_blocks=1 00:05:34.164 --rc geninfo_unexecuted_blocks=1 00:05:34.164 00:05:34.164 ' 00:05:34.164 01:41:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:34.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.164 --rc genhtml_branch_coverage=1 00:05:34.164 --rc genhtml_function_coverage=1 00:05:34.164 --rc genhtml_legend=1 00:05:34.164 --rc geninfo_all_blocks=1 00:05:34.164 --rc geninfo_unexecuted_blocks=1 00:05:34.164 00:05:34.164 ' 00:05:34.164 01:41:22 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:34.164 01:41:22 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:34.164 01:41:22 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:34.164 01:41:22 -- accel/accel.sh@59 -- # spdk_tgt_pid=3329361 00:05:34.164 01:41:22 -- accel/accel.sh@60 -- # waitforlisten 3329361 00:05:34.164 01:41:22 -- common/autotest_common.sh@829 -- # '[' -z 3329361 ']' 00:05:34.164 01:41:22 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:34.164 01:41:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.164 01:41:22 -- accel/accel.sh@58 -- # build_accel_config 00:05:34.164 01:41:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.164 01:41:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.164 01:41:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.164 01:41:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.164 01:41:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.164 01:41:22 -- common/autotest_common.sh@10 -- # set +x 00:05:34.164 01:41:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.164 01:41:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.164 01:41:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.164 01:41:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.164 01:41:22 -- accel/accel.sh@42 -- # jq -r . 00:05:34.164 [2024-11-19 01:41:22.513613] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.164 [2024-11-19 01:41:22.513738] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329361 ] 00:05:34.164 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.164 [2024-11-19 01:41:22.574570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.164 [2024-11-19 01:41:22.688163] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.164 [2024-11-19 01:41:22.688334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.100 01:41:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:35.100 01:41:23 -- common/autotest_common.sh@862 -- # return 0 00:05:35.100 01:41:23 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:35.100 01:41:23 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:35.100 01:41:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.100 01:41:23 -- common/autotest_common.sh@10 -- # set +x 00:05:35.100 01:41:23 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:35.100 01:41:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # IFS== 00:05:35.100 01:41:23 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.100 01:41:23 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.100 01:41:23 -- accel/accel.sh@67 -- # killprocess 3329361 00:05:35.100 01:41:23 -- common/autotest_common.sh@936 -- # '[' -z 3329361 ']' 00:05:35.100 01:41:23 -- common/autotest_common.sh@940 -- # kill -0 3329361 00:05:35.100 01:41:23 -- common/autotest_common.sh@941 -- # uname 00:05:35.100 01:41:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.100 01:41:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3329361 00:05:35.100 01:41:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.100 01:41:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.100 01:41:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3329361' 00:05:35.100 killing process with pid 3329361 00:05:35.100 01:41:23 -- common/autotest_common.sh@955 -- # kill 3329361 00:05:35.100 01:41:23 -- common/autotest_common.sh@960 -- # wait 3329361 00:05:35.670 01:41:23 -- accel/accel.sh@68 -- # trap - ERR 00:05:35.670 01:41:23 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:35.670 01:41:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:35.670 01:41:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.670 01:41:23 -- common/autotest_common.sh@10 -- # set +x 00:05:35.670 01:41:24 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:35.670 01:41:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:35.670 01:41:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.670 01:41:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.670 01:41:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.670 01:41:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.670 01:41:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.670 01:41:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.670 01:41:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.670 01:41:24 -- accel/accel.sh@42 -- # jq -r . 00:05:35.670 01:41:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.670 01:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:35.670 01:41:24 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:35.670 01:41:24 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:35.670 01:41:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.670 01:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:35.670 ************************************ 00:05:35.670 START TEST accel_missing_filename 00:05:35.670 ************************************ 00:05:35.670 01:41:24 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:35.670 01:41:24 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.670 01:41:24 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:35.670 01:41:24 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.670 01:41:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.670 01:41:24 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.670 01:41:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.670 01:41:24 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:35.670 01:41:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:35.670 01:41:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.670 01:41:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.670 01:41:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.670 01:41:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.670 01:41:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.670 01:41:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.670 01:41:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.670 01:41:24 -- accel/accel.sh@42 -- # jq -r . 00:05:35.670 [2024-11-19 01:41:24.068161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.670 [2024-11-19 01:41:24.068246] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329543 ] 00:05:35.670 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.670 [2024-11-19 01:41:24.130565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.929 [2024-11-19 01:41:24.246833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.929 [2024-11-19 01:41:24.308831] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:35.929 [2024-11-19 01:41:24.396245] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:36.189 A filename is required. 00:05:36.189 01:41:24 -- common/autotest_common.sh@653 -- # es=234 00:05:36.189 01:41:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.189 01:41:24 -- common/autotest_common.sh@662 -- # es=106 00:05:36.189 01:41:24 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:36.189 01:41:24 -- common/autotest_common.sh@670 -- # es=1 00:05:36.189 01:41:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.189 00:05:36.189 real 0m0.467s 00:05:36.189 user 0m0.354s 00:05:36.189 sys 0m0.145s 00:05:36.189 01:41:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.189 01:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:36.189 ************************************ 00:05:36.189 END TEST accel_missing_filename 00:05:36.189 ************************************ 00:05:36.189 01:41:24 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.189 01:41:24 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:36.189 01:41:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.189 01:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:36.189 ************************************ 00:05:36.189 START TEST accel_compress_verify 00:05:36.189 ************************************ 00:05:36.189 01:41:24 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.189 01:41:24 -- common/autotest_common.sh@650 -- # local es=0 00:05:36.189 01:41:24 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.189 01:41:24 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:36.189 01:41:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.189 01:41:24 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:36.189 01:41:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.189 01:41:24 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.189 01:41:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.189 01:41:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.189 01:41:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.189 01:41:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.189 01:41:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.189 01:41:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.189 01:41:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.189 01:41:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.189 01:41:24 -- accel/accel.sh@42 -- # jq -r . 00:05:36.189 [2024-11-19 01:41:24.564462] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.189 [2024-11-19 01:41:24.564552] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329683 ] 00:05:36.189 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.189 [2024-11-19 01:41:24.627766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.449 [2024-11-19 01:41:24.744121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.449 [2024-11-19 01:41:24.806088] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:36.449 [2024-11-19 01:41:24.881369] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:36.710 00:05:36.710 Compression does not support the verify option, aborting. 00:05:36.710 01:41:25 -- common/autotest_common.sh@653 -- # es=161 00:05:36.710 01:41:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.710 01:41:25 -- common/autotest_common.sh@662 -- # es=33 00:05:36.710 01:41:25 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:36.710 01:41:25 -- common/autotest_common.sh@670 -- # es=1 00:05:36.710 01:41:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.710 00:05:36.710 real 0m0.464s 00:05:36.710 user 0m0.360s 00:05:36.710 sys 0m0.139s 00:05:36.710 01:41:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.710 01:41:25 -- common/autotest_common.sh@10 -- # set +x 00:05:36.710 ************************************ 00:05:36.710 END TEST accel_compress_verify 00:05:36.710 ************************************ 00:05:36.710 01:41:25 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:36.710 01:41:25 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:36.710 01:41:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.710 01:41:25 -- common/autotest_common.sh@10 -- # set +x 00:05:36.711 ************************************ 00:05:36.711 START TEST accel_wrong_workload 00:05:36.711 ************************************ 00:05:36.711 01:41:25 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:36.711 01:41:25 -- common/autotest_common.sh@650 -- # local es=0 00:05:36.711 01:41:25 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:36.711 01:41:25 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:36.711 01:41:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.711 01:41:25 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:36.711 01:41:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.711 01:41:25 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:36.711 01:41:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:36.711 01:41:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.711 01:41:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.711 01:41:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.711 01:41:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.711 01:41:25 -- accel/accel.sh@42 -- # jq -r . 00:05:36.711 Unsupported workload type: foobar 00:05:36.711 [2024-11-19 01:41:25.052993] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:36.711 accel_perf options: 00:05:36.711 [-h help message] 00:05:36.711 [-q queue depth per core] 00:05:36.711 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:36.711 [-T number of threads per core 00:05:36.711 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:36.711 [-t time in seconds] 00:05:36.711 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:36.711 [ dif_verify, , dif_generate, dif_generate_copy 00:05:36.711 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:36.711 [-l for compress/decompress workloads, name of uncompressed input file 00:05:36.711 [-S for crc32c workload, use this seed value (default 0) 00:05:36.711 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:36.711 [-f for fill workload, use this BYTE value (default 255) 00:05:36.711 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:36.711 [-y verify result if this switch is on] 00:05:36.711 [-a tasks to allocate per core (default: same value as -q)] 00:05:36.711 Can be used to spread operations across a wider range of memory. 00:05:36.711 01:41:25 -- common/autotest_common.sh@653 -- # es=1 00:05:36.711 01:41:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.711 01:41:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:36.711 01:41:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.711 00:05:36.711 real 0m0.025s 00:05:36.711 user 0m0.012s 00:05:36.711 sys 0m0.013s 00:05:36.711 01:41:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.711 01:41:25 -- common/autotest_common.sh@10 -- # set +x 00:05:36.711 ************************************ 00:05:36.711 END TEST accel_wrong_workload 00:05:36.711 ************************************ 00:05:36.711 Error: writing output failed: Broken pipe 00:05:36.711 01:41:25 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.711 01:41:25 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:36.711 01:41:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.711 01:41:25 -- common/autotest_common.sh@10 -- # set +x 00:05:36.711 ************************************ 00:05:36.711 START TEST accel_negative_buffers 00:05:36.711 ************************************ 00:05:36.711 01:41:25 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.711 01:41:25 -- common/autotest_common.sh@650 -- # local es=0 00:05:36.711 01:41:25 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:36.711 01:41:25 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:36.711 01:41:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.711 01:41:25 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:36.711 01:41:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.711 01:41:25 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:36.711 01:41:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:36.711 01:41:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.711 01:41:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.711 01:41:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.711 01:41:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.711 01:41:25 -- accel/accel.sh@42 -- # jq -r . 00:05:36.711 -x option must be non-negative. 00:05:36.711 [2024-11-19 01:41:25.099875] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:36.711 accel_perf options: 00:05:36.711 [-h help message] 00:05:36.711 [-q queue depth per core] 00:05:36.711 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:36.711 [-T number of threads per core 00:05:36.711 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:36.711 [-t time in seconds] 00:05:36.711 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:36.711 [ dif_verify, , dif_generate, dif_generate_copy 00:05:36.711 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:36.711 [-l for compress/decompress workloads, name of uncompressed input file 00:05:36.711 [-S for crc32c workload, use this seed value (default 0) 00:05:36.711 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:36.711 [-f for fill workload, use this BYTE value (default 255) 00:05:36.711 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:36.711 [-y verify result if this switch is on] 00:05:36.711 [-a tasks to allocate per core (default: same value as -q)] 00:05:36.711 Can be used to spread operations across a wider range of memory. 00:05:36.711 01:41:25 -- common/autotest_common.sh@653 -- # es=1 00:05:36.711 01:41:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.711 01:41:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:36.711 01:41:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.711 00:05:36.711 real 0m0.024s 00:05:36.711 user 0m0.013s 00:05:36.711 sys 0m0.011s 00:05:36.711 01:41:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.711 01:41:25 -- common/autotest_common.sh@10 -- # set +x 00:05:36.711 ************************************ 00:05:36.711 END TEST accel_negative_buffers 00:05:36.711 ************************************ 00:05:36.711 Error: writing output failed: Broken pipe 00:05:36.711 01:41:25 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:36.711 01:41:25 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:36.711 01:41:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.711 01:41:25 -- common/autotest_common.sh@10 -- # set +x 00:05:36.711 ************************************ 00:05:36.711 START TEST accel_crc32c 00:05:36.711 ************************************ 00:05:36.711 01:41:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:36.711 01:41:25 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.711 01:41:25 -- accel/accel.sh@17 -- # local accel_module 00:05:36.711 01:41:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:36.711 01:41:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:36.711 01:41:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.711 01:41:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.711 01:41:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.711 01:41:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.711 01:41:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.711 01:41:25 -- accel/accel.sh@42 -- # jq -r . 00:05:36.711 [2024-11-19 01:41:25.148925] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.711 [2024-11-19 01:41:25.149001] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329752 ] 00:05:36.711 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.711 [2024-11-19 01:41:25.212158] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.971 [2024-11-19 01:41:25.329464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.352 01:41:26 -- accel/accel.sh@18 -- # out=' 00:05:38.352 SPDK Configuration: 00:05:38.352 Core mask: 0x1 00:05:38.352 00:05:38.352 Accel Perf Configuration: 00:05:38.352 Workload Type: crc32c 00:05:38.352 CRC-32C seed: 32 00:05:38.352 Transfer size: 4096 bytes 00:05:38.352 Vector count 1 00:05:38.352 Module: software 00:05:38.352 Queue depth: 32 00:05:38.352 Allocate depth: 32 00:05:38.352 # threads/core: 1 00:05:38.352 Run time: 1 seconds 00:05:38.352 Verify: Yes 00:05:38.352 00:05:38.352 Running for 1 seconds... 00:05:38.352 00:05:38.352 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.352 ------------------------------------------------------------------------------------ 00:05:38.352 0,0 407776/s 1592 MiB/s 0 0 00:05:38.352 ==================================================================================== 00:05:38.353 Total 407776/s 1592 MiB/s 0 0' 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:38.353 01:41:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.353 01:41:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.353 01:41:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.353 01:41:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.353 01:41:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.353 01:41:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.353 01:41:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.353 01:41:26 -- accel/accel.sh@42 -- # jq -r . 00:05:38.353 [2024-11-19 01:41:26.628497] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.353 [2024-11-19 01:41:26.628574] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329890 ] 00:05:38.353 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.353 [2024-11-19 01:41:26.689760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.353 [2024-11-19 01:41:26.805043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val= 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val= 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=0x1 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val= 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val= 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=crc32c 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=32 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val= 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=software 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=32 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=32 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=1 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val=Yes 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val= 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:38.353 01:41:26 -- accel/accel.sh@21 -- # val= 00:05:38.353 01:41:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # IFS=: 00:05:38.353 01:41:26 -- accel/accel.sh@20 -- # read -r var val 00:05:39.728 01:41:28 -- accel/accel.sh@21 -- # val= 00:05:39.728 01:41:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # IFS=: 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.728 01:41:28 -- accel/accel.sh@21 -- # val= 00:05:39.728 01:41:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # IFS=: 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.728 01:41:28 -- accel/accel.sh@21 -- # val= 00:05:39.728 01:41:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # IFS=: 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.728 01:41:28 -- accel/accel.sh@21 -- # val= 00:05:39.728 01:41:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # IFS=: 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.728 01:41:28 -- accel/accel.sh@21 -- # val= 00:05:39.728 01:41:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # IFS=: 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.728 01:41:28 -- accel/accel.sh@21 -- # val= 00:05:39.728 01:41:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # IFS=: 00:05:39.728 01:41:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.728 01:41:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.728 01:41:28 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:39.728 01:41:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.728 00:05:39.728 real 0m2.950s 00:05:39.728 user 0m2.641s 00:05:39.728 sys 0m0.301s 00:05:39.728 01:41:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.728 01:41:28 -- common/autotest_common.sh@10 -- # set +x 00:05:39.728 ************************************ 00:05:39.728 END TEST accel_crc32c 00:05:39.728 ************************************ 00:05:39.728 01:41:28 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:39.728 01:41:28 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:39.728 01:41:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.728 01:41:28 -- common/autotest_common.sh@10 -- # set +x 00:05:39.728 ************************************ 00:05:39.728 START TEST accel_crc32c_C2 00:05:39.728 ************************************ 00:05:39.728 01:41:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:39.728 01:41:28 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.728 01:41:28 -- accel/accel.sh@17 -- # local accel_module 00:05:39.728 01:41:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:39.728 01:41:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:39.728 01:41:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.728 01:41:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.728 01:41:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.728 01:41:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.728 01:41:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.728 01:41:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.728 01:41:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.728 01:41:28 -- accel/accel.sh@42 -- # jq -r . 00:05:39.728 [2024-11-19 01:41:28.124332] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.728 [2024-11-19 01:41:28.124408] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330172 ] 00:05:39.728 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.728 [2024-11-19 01:41:28.185620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.987 [2024-11-19 01:41:28.300573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.368 01:41:29 -- accel/accel.sh@18 -- # out=' 00:05:41.368 SPDK Configuration: 00:05:41.368 Core mask: 0x1 00:05:41.368 00:05:41.368 Accel Perf Configuration: 00:05:41.368 Workload Type: crc32c 00:05:41.368 CRC-32C seed: 0 00:05:41.368 Transfer size: 4096 bytes 00:05:41.368 Vector count 2 00:05:41.368 Module: software 00:05:41.368 Queue depth: 32 00:05:41.368 Allocate depth: 32 00:05:41.368 # threads/core: 1 00:05:41.368 Run time: 1 seconds 00:05:41.368 Verify: Yes 00:05:41.368 00:05:41.368 Running for 1 seconds... 00:05:41.368 00:05:41.368 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.368 ------------------------------------------------------------------------------------ 00:05:41.368 0,0 316192/s 2470 MiB/s 0 0 00:05:41.368 ==================================================================================== 00:05:41.368 Total 316192/s 1235 MiB/s 0 0' 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:41.368 01:41:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.368 01:41:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.368 01:41:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.368 01:41:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.368 01:41:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.368 01:41:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.368 01:41:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.368 01:41:29 -- accel/accel.sh@42 -- # jq -r . 00:05:41.368 [2024-11-19 01:41:29.590512] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.368 [2024-11-19 01:41:29.590589] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330318 ] 00:05:41.368 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.368 [2024-11-19 01:41:29.652440] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.368 [2024-11-19 01:41:29.769163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val= 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val= 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val=0x1 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val= 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val= 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val=crc32c 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.368 01:41:29 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val=0 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.368 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.368 01:41:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.368 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val= 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val=software 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val=32 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val=32 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val=1 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val=Yes 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val= 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.369 01:41:29 -- accel/accel.sh@21 -- # val= 00:05:41.369 01:41:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.369 01:41:29 -- accel/accel.sh@20 -- # read -r var val 00:05:42.746 01:41:31 -- accel/accel.sh@21 -- # val= 00:05:42.746 01:41:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # IFS=: 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.746 01:41:31 -- accel/accel.sh@21 -- # val= 00:05:42.746 01:41:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # IFS=: 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.746 01:41:31 -- accel/accel.sh@21 -- # val= 00:05:42.746 01:41:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # IFS=: 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.746 01:41:31 -- accel/accel.sh@21 -- # val= 00:05:42.746 01:41:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # IFS=: 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.746 01:41:31 -- accel/accel.sh@21 -- # val= 00:05:42.746 01:41:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # IFS=: 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.746 01:41:31 -- accel/accel.sh@21 -- # val= 00:05:42.746 01:41:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # IFS=: 00:05:42.746 01:41:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.746 01:41:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.746 01:41:31 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:42.746 01:41:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.746 00:05:42.746 real 0m2.944s 00:05:42.746 user 0m2.634s 00:05:42.746 sys 0m0.301s 00:05:42.746 01:41:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.746 01:41:31 -- common/autotest_common.sh@10 -- # set +x 00:05:42.746 ************************************ 00:05:42.746 END TEST accel_crc32c_C2 00:05:42.746 ************************************ 00:05:42.746 01:41:31 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:42.746 01:41:31 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:42.746 01:41:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.746 01:41:31 -- common/autotest_common.sh@10 -- # set +x 00:05:42.746 ************************************ 00:05:42.746 START TEST accel_copy 00:05:42.746 ************************************ 00:05:42.746 01:41:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:42.746 01:41:31 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.747 01:41:31 -- accel/accel.sh@17 -- # local accel_module 00:05:42.747 01:41:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:42.747 01:41:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:42.747 01:41:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.747 01:41:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.747 01:41:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.747 01:41:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.747 01:41:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.747 01:41:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.747 01:41:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.747 01:41:31 -- accel/accel.sh@42 -- # jq -r . 00:05:42.747 [2024-11-19 01:41:31.094167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.747 [2024-11-19 01:41:31.094244] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330479 ] 00:05:42.747 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.747 [2024-11-19 01:41:31.154666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.747 [2024-11-19 01:41:31.270375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.124 01:41:32 -- accel/accel.sh@18 -- # out=' 00:05:44.124 SPDK Configuration: 00:05:44.124 Core mask: 0x1 00:05:44.124 00:05:44.124 Accel Perf Configuration: 00:05:44.124 Workload Type: copy 00:05:44.124 Transfer size: 4096 bytes 00:05:44.124 Vector count 1 00:05:44.124 Module: software 00:05:44.124 Queue depth: 32 00:05:44.124 Allocate depth: 32 00:05:44.124 # threads/core: 1 00:05:44.124 Run time: 1 seconds 00:05:44.124 Verify: Yes 00:05:44.124 00:05:44.124 Running for 1 seconds... 00:05:44.124 00:05:44.124 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.124 ------------------------------------------------------------------------------------ 00:05:44.124 0,0 281792/s 1100 MiB/s 0 0 00:05:44.124 ==================================================================================== 00:05:44.124 Total 281792/s 1100 MiB/s 0 0' 00:05:44.124 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.124 01:41:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:44.124 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.124 01:41:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:44.124 01:41:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.124 01:41:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.124 01:41:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.124 01:41:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.124 01:41:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.124 01:41:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.124 01:41:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.124 01:41:32 -- accel/accel.sh@42 -- # jq -r . 00:05:44.124 [2024-11-19 01:41:32.558181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.124 [2024-11-19 01:41:32.558261] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330736 ] 00:05:44.124 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.124 [2024-11-19 01:41:32.620410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.382 [2024-11-19 01:41:32.736321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val= 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val= 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val=0x1 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val= 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val= 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val=copy 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val= 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val=software 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val=32 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val=32 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val=1 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val=Yes 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val= 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.382 01:41:32 -- accel/accel.sh@21 -- # val= 00:05:44.382 01:41:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.382 01:41:32 -- accel/accel.sh@20 -- # read -r var val 00:05:45.760 01:41:33 -- accel/accel.sh@21 -- # val= 00:05:45.760 01:41:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.760 01:41:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.760 01:41:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.760 01:41:34 -- accel/accel.sh@21 -- # val= 00:05:45.760 01:41:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # IFS=: 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.760 01:41:34 -- accel/accel.sh@21 -- # val= 00:05:45.760 01:41:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # IFS=: 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.760 01:41:34 -- accel/accel.sh@21 -- # val= 00:05:45.760 01:41:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # IFS=: 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.760 01:41:34 -- accel/accel.sh@21 -- # val= 00:05:45.760 01:41:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # IFS=: 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.760 01:41:34 -- accel/accel.sh@21 -- # val= 00:05:45.760 01:41:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # IFS=: 00:05:45.760 01:41:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.760 01:41:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.760 01:41:34 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:45.760 01:41:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.760 00:05:45.760 real 0m2.929s 00:05:45.760 user 0m2.626s 00:05:45.760 sys 0m0.293s 00:05:45.760 01:41:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.760 01:41:34 -- common/autotest_common.sh@10 -- # set +x 00:05:45.760 ************************************ 00:05:45.760 END TEST accel_copy 00:05:45.760 ************************************ 00:05:45.760 01:41:34 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.760 01:41:34 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:45.760 01:41:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.760 01:41:34 -- common/autotest_common.sh@10 -- # set +x 00:05:45.760 ************************************ 00:05:45.760 START TEST accel_fill 00:05:45.760 ************************************ 00:05:45.760 01:41:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.760 01:41:34 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.760 01:41:34 -- accel/accel.sh@17 -- # local accel_module 00:05:45.760 01:41:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.760 01:41:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.760 01:41:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.760 01:41:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.760 01:41:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.760 01:41:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.760 01:41:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.760 01:41:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.760 01:41:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.760 01:41:34 -- accel/accel.sh@42 -- # jq -r . 00:05:45.760 [2024-11-19 01:41:34.047149] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.760 [2024-11-19 01:41:34.047223] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330900 ] 00:05:45.760 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.760 [2024-11-19 01:41:34.108508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.760 [2024-11-19 01:41:34.225304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.140 01:41:35 -- accel/accel.sh@18 -- # out=' 00:05:47.140 SPDK Configuration: 00:05:47.140 Core mask: 0x1 00:05:47.140 00:05:47.140 Accel Perf Configuration: 00:05:47.140 Workload Type: fill 00:05:47.140 Fill pattern: 0x80 00:05:47.140 Transfer size: 4096 bytes 00:05:47.140 Vector count 1 00:05:47.140 Module: software 00:05:47.140 Queue depth: 64 00:05:47.140 Allocate depth: 64 00:05:47.140 # threads/core: 1 00:05:47.140 Run time: 1 seconds 00:05:47.140 Verify: Yes 00:05:47.140 00:05:47.140 Running for 1 seconds... 00:05:47.140 00:05:47.140 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.140 ------------------------------------------------------------------------------------ 00:05:47.140 0,0 402560/s 1572 MiB/s 0 0 00:05:47.140 ==================================================================================== 00:05:47.140 Total 402560/s 1572 MiB/s 0 0' 00:05:47.140 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.140 01:41:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:47.140 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.140 01:41:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:47.140 01:41:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.140 01:41:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.140 01:41:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.140 01:41:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.140 01:41:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.140 01:41:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.140 01:41:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.140 01:41:35 -- accel/accel.sh@42 -- # jq -r . 00:05:47.140 [2024-11-19 01:41:35.520969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.140 [2024-11-19 01:41:35.521047] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331045 ] 00:05:47.140 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.140 [2024-11-19 01:41:35.581575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.400 [2024-11-19 01:41:35.698177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val= 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val= 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=0x1 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val= 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val= 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=fill 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=0x80 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val= 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=software 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=64 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=64 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=1 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val=Yes 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val= 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.400 01:41:35 -- accel/accel.sh@21 -- # val= 00:05:47.400 01:41:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.400 01:41:35 -- accel/accel.sh@20 -- # read -r var val 00:05:48.879 01:41:36 -- accel/accel.sh@21 -- # val= 00:05:48.879 01:41:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.879 01:41:36 -- accel/accel.sh@21 -- # val= 00:05:48.879 01:41:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.879 01:41:36 -- accel/accel.sh@21 -- # val= 00:05:48.879 01:41:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.879 01:41:36 -- accel/accel.sh@21 -- # val= 00:05:48.879 01:41:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.879 01:41:36 -- accel/accel.sh@21 -- # val= 00:05:48.879 01:41:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.879 01:41:36 -- accel/accel.sh@21 -- # val= 00:05:48.879 01:41:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.879 01:41:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.879 01:41:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.879 01:41:36 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:48.879 01:41:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.879 00:05:48.879 real 0m2.951s 00:05:48.879 user 0m2.666s 00:05:48.879 sys 0m0.275s 00:05:48.879 01:41:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.879 01:41:36 -- common/autotest_common.sh@10 -- # set +x 00:05:48.879 ************************************ 00:05:48.879 END TEST accel_fill 00:05:48.879 ************************************ 00:05:48.879 01:41:37 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:48.879 01:41:37 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:48.879 01:41:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.879 01:41:37 -- common/autotest_common.sh@10 -- # set +x 00:05:48.879 ************************************ 00:05:48.879 START TEST accel_copy_crc32c 00:05:48.879 ************************************ 00:05:48.879 01:41:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:48.879 01:41:37 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.879 01:41:37 -- accel/accel.sh@17 -- # local accel_module 00:05:48.879 01:41:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:48.879 01:41:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:48.879 01:41:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.879 01:41:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.879 01:41:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.879 01:41:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.879 01:41:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.879 01:41:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.879 01:41:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.879 01:41:37 -- accel/accel.sh@42 -- # jq -r . 00:05:48.879 [2024-11-19 01:41:37.020475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.879 [2024-11-19 01:41:37.020554] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331322 ] 00:05:48.879 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.879 [2024-11-19 01:41:37.080767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.879 [2024-11-19 01:41:37.197977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.259 01:41:38 -- accel/accel.sh@18 -- # out=' 00:05:50.259 SPDK Configuration: 00:05:50.259 Core mask: 0x1 00:05:50.259 00:05:50.259 Accel Perf Configuration: 00:05:50.259 Workload Type: copy_crc32c 00:05:50.259 CRC-32C seed: 0 00:05:50.259 Vector size: 4096 bytes 00:05:50.259 Transfer size: 4096 bytes 00:05:50.259 Vector count 1 00:05:50.259 Module: software 00:05:50.259 Queue depth: 32 00:05:50.259 Allocate depth: 32 00:05:50.259 # threads/core: 1 00:05:50.259 Run time: 1 seconds 00:05:50.259 Verify: Yes 00:05:50.259 00:05:50.259 Running for 1 seconds... 00:05:50.259 00:05:50.259 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.259 ------------------------------------------------------------------------------------ 00:05:50.259 0,0 216352/s 845 MiB/s 0 0 00:05:50.259 ==================================================================================== 00:05:50.259 Total 216352/s 845 MiB/s 0 0' 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.259 01:41:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.259 01:41:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:50.259 01:41:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.259 01:41:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.259 01:41:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.259 01:41:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.259 01:41:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.259 01:41:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.259 01:41:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.259 01:41:38 -- accel/accel.sh@42 -- # jq -r . 00:05:50.259 [2024-11-19 01:41:38.491683] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.259 [2024-11-19 01:41:38.491764] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331476 ] 00:05:50.259 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.259 [2024-11-19 01:41:38.557047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.259 [2024-11-19 01:41:38.676500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.259 01:41:38 -- accel/accel.sh@21 -- # val= 00:05:50.259 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.259 01:41:38 -- accel/accel.sh@21 -- # val= 00:05:50.259 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.259 01:41:38 -- accel/accel.sh@21 -- # val=0x1 00:05:50.259 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.259 01:41:38 -- accel/accel.sh@21 -- # val= 00:05:50.259 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.259 01:41:38 -- accel/accel.sh@21 -- # val= 00:05:50.259 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.259 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val=0 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val= 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val=software 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val=32 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val=32 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val=1 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val=Yes 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val= 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:50.260 01:41:38 -- accel/accel.sh@21 -- # val= 00:05:50.260 01:41:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # IFS=: 00:05:50.260 01:41:38 -- accel/accel.sh@20 -- # read -r var val 00:05:51.648 01:41:39 -- accel/accel.sh@21 -- # val= 00:05:51.648 01:41:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.648 01:41:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.648 01:41:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.648 01:41:39 -- accel/accel.sh@21 -- # val= 00:05:51.648 01:41:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.648 01:41:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.648 01:41:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.648 01:41:39 -- accel/accel.sh@21 -- # val= 00:05:51.648 01:41:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.649 01:41:39 -- accel/accel.sh@21 -- # val= 00:05:51.649 01:41:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.649 01:41:39 -- accel/accel.sh@21 -- # val= 00:05:51.649 01:41:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.649 01:41:39 -- accel/accel.sh@21 -- # val= 00:05:51.649 01:41:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.649 01:41:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.649 01:41:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:51.649 01:41:39 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:51.649 01:41:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.649 00:05:51.649 real 0m2.958s 00:05:51.649 user 0m2.651s 00:05:51.649 sys 0m0.297s 00:05:51.649 01:41:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.649 01:41:39 -- common/autotest_common.sh@10 -- # set +x 00:05:51.649 ************************************ 00:05:51.649 END TEST accel_copy_crc32c 00:05:51.649 ************************************ 00:05:51.649 01:41:39 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:51.649 01:41:39 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:51.649 01:41:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.649 01:41:39 -- common/autotest_common.sh@10 -- # set +x 00:05:51.649 ************************************ 00:05:51.649 START TEST accel_copy_crc32c_C2 00:05:51.649 ************************************ 00:05:51.649 01:41:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:51.649 01:41:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:51.649 01:41:39 -- accel/accel.sh@17 -- # local accel_module 00:05:51.649 01:41:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:51.649 01:41:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:51.649 01:41:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.649 01:41:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.649 01:41:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.649 01:41:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.649 01:41:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.649 01:41:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.649 01:41:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.649 01:41:39 -- accel/accel.sh@42 -- # jq -r . 00:05:51.649 [2024-11-19 01:41:40.006966] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.649 [2024-11-19 01:41:40.007044] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331632 ] 00:05:51.649 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.649 [2024-11-19 01:41:40.075324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.909 [2024-11-19 01:41:40.197613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.289 01:41:41 -- accel/accel.sh@18 -- # out=' 00:05:53.289 SPDK Configuration: 00:05:53.289 Core mask: 0x1 00:05:53.289 00:05:53.289 Accel Perf Configuration: 00:05:53.289 Workload Type: copy_crc32c 00:05:53.289 CRC-32C seed: 0 00:05:53.289 Vector size: 4096 bytes 00:05:53.289 Transfer size: 8192 bytes 00:05:53.289 Vector count 2 00:05:53.289 Module: software 00:05:53.289 Queue depth: 32 00:05:53.289 Allocate depth: 32 00:05:53.289 # threads/core: 1 00:05:53.289 Run time: 1 seconds 00:05:53.289 Verify: Yes 00:05:53.289 00:05:53.289 Running for 1 seconds... 00:05:53.289 00:05:53.289 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.289 ------------------------------------------------------------------------------------ 00:05:53.289 0,0 154624/s 1208 MiB/s 0 0 00:05:53.289 ==================================================================================== 00:05:53.289 Total 154624/s 604 MiB/s 0 0' 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:53.289 01:41:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.289 01:41:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.289 01:41:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.289 01:41:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.289 01:41:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.289 01:41:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.289 01:41:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.289 01:41:41 -- accel/accel.sh@42 -- # jq -r . 00:05:53.289 [2024-11-19 01:41:41.499818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.289 [2024-11-19 01:41:41.499900] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331845 ] 00:05:53.289 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.289 [2024-11-19 01:41:41.562981] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.289 [2024-11-19 01:41:41.683320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val= 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val= 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val=0x1 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val= 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val= 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val=0 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val= 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val=software 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.289 01:41:41 -- accel/accel.sh@21 -- # val=32 00:05:53.289 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.289 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.290 01:41:41 -- accel/accel.sh@21 -- # val=32 00:05:53.290 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.290 01:41:41 -- accel/accel.sh@21 -- # val=1 00:05:53.290 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.290 01:41:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.290 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.290 01:41:41 -- accel/accel.sh@21 -- # val=Yes 00:05:53.290 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.290 01:41:41 -- accel/accel.sh@21 -- # val= 00:05:53.290 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:53.290 01:41:41 -- accel/accel.sh@21 -- # val= 00:05:53.290 01:41:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # IFS=: 00:05:53.290 01:41:41 -- accel/accel.sh@20 -- # read -r var val 00:05:54.672 01:41:42 -- accel/accel.sh@21 -- # val= 00:05:54.672 01:41:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.672 01:41:42 -- accel/accel.sh@21 -- # val= 00:05:54.672 01:41:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.672 01:41:42 -- accel/accel.sh@21 -- # val= 00:05:54.672 01:41:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.672 01:41:42 -- accel/accel.sh@21 -- # val= 00:05:54.672 01:41:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.672 01:41:42 -- accel/accel.sh@21 -- # val= 00:05:54.672 01:41:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.672 01:41:42 -- accel/accel.sh@21 -- # val= 00:05:54.672 01:41:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.672 01:41:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.672 01:41:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.672 01:41:42 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:54.672 01:41:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.672 00:05:54.672 real 0m2.979s 00:05:54.672 user 0m2.665s 00:05:54.672 sys 0m0.303s 00:05:54.672 01:41:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.672 01:41:42 -- common/autotest_common.sh@10 -- # set +x 00:05:54.672 ************************************ 00:05:54.672 END TEST accel_copy_crc32c_C2 00:05:54.672 ************************************ 00:05:54.672 01:41:42 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:54.672 01:41:42 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:54.672 01:41:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.672 01:41:42 -- common/autotest_common.sh@10 -- # set +x 00:05:54.672 ************************************ 00:05:54.672 START TEST accel_dualcast 00:05:54.672 ************************************ 00:05:54.672 01:41:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:54.672 01:41:42 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.672 01:41:42 -- accel/accel.sh@17 -- # local accel_module 00:05:54.672 01:41:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:54.672 01:41:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:54.672 01:41:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.672 01:41:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.672 01:41:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.672 01:41:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.672 01:41:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.672 01:41:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.672 01:41:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.672 01:41:42 -- accel/accel.sh@42 -- # jq -r . 00:05:54.672 [2024-11-19 01:41:43.012764] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.672 [2024-11-19 01:41:43.012843] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332054 ] 00:05:54.672 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.672 [2024-11-19 01:41:43.078406] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.672 [2024-11-19 01:41:43.195998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.049 01:41:44 -- accel/accel.sh@18 -- # out=' 00:05:56.049 SPDK Configuration: 00:05:56.049 Core mask: 0x1 00:05:56.049 00:05:56.049 Accel Perf Configuration: 00:05:56.049 Workload Type: dualcast 00:05:56.049 Transfer size: 4096 bytes 00:05:56.049 Vector count 1 00:05:56.049 Module: software 00:05:56.049 Queue depth: 32 00:05:56.049 Allocate depth: 32 00:05:56.049 # threads/core: 1 00:05:56.049 Run time: 1 seconds 00:05:56.049 Verify: Yes 00:05:56.049 00:05:56.049 Running for 1 seconds... 00:05:56.049 00:05:56.049 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.049 ------------------------------------------------------------------------------------ 00:05:56.049 0,0 295904/s 1155 MiB/s 0 0 00:05:56.049 ==================================================================================== 00:05:56.049 Total 295904/s 1155 MiB/s 0 0' 00:05:56.049 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.049 01:41:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:56.049 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.049 01:41:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:56.049 01:41:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.049 01:41:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.049 01:41:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.049 01:41:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.049 01:41:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.049 01:41:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.049 01:41:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.049 01:41:44 -- accel/accel.sh@42 -- # jq -r . 00:05:56.049 [2024-11-19 01:41:44.498982] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.049 [2024-11-19 01:41:44.499063] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332204 ] 00:05:56.049 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.049 [2024-11-19 01:41:44.561769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.307 [2024-11-19 01:41:44.682623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val= 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val= 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val=0x1 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val= 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val= 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val=dualcast 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val= 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val=software 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.307 01:41:44 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.307 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.307 01:41:44 -- accel/accel.sh@21 -- # val=32 00:05:56.307 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.308 01:41:44 -- accel/accel.sh@21 -- # val=32 00:05:56.308 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.308 01:41:44 -- accel/accel.sh@21 -- # val=1 00:05:56.308 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.308 01:41:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.308 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.308 01:41:44 -- accel/accel.sh@21 -- # val=Yes 00:05:56.308 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.308 01:41:44 -- accel/accel.sh@21 -- # val= 00:05:56.308 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:56.308 01:41:44 -- accel/accel.sh@21 -- # val= 00:05:56.308 01:41:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # IFS=: 00:05:56.308 01:41:44 -- accel/accel.sh@20 -- # read -r var val 00:05:57.686 01:41:45 -- accel/accel.sh@21 -- # val= 00:05:57.686 01:41:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.686 01:41:45 -- accel/accel.sh@21 -- # val= 00:05:57.686 01:41:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.686 01:41:45 -- accel/accel.sh@21 -- # val= 00:05:57.686 01:41:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.686 01:41:45 -- accel/accel.sh@21 -- # val= 00:05:57.686 01:41:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.686 01:41:45 -- accel/accel.sh@21 -- # val= 00:05:57.686 01:41:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.686 01:41:45 -- accel/accel.sh@21 -- # val= 00:05:57.686 01:41:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.686 01:41:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.686 01:41:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.686 01:41:45 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:57.686 01:41:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.686 00:05:57.686 real 0m2.973s 00:05:57.686 user 0m2.675s 00:05:57.686 sys 0m0.289s 00:05:57.686 01:41:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.686 01:41:45 -- common/autotest_common.sh@10 -- # set +x 00:05:57.686 ************************************ 00:05:57.686 END TEST accel_dualcast 00:05:57.686 ************************************ 00:05:57.686 01:41:45 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:57.686 01:41:45 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:57.686 01:41:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.686 01:41:45 -- common/autotest_common.sh@10 -- # set +x 00:05:57.686 ************************************ 00:05:57.686 START TEST accel_compare 00:05:57.686 ************************************ 00:05:57.686 01:41:45 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:57.686 01:41:45 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.686 01:41:45 -- accel/accel.sh@17 -- # local accel_module 00:05:57.686 01:41:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:57.686 01:41:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:57.686 01:41:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.686 01:41:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.686 01:41:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.686 01:41:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.686 01:41:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.686 01:41:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.686 01:41:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.686 01:41:45 -- accel/accel.sh@42 -- # jq -r . 00:05:57.686 [2024-11-19 01:41:46.013278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.686 [2024-11-19 01:41:46.013358] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332385 ] 00:05:57.686 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.686 [2024-11-19 01:41:46.074496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.686 [2024-11-19 01:41:46.194507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.064 01:41:47 -- accel/accel.sh@18 -- # out=' 00:05:59.064 SPDK Configuration: 00:05:59.064 Core mask: 0x1 00:05:59.064 00:05:59.064 Accel Perf Configuration: 00:05:59.064 Workload Type: compare 00:05:59.064 Transfer size: 4096 bytes 00:05:59.064 Vector count 1 00:05:59.064 Module: software 00:05:59.064 Queue depth: 32 00:05:59.064 Allocate depth: 32 00:05:59.064 # threads/core: 1 00:05:59.064 Run time: 1 seconds 00:05:59.064 Verify: Yes 00:05:59.064 00:05:59.064 Running for 1 seconds... 00:05:59.064 00:05:59.064 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.064 ------------------------------------------------------------------------------------ 00:05:59.064 0,0 398624/s 1557 MiB/s 0 0 00:05:59.064 ==================================================================================== 00:05:59.064 Total 398624/s 1557 MiB/s 0 0' 00:05:59.064 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.064 01:41:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:59.064 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.064 01:41:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:59.064 01:41:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.064 01:41:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.064 01:41:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.064 01:41:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.064 01:41:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.064 01:41:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.064 01:41:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.064 01:41:47 -- accel/accel.sh@42 -- # jq -r . 00:05:59.064 [2024-11-19 01:41:47.497141] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.064 [2024-11-19 01:41:47.497221] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332622 ] 00:05:59.064 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.064 [2024-11-19 01:41:47.558759] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.324 [2024-11-19 01:41:47.676918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val= 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val= 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val=0x1 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val= 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val= 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val=compare 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val= 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val=software 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val=32 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val=32 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val=1 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val=Yes 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val= 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:05:59.324 01:41:47 -- accel/accel.sh@21 -- # val= 00:05:59.324 01:41:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # IFS=: 00:05:59.324 01:41:47 -- accel/accel.sh@20 -- # read -r var val 00:06:00.705 01:41:48 -- accel/accel.sh@21 -- # val= 00:06:00.705 01:41:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.705 01:41:48 -- accel/accel.sh@21 -- # val= 00:06:00.705 01:41:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.705 01:41:48 -- accel/accel.sh@21 -- # val= 00:06:00.705 01:41:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.705 01:41:48 -- accel/accel.sh@21 -- # val= 00:06:00.705 01:41:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.705 01:41:48 -- accel/accel.sh@21 -- # val= 00:06:00.705 01:41:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.705 01:41:48 -- accel/accel.sh@21 -- # val= 00:06:00.705 01:41:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.705 01:41:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.705 01:41:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.705 01:41:48 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:00.705 01:41:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.705 00:06:00.705 real 0m2.959s 00:06:00.705 user 0m2.668s 00:06:00.705 sys 0m0.281s 00:06:00.705 01:41:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.705 01:41:48 -- common/autotest_common.sh@10 -- # set +x 00:06:00.705 ************************************ 00:06:00.705 END TEST accel_compare 00:06:00.705 ************************************ 00:06:00.705 01:41:48 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:00.705 01:41:48 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:00.705 01:41:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.705 01:41:48 -- common/autotest_common.sh@10 -- # set +x 00:06:00.705 ************************************ 00:06:00.705 START TEST accel_xor 00:06:00.705 ************************************ 00:06:00.705 01:41:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:00.705 01:41:48 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.705 01:41:48 -- accel/accel.sh@17 -- # local accel_module 00:06:00.705 01:41:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:00.705 01:41:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:00.705 01:41:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.705 01:41:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.705 01:41:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.705 01:41:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.705 01:41:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.705 01:41:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.705 01:41:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.705 01:41:48 -- accel/accel.sh@42 -- # jq -r . 00:06:00.705 [2024-11-19 01:41:48.996560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.705 [2024-11-19 01:41:48.996657] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332787 ] 00:06:00.705 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.705 [2024-11-19 01:41:49.059221] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.705 [2024-11-19 01:41:49.179593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.082 01:41:50 -- accel/accel.sh@18 -- # out=' 00:06:02.082 SPDK Configuration: 00:06:02.082 Core mask: 0x1 00:06:02.082 00:06:02.082 Accel Perf Configuration: 00:06:02.082 Workload Type: xor 00:06:02.082 Source buffers: 2 00:06:02.082 Transfer size: 4096 bytes 00:06:02.082 Vector count 1 00:06:02.082 Module: software 00:06:02.082 Queue depth: 32 00:06:02.082 Allocate depth: 32 00:06:02.082 # threads/core: 1 00:06:02.082 Run time: 1 seconds 00:06:02.082 Verify: Yes 00:06:02.082 00:06:02.082 Running for 1 seconds... 00:06:02.082 00:06:02.082 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.083 ------------------------------------------------------------------------------------ 00:06:02.083 0,0 190464/s 744 MiB/s 0 0 00:06:02.083 ==================================================================================== 00:06:02.083 Total 190464/s 744 MiB/s 0 0' 00:06:02.083 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.083 01:41:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:02.083 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.083 01:41:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:02.083 01:41:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.083 01:41:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.083 01:41:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.083 01:41:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.083 01:41:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.083 01:41:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.083 01:41:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.083 01:41:50 -- accel/accel.sh@42 -- # jq -r . 00:06:02.083 [2024-11-19 01:41:50.482122] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.083 [2024-11-19 01:41:50.482205] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332931 ] 00:06:02.083 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.083 [2024-11-19 01:41:50.545991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.341 [2024-11-19 01:41:50.668671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val= 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val= 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val=0x1 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val= 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val= 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val=xor 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val=2 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.341 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.341 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.341 01:41:50 -- accel/accel.sh@21 -- # val= 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val=software 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val=32 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val=32 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val=1 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val=Yes 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val= 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:02.342 01:41:50 -- accel/accel.sh@21 -- # val= 00:06:02.342 01:41:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # IFS=: 00:06:02.342 01:41:50 -- accel/accel.sh@20 -- # read -r var val 00:06:03.722 01:41:51 -- accel/accel.sh@21 -- # val= 00:06:03.722 01:41:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.722 01:41:51 -- accel/accel.sh@21 -- # val= 00:06:03.722 01:41:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.722 01:41:51 -- accel/accel.sh@21 -- # val= 00:06:03.722 01:41:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.722 01:41:51 -- accel/accel.sh@21 -- # val= 00:06:03.722 01:41:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.722 01:41:51 -- accel/accel.sh@21 -- # val= 00:06:03.722 01:41:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.722 01:41:51 -- accel/accel.sh@21 -- # val= 00:06:03.722 01:41:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.722 01:41:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.722 01:41:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:03.722 01:41:51 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:03.722 01:41:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.722 00:06:03.722 real 0m2.974s 00:06:03.722 user 0m2.670s 00:06:03.722 sys 0m0.293s 00:06:03.722 01:41:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.722 01:41:51 -- common/autotest_common.sh@10 -- # set +x 00:06:03.722 ************************************ 00:06:03.722 END TEST accel_xor 00:06:03.722 ************************************ 00:06:03.722 01:41:51 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:03.722 01:41:51 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:03.722 01:41:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.722 01:41:51 -- common/autotest_common.sh@10 -- # set +x 00:06:03.722 ************************************ 00:06:03.722 START TEST accel_xor 00:06:03.722 ************************************ 00:06:03.722 01:41:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:03.722 01:41:51 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.722 01:41:51 -- accel/accel.sh@17 -- # local accel_module 00:06:03.722 01:41:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:03.722 01:41:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:03.722 01:41:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.722 01:41:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.722 01:41:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.722 01:41:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.722 01:41:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.722 01:41:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.722 01:41:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.722 01:41:51 -- accel/accel.sh@42 -- # jq -r . 00:06:03.722 [2024-11-19 01:41:51.996974] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.722 [2024-11-19 01:41:51.997055] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333205 ] 00:06:03.722 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.722 [2024-11-19 01:41:52.063081] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.722 [2024-11-19 01:41:52.182628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.103 01:41:53 -- accel/accel.sh@18 -- # out=' 00:06:05.103 SPDK Configuration: 00:06:05.103 Core mask: 0x1 00:06:05.103 00:06:05.103 Accel Perf Configuration: 00:06:05.103 Workload Type: xor 00:06:05.103 Source buffers: 3 00:06:05.103 Transfer size: 4096 bytes 00:06:05.103 Vector count 1 00:06:05.103 Module: software 00:06:05.103 Queue depth: 32 00:06:05.103 Allocate depth: 32 00:06:05.103 # threads/core: 1 00:06:05.103 Run time: 1 seconds 00:06:05.103 Verify: Yes 00:06:05.103 00:06:05.103 Running for 1 seconds... 00:06:05.103 00:06:05.103 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.103 ------------------------------------------------------------------------------------ 00:06:05.103 0,0 183104/s 715 MiB/s 0 0 00:06:05.103 ==================================================================================== 00:06:05.103 Total 183104/s 715 MiB/s 0 0' 00:06:05.103 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.103 01:41:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:05.103 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.103 01:41:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:05.103 01:41:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.103 01:41:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.103 01:41:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.103 01:41:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.103 01:41:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.103 01:41:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.103 01:41:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.103 01:41:53 -- accel/accel.sh@42 -- # jq -r . 00:06:05.103 [2024-11-19 01:41:53.475337] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.103 [2024-11-19 01:41:53.475417] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333358 ] 00:06:05.103 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.103 [2024-11-19 01:41:53.535695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.364 [2024-11-19 01:41:53.654950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val= 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val= 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=0x1 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val= 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val= 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=xor 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=3 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val= 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=software 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=32 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=32 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=1 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val=Yes 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val= 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:05.364 01:41:53 -- accel/accel.sh@21 -- # val= 00:06:05.364 01:41:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # IFS=: 00:06:05.364 01:41:53 -- accel/accel.sh@20 -- # read -r var val 00:06:06.746 01:41:54 -- accel/accel.sh@21 -- # val= 00:06:06.746 01:41:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.746 01:41:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.746 01:41:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.746 01:41:54 -- accel/accel.sh@21 -- # val= 00:06:06.746 01:41:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.746 01:41:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.746 01:41:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.746 01:41:54 -- accel/accel.sh@21 -- # val= 00:06:06.746 01:41:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.747 01:41:54 -- accel/accel.sh@21 -- # val= 00:06:06.747 01:41:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.747 01:41:54 -- accel/accel.sh@21 -- # val= 00:06:06.747 01:41:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.747 01:41:54 -- accel/accel.sh@21 -- # val= 00:06:06.747 01:41:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.747 01:41:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.747 01:41:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.747 01:41:54 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:06.747 01:41:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.747 00:06:06.747 real 0m2.957s 00:06:06.747 user 0m2.669s 00:06:06.747 sys 0m0.278s 00:06:06.747 01:41:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.747 01:41:54 -- common/autotest_common.sh@10 -- # set +x 00:06:06.747 ************************************ 00:06:06.747 END TEST accel_xor 00:06:06.747 ************************************ 00:06:06.747 01:41:54 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:06.747 01:41:54 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:06.747 01:41:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.747 01:41:54 -- common/autotest_common.sh@10 -- # set +x 00:06:06.747 ************************************ 00:06:06.747 START TEST accel_dif_verify 00:06:06.747 ************************************ 00:06:06.747 01:41:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:06.747 01:41:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.747 01:41:54 -- accel/accel.sh@17 -- # local accel_module 00:06:06.747 01:41:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:06.747 01:41:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:06.747 01:41:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.747 01:41:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.747 01:41:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.747 01:41:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.747 01:41:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.747 01:41:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.747 01:41:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.747 01:41:54 -- accel/accel.sh@42 -- # jq -r . 00:06:06.747 [2024-11-19 01:41:54.980752] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.747 [2024-11-19 01:41:54.980832] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333514 ] 00:06:06.747 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.747 [2024-11-19 01:41:55.046717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.747 [2024-11-19 01:41:55.166733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.124 01:41:56 -- accel/accel.sh@18 -- # out=' 00:06:08.124 SPDK Configuration: 00:06:08.124 Core mask: 0x1 00:06:08.124 00:06:08.124 Accel Perf Configuration: 00:06:08.124 Workload Type: dif_verify 00:06:08.124 Vector size: 4096 bytes 00:06:08.124 Transfer size: 4096 bytes 00:06:08.124 Block size: 512 bytes 00:06:08.124 Metadata size: 8 bytes 00:06:08.124 Vector count 1 00:06:08.124 Module: software 00:06:08.124 Queue depth: 32 00:06:08.124 Allocate depth: 32 00:06:08.124 # threads/core: 1 00:06:08.124 Run time: 1 seconds 00:06:08.124 Verify: No 00:06:08.124 00:06:08.124 Running for 1 seconds... 00:06:08.124 00:06:08.124 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.124 ------------------------------------------------------------------------------------ 00:06:08.125 0,0 81920/s 325 MiB/s 0 0 00:06:08.125 ==================================================================================== 00:06:08.125 Total 81920/s 320 MiB/s 0 0' 00:06:08.125 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.125 01:41:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:08.125 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.125 01:41:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:08.125 01:41:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.125 01:41:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.125 01:41:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.125 01:41:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.125 01:41:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.125 01:41:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.125 01:41:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.125 01:41:56 -- accel/accel.sh@42 -- # jq -r . 00:06:08.125 [2024-11-19 01:41:56.462393] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.125 [2024-11-19 01:41:56.462475] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333777 ] 00:06:08.125 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.125 [2024-11-19 01:41:56.524299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.125 [2024-11-19 01:41:56.644667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val= 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val= 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val=0x1 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val= 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val= 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val=dif_verify 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val= 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val=software 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val=32 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val=32 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val=1 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val=No 00:06:08.385 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.385 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.385 01:41:56 -- accel/accel.sh@21 -- # val= 00:06:08.386 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.386 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.386 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:08.386 01:41:56 -- accel/accel.sh@21 -- # val= 00:06:08.386 01:41:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.386 01:41:56 -- accel/accel.sh@20 -- # IFS=: 00:06:08.386 01:41:56 -- accel/accel.sh@20 -- # read -r var val 00:06:09.767 01:41:57 -- accel/accel.sh@21 -- # val= 00:06:09.767 01:41:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.767 01:41:57 -- accel/accel.sh@21 -- # val= 00:06:09.767 01:41:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.767 01:41:57 -- accel/accel.sh@21 -- # val= 00:06:09.767 01:41:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.767 01:41:57 -- accel/accel.sh@21 -- # val= 00:06:09.767 01:41:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.767 01:41:57 -- accel/accel.sh@21 -- # val= 00:06:09.767 01:41:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.767 01:41:57 -- accel/accel.sh@21 -- # val= 00:06:09.767 01:41:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.767 01:41:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.767 01:41:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.767 01:41:57 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:09.767 01:41:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.767 00:06:09.767 real 0m2.965s 00:06:09.767 user 0m2.668s 00:06:09.767 sys 0m0.288s 00:06:09.767 01:41:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.767 01:41:57 -- common/autotest_common.sh@10 -- # set +x 00:06:09.767 ************************************ 00:06:09.767 END TEST accel_dif_verify 00:06:09.767 ************************************ 00:06:09.767 01:41:57 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:09.767 01:41:57 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:09.767 01:41:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.767 01:41:57 -- common/autotest_common.sh@10 -- # set +x 00:06:09.767 ************************************ 00:06:09.767 START TEST accel_dif_generate 00:06:09.767 ************************************ 00:06:09.767 01:41:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:09.767 01:41:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.767 01:41:57 -- accel/accel.sh@17 -- # local accel_module 00:06:09.767 01:41:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:09.767 01:41:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:09.767 01:41:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.767 01:41:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.767 01:41:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.767 01:41:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.767 01:41:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.767 01:41:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.767 01:41:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.767 01:41:57 -- accel/accel.sh@42 -- # jq -r . 00:06:09.767 [2024-11-19 01:41:57.974615] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.767 [2024-11-19 01:41:57.974718] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333936 ] 00:06:09.767 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.767 [2024-11-19 01:41:58.036755] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.767 [2024-11-19 01:41:58.156734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.147 01:41:59 -- accel/accel.sh@18 -- # out=' 00:06:11.147 SPDK Configuration: 00:06:11.147 Core mask: 0x1 00:06:11.147 00:06:11.147 Accel Perf Configuration: 00:06:11.147 Workload Type: dif_generate 00:06:11.147 Vector size: 4096 bytes 00:06:11.147 Transfer size: 4096 bytes 00:06:11.147 Block size: 512 bytes 00:06:11.147 Metadata size: 8 bytes 00:06:11.147 Vector count 1 00:06:11.147 Module: software 00:06:11.147 Queue depth: 32 00:06:11.147 Allocate depth: 32 00:06:11.147 # threads/core: 1 00:06:11.147 Run time: 1 seconds 00:06:11.147 Verify: No 00:06:11.147 00:06:11.147 Running for 1 seconds... 00:06:11.147 00:06:11.147 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:11.147 ------------------------------------------------------------------------------------ 00:06:11.147 0,0 96352/s 382 MiB/s 0 0 00:06:11.147 ==================================================================================== 00:06:11.147 Total 96352/s 376 MiB/s 0 0' 00:06:11.147 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.147 01:41:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:11.147 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.147 01:41:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:11.147 01:41:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.147 01:41:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.147 01:41:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.147 01:41:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.147 01:41:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.147 01:41:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.147 01:41:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.147 01:41:59 -- accel/accel.sh@42 -- # jq -r . 00:06:11.147 [2024-11-19 01:41:59.452481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.147 [2024-11-19 01:41:59.452562] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334085 ] 00:06:11.147 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.147 [2024-11-19 01:41:59.514307] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.147 [2024-11-19 01:41:59.634822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val= 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val= 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val=0x1 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val= 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val= 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val=dif_generate 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val= 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val=software 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val=32 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val=32 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val=1 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val=No 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val= 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:11.407 01:41:59 -- accel/accel.sh@21 -- # val= 00:06:11.407 01:41:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # IFS=: 00:06:11.407 01:41:59 -- accel/accel.sh@20 -- # read -r var val 00:06:12.783 01:42:00 -- accel/accel.sh@21 -- # val= 00:06:12.783 01:42:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.783 01:42:00 -- accel/accel.sh@21 -- # val= 00:06:12.783 01:42:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.783 01:42:00 -- accel/accel.sh@21 -- # val= 00:06:12.783 01:42:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.783 01:42:00 -- accel/accel.sh@21 -- # val= 00:06:12.783 01:42:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.783 01:42:00 -- accel/accel.sh@21 -- # val= 00:06:12.783 01:42:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.783 01:42:00 -- accel/accel.sh@21 -- # val= 00:06:12.783 01:42:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.783 01:42:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.783 01:42:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.783 01:42:00 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:12.783 01:42:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.783 00:06:12.783 real 0m2.955s 00:06:12.783 user 0m2.668s 00:06:12.783 sys 0m0.278s 00:06:12.783 01:42:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.783 01:42:00 -- common/autotest_common.sh@10 -- # set +x 00:06:12.783 ************************************ 00:06:12.783 END TEST accel_dif_generate 00:06:12.783 ************************************ 00:06:12.783 01:42:00 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:12.783 01:42:00 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:12.783 01:42:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.783 01:42:00 -- common/autotest_common.sh@10 -- # set +x 00:06:12.783 ************************************ 00:06:12.783 START TEST accel_dif_generate_copy 00:06:12.783 ************************************ 00:06:12.783 01:42:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:12.783 01:42:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.783 01:42:00 -- accel/accel.sh@17 -- # local accel_module 00:06:12.783 01:42:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:12.783 01:42:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:12.783 01:42:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.783 01:42:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.783 01:42:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.783 01:42:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.783 01:42:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.783 01:42:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.783 01:42:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.783 01:42:00 -- accel/accel.sh@42 -- # jq -r . 00:06:12.783 [2024-11-19 01:42:00.956765] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.783 [2024-11-19 01:42:00.956844] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334416 ] 00:06:12.783 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.783 [2024-11-19 01:42:01.019242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.783 [2024-11-19 01:42:01.138244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.163 01:42:02 -- accel/accel.sh@18 -- # out=' 00:06:14.163 SPDK Configuration: 00:06:14.163 Core mask: 0x1 00:06:14.163 00:06:14.163 Accel Perf Configuration: 00:06:14.163 Workload Type: dif_generate_copy 00:06:14.163 Vector size: 4096 bytes 00:06:14.163 Transfer size: 4096 bytes 00:06:14.163 Vector count 1 00:06:14.163 Module: software 00:06:14.163 Queue depth: 32 00:06:14.163 Allocate depth: 32 00:06:14.163 # threads/core: 1 00:06:14.163 Run time: 1 seconds 00:06:14.163 Verify: No 00:06:14.163 00:06:14.163 Running for 1 seconds... 00:06:14.163 00:06:14.163 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:14.163 ------------------------------------------------------------------------------------ 00:06:14.163 0,0 76032/s 301 MiB/s 0 0 00:06:14.163 ==================================================================================== 00:06:14.163 Total 76032/s 297 MiB/s 0 0' 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.163 01:42:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.163 01:42:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:14.163 01:42:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.163 01:42:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.163 01:42:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.163 01:42:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.163 01:42:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.163 01:42:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.163 01:42:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.163 01:42:02 -- accel/accel.sh@42 -- # jq -r . 00:06:14.163 [2024-11-19 01:42:02.439777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:14.163 [2024-11-19 01:42:02.439859] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334611 ] 00:06:14.163 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.163 [2024-11-19 01:42:02.502808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.163 [2024-11-19 01:42:02.622100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.163 01:42:02 -- accel/accel.sh@21 -- # val= 00:06:14.163 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.163 01:42:02 -- accel/accel.sh@21 -- # val= 00:06:14.163 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.163 01:42:02 -- accel/accel.sh@21 -- # val=0x1 00:06:14.163 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.163 01:42:02 -- accel/accel.sh@21 -- # val= 00:06:14.163 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.163 01:42:02 -- accel/accel.sh@21 -- # val= 00:06:14.163 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.163 01:42:02 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:14.163 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.163 01:42:02 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.163 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.163 01:42:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.163 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val= 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val=software 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val=32 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val=32 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val=1 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val=No 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val= 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:14.164 01:42:02 -- accel/accel.sh@21 -- # val= 00:06:14.164 01:42:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # IFS=: 00:06:14.164 01:42:02 -- accel/accel.sh@20 -- # read -r var val 00:06:15.544 01:42:03 -- accel/accel.sh@21 -- # val= 00:06:15.544 01:42:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.544 01:42:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.544 01:42:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.544 01:42:03 -- accel/accel.sh@21 -- # val= 00:06:15.545 01:42:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.545 01:42:03 -- accel/accel.sh@21 -- # val= 00:06:15.545 01:42:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.545 01:42:03 -- accel/accel.sh@21 -- # val= 00:06:15.545 01:42:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.545 01:42:03 -- accel/accel.sh@21 -- # val= 00:06:15.545 01:42:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.545 01:42:03 -- accel/accel.sh@21 -- # val= 00:06:15.545 01:42:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.545 01:42:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.545 01:42:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.545 01:42:03 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:15.545 01:42:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.545 00:06:15.545 real 0m2.971s 00:06:15.545 user 0m2.677s 00:06:15.545 sys 0m0.282s 00:06:15.545 01:42:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.545 01:42:03 -- common/autotest_common.sh@10 -- # set +x 00:06:15.545 ************************************ 00:06:15.545 END TEST accel_dif_generate_copy 00:06:15.545 ************************************ 00:06:15.545 01:42:03 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:15.545 01:42:03 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.545 01:42:03 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:15.545 01:42:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.545 01:42:03 -- common/autotest_common.sh@10 -- # set +x 00:06:15.545 ************************************ 00:06:15.545 START TEST accel_comp 00:06:15.545 ************************************ 00:06:15.545 01:42:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.545 01:42:03 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.545 01:42:03 -- accel/accel.sh@17 -- # local accel_module 00:06:15.545 01:42:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.545 01:42:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.545 01:42:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.545 01:42:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.545 01:42:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.545 01:42:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.545 01:42:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.545 01:42:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.545 01:42:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.545 01:42:03 -- accel/accel.sh@42 -- # jq -r . 00:06:15.545 [2024-11-19 01:42:03.955990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.545 [2024-11-19 01:42:03.956069] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334778 ] 00:06:15.545 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.545 [2024-11-19 01:42:04.017474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.804 [2024-11-19 01:42:04.135578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.185 01:42:05 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:17.185 00:06:17.185 SPDK Configuration: 00:06:17.185 Core mask: 0x1 00:06:17.185 00:06:17.185 Accel Perf Configuration: 00:06:17.185 Workload Type: compress 00:06:17.185 Transfer size: 4096 bytes 00:06:17.185 Vector count 1 00:06:17.185 Module: software 00:06:17.185 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.185 Queue depth: 32 00:06:17.185 Allocate depth: 32 00:06:17.185 # threads/core: 1 00:06:17.185 Run time: 1 seconds 00:06:17.185 Verify: No 00:06:17.185 00:06:17.185 Running for 1 seconds... 00:06:17.185 00:06:17.185 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:17.185 ------------------------------------------------------------------------------------ 00:06:17.185 0,0 31456/s 131 MiB/s 0 0 00:06:17.185 ==================================================================================== 00:06:17.185 Total 31456/s 122 MiB/s 0 0' 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.185 01:42:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.185 01:42:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.185 01:42:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.185 01:42:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.185 01:42:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.185 01:42:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.185 01:42:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.185 01:42:05 -- accel/accel.sh@42 -- # jq -r . 00:06:17.185 [2024-11-19 01:42:05.431282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.185 [2024-11-19 01:42:05.431367] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335033 ] 00:06:17.185 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.185 [2024-11-19 01:42:05.493680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.185 [2024-11-19 01:42:05.614017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=0x1 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=compress 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=software 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=32 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=32 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=1 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.185 01:42:05 -- accel/accel.sh@21 -- # val=No 00:06:17.185 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.185 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.186 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.186 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.186 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.186 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:17.186 01:42:05 -- accel/accel.sh@21 -- # val= 00:06:17.186 01:42:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.186 01:42:05 -- accel/accel.sh@20 -- # IFS=: 00:06:17.186 01:42:05 -- accel/accel.sh@20 -- # read -r var val 00:06:18.565 01:42:06 -- accel/accel.sh@21 -- # val= 00:06:18.565 01:42:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.565 01:42:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.566 01:42:06 -- accel/accel.sh@21 -- # val= 00:06:18.566 01:42:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.566 01:42:06 -- accel/accel.sh@21 -- # val= 00:06:18.566 01:42:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.566 01:42:06 -- accel/accel.sh@21 -- # val= 00:06:18.566 01:42:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.566 01:42:06 -- accel/accel.sh@21 -- # val= 00:06:18.566 01:42:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.566 01:42:06 -- accel/accel.sh@21 -- # val= 00:06:18.566 01:42:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.566 01:42:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.566 01:42:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.566 01:42:06 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:18.566 01:42:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.566 00:06:18.566 real 0m2.967s 00:06:18.566 user 0m2.674s 00:06:18.566 sys 0m0.282s 00:06:18.566 01:42:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.566 01:42:06 -- common/autotest_common.sh@10 -- # set +x 00:06:18.566 ************************************ 00:06:18.566 END TEST accel_comp 00:06:18.566 ************************************ 00:06:18.566 01:42:06 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.566 01:42:06 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:18.566 01:42:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.566 01:42:06 -- common/autotest_common.sh@10 -- # set +x 00:06:18.566 ************************************ 00:06:18.566 START TEST accel_decomp 00:06:18.566 ************************************ 00:06:18.566 01:42:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.566 01:42:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.566 01:42:06 -- accel/accel.sh@17 -- # local accel_module 00:06:18.566 01:42:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.566 01:42:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.566 01:42:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.566 01:42:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.566 01:42:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.566 01:42:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.566 01:42:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.566 01:42:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.566 01:42:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.566 01:42:06 -- accel/accel.sh@42 -- # jq -r . 00:06:18.566 [2024-11-19 01:42:06.948034] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.566 [2024-11-19 01:42:06.948113] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335200 ] 00:06:18.566 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.566 [2024-11-19 01:42:07.013822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.825 [2024-11-19 01:42:07.134699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.201 01:42:08 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:20.201 00:06:20.201 SPDK Configuration: 00:06:20.201 Core mask: 0x1 00:06:20.201 00:06:20.201 Accel Perf Configuration: 00:06:20.201 Workload Type: decompress 00:06:20.201 Transfer size: 4096 bytes 00:06:20.201 Vector count 1 00:06:20.201 Module: software 00:06:20.201 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.201 Queue depth: 32 00:06:20.201 Allocate depth: 32 00:06:20.201 # threads/core: 1 00:06:20.201 Run time: 1 seconds 00:06:20.201 Verify: Yes 00:06:20.201 00:06:20.201 Running for 1 seconds... 00:06:20.201 00:06:20.201 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:20.201 ------------------------------------------------------------------------------------ 00:06:20.201 0,0 55232/s 101 MiB/s 0 0 00:06:20.201 ==================================================================================== 00:06:20.201 Total 55232/s 215 MiB/s 0 0' 00:06:20.201 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:20.202 01:42:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.202 01:42:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.202 01:42:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.202 01:42:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.202 01:42:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.202 01:42:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.202 01:42:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.202 01:42:08 -- accel/accel.sh@42 -- # jq -r . 00:06:20.202 [2024-11-19 01:42:08.436597] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.202 [2024-11-19 01:42:08.436685] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335725 ] 00:06:20.202 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.202 [2024-11-19 01:42:08.502228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.202 [2024-11-19 01:42:08.624016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=0x1 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=decompress 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=software 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=32 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=32 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=1 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val=Yes 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 01:42:08 -- accel/accel.sh@21 -- # val= 00:06:20.202 01:42:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 01:42:08 -- accel/accel.sh@20 -- # read -r var val 00:06:21.578 01:42:09 -- accel/accel.sh@21 -- # val= 00:06:21.578 01:42:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.578 01:42:09 -- accel/accel.sh@21 -- # val= 00:06:21.578 01:42:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.578 01:42:09 -- accel/accel.sh@21 -- # val= 00:06:21.578 01:42:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.578 01:42:09 -- accel/accel.sh@21 -- # val= 00:06:21.578 01:42:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.578 01:42:09 -- accel/accel.sh@21 -- # val= 00:06:21.578 01:42:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.578 01:42:09 -- accel/accel.sh@21 -- # val= 00:06:21.578 01:42:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.578 01:42:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.578 01:42:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.578 01:42:09 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:21.578 01:42:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.578 00:06:21.578 real 0m2.974s 00:06:21.578 user 0m2.670s 00:06:21.578 sys 0m0.294s 00:06:21.578 01:42:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.578 01:42:09 -- common/autotest_common.sh@10 -- # set +x 00:06:21.578 ************************************ 00:06:21.578 END TEST accel_decomp 00:06:21.578 ************************************ 00:06:21.578 01:42:09 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.578 01:42:09 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:21.578 01:42:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.578 01:42:09 -- common/autotest_common.sh@10 -- # set +x 00:06:21.578 ************************************ 00:06:21.578 START TEST accel_decmop_full 00:06:21.578 ************************************ 00:06:21.578 01:42:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.578 01:42:09 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.578 01:42:09 -- accel/accel.sh@17 -- # local accel_module 00:06:21.578 01:42:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.578 01:42:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.578 01:42:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.578 01:42:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.578 01:42:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.578 01:42:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.578 01:42:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.578 01:42:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.578 01:42:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.578 01:42:09 -- accel/accel.sh@42 -- # jq -r . 00:06:21.578 [2024-11-19 01:42:09.944508] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.578 [2024-11-19 01:42:09.944587] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3336133 ] 00:06:21.578 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.578 [2024-11-19 01:42:10.006583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.838 [2024-11-19 01:42:10.146451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.219 01:42:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:23.219 00:06:23.219 SPDK Configuration: 00:06:23.219 Core mask: 0x1 00:06:23.219 00:06:23.219 Accel Perf Configuration: 00:06:23.219 Workload Type: decompress 00:06:23.219 Transfer size: 111250 bytes 00:06:23.219 Vector count 1 00:06:23.219 Module: software 00:06:23.219 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.219 Queue depth: 32 00:06:23.219 Allocate depth: 32 00:06:23.219 # threads/core: 1 00:06:23.219 Run time: 1 seconds 00:06:23.219 Verify: Yes 00:06:23.219 00:06:23.219 Running for 1 seconds... 00:06:23.219 00:06:23.219 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:23.219 ------------------------------------------------------------------------------------ 00:06:23.219 0,0 3776/s 155 MiB/s 0 0 00:06:23.219 ==================================================================================== 00:06:23.219 Total 3776/s 400 MiB/s 0 0' 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:23.219 01:42:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.219 01:42:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.219 01:42:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.219 01:42:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.219 01:42:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.219 01:42:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.219 01:42:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.219 01:42:11 -- accel/accel.sh@42 -- # jq -r . 00:06:23.219 [2024-11-19 01:42:11.462264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.219 [2024-11-19 01:42:11.462345] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3336272 ] 00:06:23.219 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.219 [2024-11-19 01:42:11.523582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.219 [2024-11-19 01:42:11.644391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val=0x1 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val=decompress 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.219 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.219 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.219 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val=software 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val=32 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val=32 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val=1 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val=Yes 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:23.220 01:42:11 -- accel/accel.sh@21 -- # val= 00:06:23.220 01:42:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # IFS=: 00:06:23.220 01:42:11 -- accel/accel.sh@20 -- # read -r var val 00:06:24.638 01:42:12 -- accel/accel.sh@21 -- # val= 00:06:24.638 01:42:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # IFS=: 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # read -r var val 00:06:24.638 01:42:12 -- accel/accel.sh@21 -- # val= 00:06:24.638 01:42:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # IFS=: 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # read -r var val 00:06:24.638 01:42:12 -- accel/accel.sh@21 -- # val= 00:06:24.638 01:42:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # IFS=: 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # read -r var val 00:06:24.638 01:42:12 -- accel/accel.sh@21 -- # val= 00:06:24.638 01:42:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # IFS=: 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # read -r var val 00:06:24.638 01:42:12 -- accel/accel.sh@21 -- # val= 00:06:24.638 01:42:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # IFS=: 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # read -r var val 00:06:24.638 01:42:12 -- accel/accel.sh@21 -- # val= 00:06:24.638 01:42:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # IFS=: 00:06:24.638 01:42:12 -- accel/accel.sh@20 -- # read -r var val 00:06:24.638 01:42:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.638 01:42:12 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:24.638 01:42:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.638 00:06:24.638 real 0m3.015s 00:06:24.638 user 0m2.713s 00:06:24.638 sys 0m0.293s 00:06:24.638 01:42:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.638 01:42:12 -- common/autotest_common.sh@10 -- # set +x 00:06:24.638 ************************************ 00:06:24.638 END TEST accel_decmop_full 00:06:24.638 ************************************ 00:06:24.638 01:42:12 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.638 01:42:12 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:24.638 01:42:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.638 01:42:12 -- common/autotest_common.sh@10 -- # set +x 00:06:24.638 ************************************ 00:06:24.638 START TEST accel_decomp_mcore 00:06:24.638 ************************************ 00:06:24.638 01:42:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.638 01:42:12 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.638 01:42:12 -- accel/accel.sh@17 -- # local accel_module 00:06:24.638 01:42:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.638 01:42:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.638 01:42:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.638 01:42:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.638 01:42:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.638 01:42:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.638 01:42:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.638 01:42:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.638 01:42:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.638 01:42:12 -- accel/accel.sh@42 -- # jq -r . 00:06:24.638 [2024-11-19 01:42:12.991743] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.638 [2024-11-19 01:42:12.991832] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3336438 ] 00:06:24.638 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.638 [2024-11-19 01:42:13.055995] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:24.638 [2024-11-19 01:42:13.177506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:24.638 [2024-11-19 01:42:13.177560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:24.638 [2024-11-19 01:42:13.177616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:24.638 [2024-11-19 01:42:13.177619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.013 01:42:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:26.013 00:06:26.013 SPDK Configuration: 00:06:26.013 Core mask: 0xf 00:06:26.013 00:06:26.013 Accel Perf Configuration: 00:06:26.013 Workload Type: decompress 00:06:26.013 Transfer size: 4096 bytes 00:06:26.013 Vector count 1 00:06:26.013 Module: software 00:06:26.013 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.013 Queue depth: 32 00:06:26.013 Allocate depth: 32 00:06:26.013 # threads/core: 1 00:06:26.013 Run time: 1 seconds 00:06:26.013 Verify: Yes 00:06:26.013 00:06:26.013 Running for 1 seconds... 00:06:26.013 00:06:26.013 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:26.013 ------------------------------------------------------------------------------------ 00:06:26.013 0,0 50048/s 92 MiB/s 0 0 00:06:26.013 3,0 50592/s 93 MiB/s 0 0 00:06:26.013 2,0 50432/s 92 MiB/s 0 0 00:06:26.013 1,0 50432/s 92 MiB/s 0 0 00:06:26.013 ==================================================================================== 00:06:26.013 Total 201504/s 787 MiB/s 0 0' 00:06:26.013 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.013 01:42:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:26.013 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.013 01:42:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:26.013 01:42:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.013 01:42:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.013 01:42:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.013 01:42:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.013 01:42:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.013 01:42:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.014 01:42:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.014 01:42:14 -- accel/accel.sh@42 -- # jq -r . 00:06:26.014 [2024-11-19 01:42:14.482603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.014 [2024-11-19 01:42:14.482695] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3336703 ] 00:06:26.014 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.014 [2024-11-19 01:42:14.545144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:26.272 [2024-11-19 01:42:14.666488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.272 [2024-11-19 01:42:14.666542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.272 [2024-11-19 01:42:14.666597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:26.272 [2024-11-19 01:42:14.666600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val=0xf 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val=decompress 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val=software 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.272 01:42:14 -- accel/accel.sh@21 -- # val=32 00:06:26.272 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.272 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.273 01:42:14 -- accel/accel.sh@21 -- # val=32 00:06:26.273 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.273 01:42:14 -- accel/accel.sh@21 -- # val=1 00:06:26.273 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.273 01:42:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.273 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.273 01:42:14 -- accel/accel.sh@21 -- # val=Yes 00:06:26.273 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.273 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.273 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:26.273 01:42:14 -- accel/accel.sh@21 -- # val= 00:06:26.273 01:42:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # IFS=: 00:06:26.273 01:42:14 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.647 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.647 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.647 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.648 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.648 01:42:15 -- accel/accel.sh@21 -- # val= 00:06:27.648 01:42:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.648 01:42:15 -- accel/accel.sh@20 -- # IFS=: 00:06:27.648 01:42:15 -- accel/accel.sh@20 -- # read -r var val 00:06:27.648 01:42:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.648 01:42:15 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.648 01:42:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.648 00:06:27.648 real 0m2.980s 00:06:27.648 user 0m9.553s 00:06:27.648 sys 0m0.316s 00:06:27.648 01:42:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.648 01:42:15 -- common/autotest_common.sh@10 -- # set +x 00:06:27.648 ************************************ 00:06:27.648 END TEST accel_decomp_mcore 00:06:27.648 ************************************ 00:06:27.648 01:42:15 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.648 01:42:15 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:27.648 01:42:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.648 01:42:15 -- common/autotest_common.sh@10 -- # set +x 00:06:27.648 ************************************ 00:06:27.648 START TEST accel_decomp_full_mcore 00:06:27.648 ************************************ 00:06:27.648 01:42:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.648 01:42:15 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.648 01:42:15 -- accel/accel.sh@17 -- # local accel_module 00:06:27.648 01:42:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.648 01:42:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.648 01:42:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.648 01:42:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.648 01:42:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.648 01:42:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.648 01:42:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.648 01:42:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.648 01:42:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.648 01:42:15 -- accel/accel.sh@42 -- # jq -r . 00:06:27.648 [2024-11-19 01:42:15.996238] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.648 [2024-11-19 01:42:15.996320] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3336872 ] 00:06:27.648 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.648 [2024-11-19 01:42:16.062786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.648 [2024-11-19 01:42:16.186978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.648 [2024-11-19 01:42:16.187037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.648 [2024-11-19 01:42:16.187095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.648 [2024-11-19 01:42:16.187099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.024 01:42:17 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:29.024 00:06:29.024 SPDK Configuration: 00:06:29.024 Core mask: 0xf 00:06:29.024 00:06:29.024 Accel Perf Configuration: 00:06:29.024 Workload Type: decompress 00:06:29.024 Transfer size: 111250 bytes 00:06:29.024 Vector count 1 00:06:29.024 Module: software 00:06:29.024 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.024 Queue depth: 32 00:06:29.024 Allocate depth: 32 00:06:29.024 # threads/core: 1 00:06:29.024 Run time: 1 seconds 00:06:29.024 Verify: Yes 00:06:29.024 00:06:29.024 Running for 1 seconds... 00:06:29.024 00:06:29.024 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:29.024 ------------------------------------------------------------------------------------ 00:06:29.024 0,0 3776/s 155 MiB/s 0 0 00:06:29.024 3,0 3776/s 155 MiB/s 0 0 00:06:29.024 2,0 3776/s 155 MiB/s 0 0 00:06:29.024 1,0 3776/s 155 MiB/s 0 0 00:06:29.024 ==================================================================================== 00:06:29.024 Total 15104/s 1602 MiB/s 0 0' 00:06:29.024 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.024 01:42:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:29.024 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.024 01:42:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:29.024 01:42:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.024 01:42:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.024 01:42:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.024 01:42:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.024 01:42:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.024 01:42:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.024 01:42:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.024 01:42:17 -- accel/accel.sh@42 -- # jq -r . 00:06:29.024 [2024-11-19 01:42:17.510164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.024 [2024-11-19 01:42:17.510248] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3337013 ] 00:06:29.024 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.283 [2024-11-19 01:42:17.576614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:29.283 [2024-11-19 01:42:17.700504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:29.283 [2024-11-19 01:42:17.700558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:29.283 [2024-11-19 01:42:17.700611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:29.283 [2024-11-19 01:42:17.700614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val=0xf 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val=decompress 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val=software 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@23 -- # accel_module=software 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val=32 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val=32 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val=1 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.283 01:42:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:29.283 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.283 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.284 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.284 01:42:17 -- accel/accel.sh@21 -- # val=Yes 00:06:29.284 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.284 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.284 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.284 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.284 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.284 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.284 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:29.284 01:42:17 -- accel/accel.sh@21 -- # val= 00:06:29.284 01:42:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.284 01:42:17 -- accel/accel.sh@20 -- # IFS=: 00:06:29.284 01:42:17 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@21 -- # val= 00:06:30.657 01:42:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # IFS=: 00:06:30.657 01:42:18 -- accel/accel.sh@20 -- # read -r var val 00:06:30.657 01:42:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.657 01:42:18 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:30.657 01:42:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.657 00:06:30.657 real 0m3.014s 00:06:30.657 user 0m9.673s 00:06:30.657 sys 0m0.318s 00:06:30.657 01:42:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.657 01:42:18 -- common/autotest_common.sh@10 -- # set +x 00:06:30.657 ************************************ 00:06:30.657 END TEST accel_decomp_full_mcore 00:06:30.657 ************************************ 00:06:30.657 01:42:19 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.657 01:42:19 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:30.657 01:42:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.657 01:42:19 -- common/autotest_common.sh@10 -- # set +x 00:06:30.657 ************************************ 00:06:30.657 START TEST accel_decomp_mthread 00:06:30.657 ************************************ 00:06:30.657 01:42:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.657 01:42:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.657 01:42:19 -- accel/accel.sh@17 -- # local accel_module 00:06:30.657 01:42:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.657 01:42:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.657 01:42:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.657 01:42:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.657 01:42:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.657 01:42:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.657 01:42:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.657 01:42:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.657 01:42:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.657 01:42:19 -- accel/accel.sh@42 -- # jq -r . 00:06:30.657 [2024-11-19 01:42:19.036865] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.657 [2024-11-19 01:42:19.036946] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3337301 ] 00:06:30.657 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.657 [2024-11-19 01:42:19.098620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.915 [2024-11-19 01:42:19.219861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.289 01:42:20 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:32.289 00:06:32.289 SPDK Configuration: 00:06:32.289 Core mask: 0x1 00:06:32.289 00:06:32.289 Accel Perf Configuration: 00:06:32.289 Workload Type: decompress 00:06:32.289 Transfer size: 4096 bytes 00:06:32.289 Vector count 1 00:06:32.289 Module: software 00:06:32.289 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.289 Queue depth: 32 00:06:32.289 Allocate depth: 32 00:06:32.289 # threads/core: 2 00:06:32.289 Run time: 1 seconds 00:06:32.289 Verify: Yes 00:06:32.289 00:06:32.289 Running for 1 seconds... 00:06:32.289 00:06:32.289 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:32.289 ------------------------------------------------------------------------------------ 00:06:32.289 0,1 28032/s 51 MiB/s 0 0 00:06:32.289 0,0 27936/s 51 MiB/s 0 0 00:06:32.289 ==================================================================================== 00:06:32.289 Total 55968/s 218 MiB/s 0 0' 00:06:32.289 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.289 01:42:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:32.289 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.289 01:42:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:32.289 01:42:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.289 01:42:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.289 01:42:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.289 01:42:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.289 01:42:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.289 01:42:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.289 01:42:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.289 01:42:20 -- accel/accel.sh@42 -- # jq -r . 00:06:32.289 [2024-11-19 01:42:20.520425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.290 [2024-11-19 01:42:20.520504] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3337443 ] 00:06:32.290 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.290 [2024-11-19 01:42:20.585339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.290 [2024-11-19 01:42:20.705885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=0x1 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=decompress 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=software 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@23 -- # accel_module=software 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=32 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=32 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=2 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val=Yes 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:32.290 01:42:20 -- accel/accel.sh@21 -- # val= 00:06:32.290 01:42:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # IFS=: 00:06:32.290 01:42:20 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@21 -- # val= 00:06:33.664 01:42:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # IFS=: 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@21 -- # val= 00:06:33.664 01:42:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # IFS=: 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@21 -- # val= 00:06:33.664 01:42:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # IFS=: 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@21 -- # val= 00:06:33.664 01:42:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # IFS=: 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@21 -- # val= 00:06:33.664 01:42:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # IFS=: 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@21 -- # val= 00:06:33.664 01:42:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # IFS=: 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@21 -- # val= 00:06:33.664 01:42:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # IFS=: 00:06:33.664 01:42:21 -- accel/accel.sh@20 -- # read -r var val 00:06:33.664 01:42:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:33.664 01:42:21 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:33.664 01:42:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:33.664 00:06:33.664 real 0m2.983s 00:06:33.664 user 0m2.691s 00:06:33.664 sys 0m0.283s 00:06:33.664 01:42:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.664 01:42:21 -- common/autotest_common.sh@10 -- # set +x 00:06:33.664 ************************************ 00:06:33.664 END TEST accel_decomp_mthread 00:06:33.664 ************************************ 00:06:33.665 01:42:22 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.665 01:42:22 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:33.665 01:42:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.665 01:42:22 -- common/autotest_common.sh@10 -- # set +x 00:06:33.665 ************************************ 00:06:33.665 START TEST accel_deomp_full_mthread 00:06:33.665 ************************************ 00:06:33.665 01:42:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.665 01:42:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:33.665 01:42:22 -- accel/accel.sh@17 -- # local accel_module 00:06:33.665 01:42:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.665 01:42:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.665 01:42:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.665 01:42:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.665 01:42:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.665 01:42:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.665 01:42:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.665 01:42:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.665 01:42:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.665 01:42:22 -- accel/accel.sh@42 -- # jq -r . 00:06:33.665 [2024-11-19 01:42:22.045776] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.665 [2024-11-19 01:42:22.045856] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3337605 ] 00:06:33.665 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.665 [2024-11-19 01:42:22.108151] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.923 [2024-11-19 01:42:22.229615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.297 01:42:23 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:35.297 00:06:35.297 SPDK Configuration: 00:06:35.297 Core mask: 0x1 00:06:35.297 00:06:35.297 Accel Perf Configuration: 00:06:35.297 Workload Type: decompress 00:06:35.297 Transfer size: 111250 bytes 00:06:35.297 Vector count 1 00:06:35.297 Module: software 00:06:35.297 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:35.297 Queue depth: 32 00:06:35.297 Allocate depth: 32 00:06:35.297 # threads/core: 2 00:06:35.298 Run time: 1 seconds 00:06:35.298 Verify: Yes 00:06:35.298 00:06:35.298 Running for 1 seconds... 00:06:35.298 00:06:35.298 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:35.298 ------------------------------------------------------------------------------------ 00:06:35.298 0,1 1952/s 80 MiB/s 0 0 00:06:35.298 0,0 1920/s 79 MiB/s 0 0 00:06:35.298 ==================================================================================== 00:06:35.298 Total 3872/s 410 MiB/s 0 0' 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:35.298 01:42:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.298 01:42:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.298 01:42:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.298 01:42:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.298 01:42:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.298 01:42:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.298 01:42:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.298 01:42:23 -- accel/accel.sh@42 -- # jq -r . 00:06:35.298 [2024-11-19 01:42:23.561566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.298 [2024-11-19 01:42:23.561658] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3337867 ] 00:06:35.298 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.298 [2024-11-19 01:42:23.627746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.298 [2024-11-19 01:42:23.747848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=0x1 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=decompress 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=software 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@23 -- # accel_module=software 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=32 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=32 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=2 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val=Yes 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:35.298 01:42:23 -- accel/accel.sh@21 -- # val= 00:06:35.298 01:42:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # IFS=: 00:06:35.298 01:42:23 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@21 -- # val= 00:06:36.672 01:42:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # IFS=: 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@21 -- # val= 00:06:36.672 01:42:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # IFS=: 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@21 -- # val= 00:06:36.672 01:42:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # IFS=: 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@21 -- # val= 00:06:36.672 01:42:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # IFS=: 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@21 -- # val= 00:06:36.672 01:42:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # IFS=: 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@21 -- # val= 00:06:36.672 01:42:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # IFS=: 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@21 -- # val= 00:06:36.672 01:42:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # IFS=: 00:06:36.672 01:42:25 -- accel/accel.sh@20 -- # read -r var val 00:06:36.672 01:42:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:36.672 01:42:25 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:36.672 01:42:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:36.672 00:06:36.672 real 0m3.047s 00:06:36.672 user 0m2.745s 00:06:36.672 sys 0m0.292s 00:06:36.672 01:42:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.672 01:42:25 -- common/autotest_common.sh@10 -- # set +x 00:06:36.672 ************************************ 00:06:36.672 END TEST accel_deomp_full_mthread 00:06:36.672 ************************************ 00:06:36.672 01:42:25 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:36.672 01:42:25 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:36.672 01:42:25 -- accel/accel.sh@129 -- # build_accel_config 00:06:36.672 01:42:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:36.672 01:42:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.673 01:42:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.673 01:42:25 -- common/autotest_common.sh@10 -- # set +x 00:06:36.673 01:42:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.673 01:42:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.673 01:42:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.673 01:42:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.673 01:42:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.673 01:42:25 -- accel/accel.sh@42 -- # jq -r . 00:06:36.673 ************************************ 00:06:36.673 START TEST accel_dif_functional_tests 00:06:36.673 ************************************ 00:06:36.673 01:42:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:36.673 [2024-11-19 01:42:25.137788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.673 [2024-11-19 01:42:25.137872] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3338029 ] 00:06:36.673 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.673 [2024-11-19 01:42:25.198851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:36.931 [2024-11-19 01:42:25.319806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:36.931 [2024-11-19 01:42:25.319863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:36.931 [2024-11-19 01:42:25.319867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.931 00:06:36.931 00:06:36.931 CUnit - A unit testing framework for C - Version 2.1-3 00:06:36.931 http://cunit.sourceforge.net/ 00:06:36.931 00:06:36.931 00:06:36.931 Suite: accel_dif 00:06:36.931 Test: verify: DIF generated, GUARD check ...passed 00:06:36.931 Test: verify: DIF generated, APPTAG check ...passed 00:06:36.931 Test: verify: DIF generated, REFTAG check ...passed 00:06:36.931 Test: verify: DIF not generated, GUARD check ...[2024-11-19 01:42:25.422897] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:36.931 [2024-11-19 01:42:25.422965] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:36.931 passed 00:06:36.931 Test: verify: DIF not generated, APPTAG check ...[2024-11-19 01:42:25.423009] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:36.931 [2024-11-19 01:42:25.423039] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:36.931 passed 00:06:36.932 Test: verify: DIF not generated, REFTAG check ...[2024-11-19 01:42:25.423074] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:36.932 [2024-11-19 01:42:25.423101] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:36.932 passed 00:06:36.932 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:36.932 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-19 01:42:25.423170] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:36.932 passed 00:06:36.932 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:36.932 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:36.932 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:36.932 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-19 01:42:25.423321] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:36.932 passed 00:06:36.932 Test: generate copy: DIF generated, GUARD check ...passed 00:06:36.932 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:36.932 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:36.932 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:36.932 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:36.932 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:36.932 Test: generate copy: iovecs-len validate ...[2024-11-19 01:42:25.423583] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:36.932 passed 00:06:36.932 Test: generate copy: buffer alignment validate ...passed 00:06:36.932 00:06:36.932 Run Summary: Type Total Ran Passed Failed Inactive 00:06:36.932 suites 1 1 n/a 0 0 00:06:36.932 tests 20 20 20 0 0 00:06:36.932 asserts 204 204 204 0 n/a 00:06:36.932 00:06:36.932 Elapsed time = 0.003 seconds 00:06:37.190 00:06:37.190 real 0m0.592s 00:06:37.190 user 0m0.903s 00:06:37.190 sys 0m0.191s 00:06:37.190 01:42:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.190 01:42:25 -- common/autotest_common.sh@10 -- # set +x 00:06:37.190 ************************************ 00:06:37.190 END TEST accel_dif_functional_tests 00:06:37.190 ************************************ 00:06:37.190 00:06:37.190 real 1m3.389s 00:06:37.190 user 1m11.128s 00:06:37.190 sys 0m7.303s 00:06:37.190 01:42:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.190 01:42:25 -- common/autotest_common.sh@10 -- # set +x 00:06:37.190 ************************************ 00:06:37.190 END TEST accel 00:06:37.190 ************************************ 00:06:37.449 01:42:25 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:37.449 01:42:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.449 01:42:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.449 01:42:25 -- common/autotest_common.sh@10 -- # set +x 00:06:37.449 ************************************ 00:06:37.449 START TEST accel_rpc 00:06:37.449 ************************************ 00:06:37.449 01:42:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:37.449 * Looking for test storage... 00:06:37.449 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:37.449 01:42:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:37.449 01:42:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:37.449 01:42:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:37.449 01:42:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:37.449 01:42:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:37.449 01:42:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:37.449 01:42:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:37.449 01:42:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:37.449 01:42:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:37.449 01:42:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:37.449 01:42:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:37.449 01:42:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:37.449 01:42:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:37.449 01:42:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:37.449 01:42:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:37.449 01:42:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:37.449 01:42:25 -- scripts/common.sh@344 -- # : 1 00:06:37.449 01:42:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:37.449 01:42:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:37.449 01:42:25 -- scripts/common.sh@364 -- # decimal 1 00:06:37.449 01:42:25 -- scripts/common.sh@352 -- # local d=1 00:06:37.449 01:42:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:37.449 01:42:25 -- scripts/common.sh@354 -- # echo 1 00:06:37.449 01:42:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:37.449 01:42:25 -- scripts/common.sh@365 -- # decimal 2 00:06:37.449 01:42:25 -- scripts/common.sh@352 -- # local d=2 00:06:37.449 01:42:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:37.449 01:42:25 -- scripts/common.sh@354 -- # echo 2 00:06:37.449 01:42:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:37.449 01:42:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:37.449 01:42:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:37.449 01:42:25 -- scripts/common.sh@367 -- # return 0 00:06:37.449 01:42:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:37.449 01:42:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:37.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.449 --rc genhtml_branch_coverage=1 00:06:37.449 --rc genhtml_function_coverage=1 00:06:37.449 --rc genhtml_legend=1 00:06:37.449 --rc geninfo_all_blocks=1 00:06:37.449 --rc geninfo_unexecuted_blocks=1 00:06:37.449 00:06:37.449 ' 00:06:37.449 01:42:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:37.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.449 --rc genhtml_branch_coverage=1 00:06:37.449 --rc genhtml_function_coverage=1 00:06:37.450 --rc genhtml_legend=1 00:06:37.450 --rc geninfo_all_blocks=1 00:06:37.450 --rc geninfo_unexecuted_blocks=1 00:06:37.450 00:06:37.450 ' 00:06:37.450 01:42:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:37.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.450 --rc genhtml_branch_coverage=1 00:06:37.450 --rc genhtml_function_coverage=1 00:06:37.450 --rc genhtml_legend=1 00:06:37.450 --rc geninfo_all_blocks=1 00:06:37.450 --rc geninfo_unexecuted_blocks=1 00:06:37.450 00:06:37.450 ' 00:06:37.450 01:42:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:37.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.450 --rc genhtml_branch_coverage=1 00:06:37.450 --rc genhtml_function_coverage=1 00:06:37.450 --rc genhtml_legend=1 00:06:37.450 --rc geninfo_all_blocks=1 00:06:37.450 --rc geninfo_unexecuted_blocks=1 00:06:37.450 00:06:37.450 ' 00:06:37.450 01:42:25 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:37.450 01:42:25 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3338230 00:06:37.450 01:42:25 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:37.450 01:42:25 -- accel/accel_rpc.sh@15 -- # waitforlisten 3338230 00:06:37.450 01:42:25 -- common/autotest_common.sh@829 -- # '[' -z 3338230 ']' 00:06:37.450 01:42:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.450 01:42:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.450 01:42:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.450 01:42:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.450 01:42:25 -- common/autotest_common.sh@10 -- # set +x 00:06:37.450 [2024-11-19 01:42:25.930602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.450 [2024-11-19 01:42:25.930700] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3338230 ] 00:06:37.450 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.450 [2024-11-19 01:42:25.993248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.708 [2024-11-19 01:42:26.111290] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.708 [2024-11-19 01:42:26.111463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.643 01:42:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.643 01:42:26 -- common/autotest_common.sh@862 -- # return 0 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:38.643 01:42:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:38.643 01:42:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.643 01:42:26 -- common/autotest_common.sh@10 -- # set +x 00:06:38.643 ************************************ 00:06:38.643 START TEST accel_assign_opcode 00:06:38.643 ************************************ 00:06:38.643 01:42:26 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:38.643 01:42:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.643 01:42:26 -- common/autotest_common.sh@10 -- # set +x 00:06:38.643 [2024-11-19 01:42:26.921966] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:38.643 01:42:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:38.643 01:42:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.643 01:42:26 -- common/autotest_common.sh@10 -- # set +x 00:06:38.643 [2024-11-19 01:42:26.929972] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:38.643 01:42:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.643 01:42:26 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:38.643 01:42:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.643 01:42:26 -- common/autotest_common.sh@10 -- # set +x 00:06:38.643 01:42:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.643 01:42:27 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:38.643 01:42:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.643 01:42:27 -- common/autotest_common.sh@10 -- # set +x 00:06:38.643 01:42:27 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:38.643 01:42:27 -- accel/accel_rpc.sh@42 -- # grep software 00:06:38.902 01:42:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.902 software 00:06:38.902 00:06:38.902 real 0m0.309s 00:06:38.902 user 0m0.044s 00:06:38.902 sys 0m0.005s 00:06:38.902 01:42:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.902 01:42:27 -- common/autotest_common.sh@10 -- # set +x 00:06:38.902 ************************************ 00:06:38.902 END TEST accel_assign_opcode 00:06:38.902 ************************************ 00:06:38.902 01:42:27 -- accel/accel_rpc.sh@55 -- # killprocess 3338230 00:06:38.902 01:42:27 -- common/autotest_common.sh@936 -- # '[' -z 3338230 ']' 00:06:38.902 01:42:27 -- common/autotest_common.sh@940 -- # kill -0 3338230 00:06:38.902 01:42:27 -- common/autotest_common.sh@941 -- # uname 00:06:38.902 01:42:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:38.902 01:42:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3338230 00:06:38.902 01:42:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:38.902 01:42:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:38.902 01:42:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3338230' 00:06:38.902 killing process with pid 3338230 00:06:38.902 01:42:27 -- common/autotest_common.sh@955 -- # kill 3338230 00:06:38.902 01:42:27 -- common/autotest_common.sh@960 -- # wait 3338230 00:06:39.468 00:06:39.468 real 0m2.011s 00:06:39.468 user 0m2.184s 00:06:39.468 sys 0m0.455s 00:06:39.468 01:42:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.468 01:42:27 -- common/autotest_common.sh@10 -- # set +x 00:06:39.468 ************************************ 00:06:39.468 END TEST accel_rpc 00:06:39.468 ************************************ 00:06:39.468 01:42:27 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:39.468 01:42:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.468 01:42:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.468 01:42:27 -- common/autotest_common.sh@10 -- # set +x 00:06:39.468 ************************************ 00:06:39.468 START TEST app_cmdline 00:06:39.468 ************************************ 00:06:39.468 01:42:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:39.468 * Looking for test storage... 00:06:39.468 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:39.468 01:42:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:39.468 01:42:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:39.468 01:42:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:39.468 01:42:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:39.468 01:42:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:39.468 01:42:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:39.469 01:42:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:39.469 01:42:27 -- scripts/common.sh@335 -- # IFS=.-: 00:06:39.469 01:42:27 -- scripts/common.sh@335 -- # read -ra ver1 00:06:39.469 01:42:27 -- scripts/common.sh@336 -- # IFS=.-: 00:06:39.469 01:42:27 -- scripts/common.sh@336 -- # read -ra ver2 00:06:39.469 01:42:27 -- scripts/common.sh@337 -- # local 'op=<' 00:06:39.469 01:42:27 -- scripts/common.sh@339 -- # ver1_l=2 00:06:39.469 01:42:27 -- scripts/common.sh@340 -- # ver2_l=1 00:06:39.469 01:42:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:39.469 01:42:27 -- scripts/common.sh@343 -- # case "$op" in 00:06:39.469 01:42:27 -- scripts/common.sh@344 -- # : 1 00:06:39.469 01:42:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:39.469 01:42:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:39.469 01:42:27 -- scripts/common.sh@364 -- # decimal 1 00:06:39.469 01:42:27 -- scripts/common.sh@352 -- # local d=1 00:06:39.469 01:42:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:39.469 01:42:27 -- scripts/common.sh@354 -- # echo 1 00:06:39.469 01:42:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:39.469 01:42:27 -- scripts/common.sh@365 -- # decimal 2 00:06:39.469 01:42:27 -- scripts/common.sh@352 -- # local d=2 00:06:39.469 01:42:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:39.469 01:42:27 -- scripts/common.sh@354 -- # echo 2 00:06:39.469 01:42:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:39.469 01:42:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:39.469 01:42:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:39.469 01:42:27 -- scripts/common.sh@367 -- # return 0 00:06:39.469 01:42:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:39.469 01:42:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:39.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.469 --rc genhtml_branch_coverage=1 00:06:39.469 --rc genhtml_function_coverage=1 00:06:39.469 --rc genhtml_legend=1 00:06:39.469 --rc geninfo_all_blocks=1 00:06:39.469 --rc geninfo_unexecuted_blocks=1 00:06:39.469 00:06:39.469 ' 00:06:39.469 01:42:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:39.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.469 --rc genhtml_branch_coverage=1 00:06:39.469 --rc genhtml_function_coverage=1 00:06:39.469 --rc genhtml_legend=1 00:06:39.469 --rc geninfo_all_blocks=1 00:06:39.469 --rc geninfo_unexecuted_blocks=1 00:06:39.469 00:06:39.469 ' 00:06:39.469 01:42:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:39.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.469 --rc genhtml_branch_coverage=1 00:06:39.469 --rc genhtml_function_coverage=1 00:06:39.469 --rc genhtml_legend=1 00:06:39.469 --rc geninfo_all_blocks=1 00:06:39.469 --rc geninfo_unexecuted_blocks=1 00:06:39.469 00:06:39.469 ' 00:06:39.469 01:42:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:39.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.469 --rc genhtml_branch_coverage=1 00:06:39.469 --rc genhtml_function_coverage=1 00:06:39.469 --rc genhtml_legend=1 00:06:39.469 --rc geninfo_all_blocks=1 00:06:39.469 --rc geninfo_unexecuted_blocks=1 00:06:39.469 00:06:39.469 ' 00:06:39.469 01:42:27 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:39.469 01:42:27 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3338493 00:06:39.469 01:42:27 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:39.469 01:42:27 -- app/cmdline.sh@18 -- # waitforlisten 3338493 00:06:39.469 01:42:27 -- common/autotest_common.sh@829 -- # '[' -z 3338493 ']' 00:06:39.469 01:42:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.469 01:42:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.469 01:42:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.469 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.469 01:42:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.469 01:42:27 -- common/autotest_common.sh@10 -- # set +x 00:06:39.469 [2024-11-19 01:42:27.968964] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.469 [2024-11-19 01:42:27.969069] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3338493 ] 00:06:39.469 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.727 [2024-11-19 01:42:28.028155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.727 [2024-11-19 01:42:28.133812] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.727 [2024-11-19 01:42:28.133983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.669 01:42:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.669 01:42:28 -- common/autotest_common.sh@862 -- # return 0 00:06:40.669 01:42:28 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:40.927 { 00:06:40.927 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:40.927 "fields": { 00:06:40.927 "major": 24, 00:06:40.927 "minor": 1, 00:06:40.927 "patch": 1, 00:06:40.927 "suffix": "-pre", 00:06:40.927 "commit": "c13c99a5e" 00:06:40.927 } 00:06:40.927 } 00:06:40.927 01:42:29 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:40.927 01:42:29 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:40.927 01:42:29 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:40.927 01:42:29 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:40.927 01:42:29 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:40.927 01:42:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.927 01:42:29 -- common/autotest_common.sh@10 -- # set +x 00:06:40.927 01:42:29 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:40.927 01:42:29 -- app/cmdline.sh@26 -- # sort 00:06:40.927 01:42:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.927 01:42:29 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:40.927 01:42:29 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:40.927 01:42:29 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:40.927 01:42:29 -- common/autotest_common.sh@650 -- # local es=0 00:06:40.927 01:42:29 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:40.927 01:42:29 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.927 01:42:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.927 01:42:29 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.927 01:42:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.927 01:42:29 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.927 01:42:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.927 01:42:29 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.927 01:42:29 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:40.927 01:42:29 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:41.186 request: 00:06:41.186 { 00:06:41.186 "method": "env_dpdk_get_mem_stats", 00:06:41.186 "req_id": 1 00:06:41.186 } 00:06:41.186 Got JSON-RPC error response 00:06:41.186 response: 00:06:41.186 { 00:06:41.186 "code": -32601, 00:06:41.186 "message": "Method not found" 00:06:41.186 } 00:06:41.186 01:42:29 -- common/autotest_common.sh@653 -- # es=1 00:06:41.186 01:42:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:41.186 01:42:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:41.186 01:42:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:41.186 01:42:29 -- app/cmdline.sh@1 -- # killprocess 3338493 00:06:41.186 01:42:29 -- common/autotest_common.sh@936 -- # '[' -z 3338493 ']' 00:06:41.186 01:42:29 -- common/autotest_common.sh@940 -- # kill -0 3338493 00:06:41.186 01:42:29 -- common/autotest_common.sh@941 -- # uname 00:06:41.186 01:42:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.186 01:42:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3338493 00:06:41.186 01:42:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.186 01:42:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.186 01:42:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3338493' 00:06:41.186 killing process with pid 3338493 00:06:41.186 01:42:29 -- common/autotest_common.sh@955 -- # kill 3338493 00:06:41.186 01:42:29 -- common/autotest_common.sh@960 -- # wait 3338493 00:06:41.752 00:06:41.752 real 0m2.357s 00:06:41.752 user 0m3.016s 00:06:41.752 sys 0m0.552s 00:06:41.752 01:42:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.752 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:41.752 ************************************ 00:06:41.752 END TEST app_cmdline 00:06:41.752 ************************************ 00:06:41.752 01:42:30 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:41.752 01:42:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.752 01:42:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.752 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:41.752 ************************************ 00:06:41.752 START TEST version 00:06:41.752 ************************************ 00:06:41.752 01:42:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:41.752 * Looking for test storage... 00:06:41.752 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:41.752 01:42:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:41.752 01:42:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:41.752 01:42:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:41.752 01:42:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:41.752 01:42:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:41.752 01:42:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:41.752 01:42:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:41.752 01:42:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:41.752 01:42:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:41.752 01:42:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:41.752 01:42:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:41.752 01:42:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:41.752 01:42:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:41.752 01:42:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:41.752 01:42:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:41.752 01:42:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:41.752 01:42:30 -- scripts/common.sh@344 -- # : 1 00:06:41.752 01:42:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:41.752 01:42:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:41.752 01:42:30 -- scripts/common.sh@364 -- # decimal 1 00:06:42.012 01:42:30 -- scripts/common.sh@352 -- # local d=1 00:06:42.012 01:42:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:42.012 01:42:30 -- scripts/common.sh@354 -- # echo 1 00:06:42.012 01:42:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:42.012 01:42:30 -- scripts/common.sh@365 -- # decimal 2 00:06:42.012 01:42:30 -- scripts/common.sh@352 -- # local d=2 00:06:42.012 01:42:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:42.012 01:42:30 -- scripts/common.sh@354 -- # echo 2 00:06:42.012 01:42:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:42.012 01:42:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:42.012 01:42:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:42.012 01:42:30 -- scripts/common.sh@367 -- # return 0 00:06:42.012 01:42:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:42.012 01:42:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:42.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.012 --rc genhtml_branch_coverage=1 00:06:42.012 --rc genhtml_function_coverage=1 00:06:42.012 --rc genhtml_legend=1 00:06:42.012 --rc geninfo_all_blocks=1 00:06:42.012 --rc geninfo_unexecuted_blocks=1 00:06:42.012 00:06:42.012 ' 00:06:42.012 01:42:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:42.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.012 --rc genhtml_branch_coverage=1 00:06:42.012 --rc genhtml_function_coverage=1 00:06:42.012 --rc genhtml_legend=1 00:06:42.012 --rc geninfo_all_blocks=1 00:06:42.012 --rc geninfo_unexecuted_blocks=1 00:06:42.012 00:06:42.012 ' 00:06:42.012 01:42:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:42.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.012 --rc genhtml_branch_coverage=1 00:06:42.012 --rc genhtml_function_coverage=1 00:06:42.012 --rc genhtml_legend=1 00:06:42.012 --rc geninfo_all_blocks=1 00:06:42.012 --rc geninfo_unexecuted_blocks=1 00:06:42.012 00:06:42.012 ' 00:06:42.012 01:42:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:42.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.012 --rc genhtml_branch_coverage=1 00:06:42.012 --rc genhtml_function_coverage=1 00:06:42.012 --rc genhtml_legend=1 00:06:42.012 --rc geninfo_all_blocks=1 00:06:42.012 --rc geninfo_unexecuted_blocks=1 00:06:42.012 00:06:42.012 ' 00:06:42.012 01:42:30 -- app/version.sh@17 -- # get_header_version major 00:06:42.012 01:42:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:42.012 01:42:30 -- app/version.sh@14 -- # cut -f2 00:06:42.012 01:42:30 -- app/version.sh@14 -- # tr -d '"' 00:06:42.012 01:42:30 -- app/version.sh@17 -- # major=24 00:06:42.012 01:42:30 -- app/version.sh@18 -- # get_header_version minor 00:06:42.012 01:42:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:42.012 01:42:30 -- app/version.sh@14 -- # cut -f2 00:06:42.012 01:42:30 -- app/version.sh@14 -- # tr -d '"' 00:06:42.012 01:42:30 -- app/version.sh@18 -- # minor=1 00:06:42.012 01:42:30 -- app/version.sh@19 -- # get_header_version patch 00:06:42.012 01:42:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:42.012 01:42:30 -- app/version.sh@14 -- # cut -f2 00:06:42.012 01:42:30 -- app/version.sh@14 -- # tr -d '"' 00:06:42.012 01:42:30 -- app/version.sh@19 -- # patch=1 00:06:42.012 01:42:30 -- app/version.sh@20 -- # get_header_version suffix 00:06:42.012 01:42:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:42.012 01:42:30 -- app/version.sh@14 -- # cut -f2 00:06:42.012 01:42:30 -- app/version.sh@14 -- # tr -d '"' 00:06:42.012 01:42:30 -- app/version.sh@20 -- # suffix=-pre 00:06:42.012 01:42:30 -- app/version.sh@22 -- # version=24.1 00:06:42.012 01:42:30 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:42.012 01:42:30 -- app/version.sh@25 -- # version=24.1.1 00:06:42.012 01:42:30 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:42.012 01:42:30 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:42.012 01:42:30 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:42.012 01:42:30 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:42.012 01:42:30 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:42.012 00:06:42.012 real 0m0.193s 00:06:42.012 user 0m0.126s 00:06:42.012 sys 0m0.093s 00:06:42.012 01:42:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.012 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:42.012 ************************************ 00:06:42.012 END TEST version 00:06:42.012 ************************************ 00:06:42.012 01:42:30 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@191 -- # uname -s 00:06:42.012 01:42:30 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:42.012 01:42:30 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:42.012 01:42:30 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:42.012 01:42:30 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:42.012 01:42:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:42.012 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:42.012 01:42:30 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:42.012 01:42:30 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:42.012 01:42:30 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:42.012 01:42:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:42.012 01:42:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.012 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:42.012 ************************************ 00:06:42.012 START TEST nvmf_tcp 00:06:42.012 ************************************ 00:06:42.012 01:42:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:42.012 * Looking for test storage... 00:06:42.012 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:42.012 01:42:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:42.012 01:42:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:42.012 01:42:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:42.012 01:42:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:42.012 01:42:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:42.012 01:42:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:42.012 01:42:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:42.012 01:42:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:42.012 01:42:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:42.012 01:42:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:42.012 01:42:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:42.012 01:42:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:42.012 01:42:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:42.012 01:42:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:42.012 01:42:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:42.012 01:42:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:42.012 01:42:30 -- scripts/common.sh@344 -- # : 1 00:06:42.012 01:42:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:42.013 01:42:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:42.013 01:42:30 -- scripts/common.sh@364 -- # decimal 1 00:06:42.013 01:42:30 -- scripts/common.sh@352 -- # local d=1 00:06:42.013 01:42:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:42.013 01:42:30 -- scripts/common.sh@354 -- # echo 1 00:06:42.013 01:42:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:42.013 01:42:30 -- scripts/common.sh@365 -- # decimal 2 00:06:42.013 01:42:30 -- scripts/common.sh@352 -- # local d=2 00:06:42.013 01:42:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:42.013 01:42:30 -- scripts/common.sh@354 -- # echo 2 00:06:42.013 01:42:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:42.013 01:42:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:42.013 01:42:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:42.013 01:42:30 -- scripts/common.sh@367 -- # return 0 00:06:42.013 01:42:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:42.013 01:42:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:42.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.013 --rc genhtml_branch_coverage=1 00:06:42.013 --rc genhtml_function_coverage=1 00:06:42.013 --rc genhtml_legend=1 00:06:42.013 --rc geninfo_all_blocks=1 00:06:42.013 --rc geninfo_unexecuted_blocks=1 00:06:42.013 00:06:42.013 ' 00:06:42.013 01:42:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:42.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.013 --rc genhtml_branch_coverage=1 00:06:42.013 --rc genhtml_function_coverage=1 00:06:42.013 --rc genhtml_legend=1 00:06:42.013 --rc geninfo_all_blocks=1 00:06:42.013 --rc geninfo_unexecuted_blocks=1 00:06:42.013 00:06:42.013 ' 00:06:42.013 01:42:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:42.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.013 --rc genhtml_branch_coverage=1 00:06:42.013 --rc genhtml_function_coverage=1 00:06:42.013 --rc genhtml_legend=1 00:06:42.013 --rc geninfo_all_blocks=1 00:06:42.013 --rc geninfo_unexecuted_blocks=1 00:06:42.013 00:06:42.013 ' 00:06:42.013 01:42:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:42.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.013 --rc genhtml_branch_coverage=1 00:06:42.013 --rc genhtml_function_coverage=1 00:06:42.013 --rc genhtml_legend=1 00:06:42.013 --rc geninfo_all_blocks=1 00:06:42.013 --rc geninfo_unexecuted_blocks=1 00:06:42.013 00:06:42.013 ' 00:06:42.013 01:42:30 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:42.013 01:42:30 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:42.013 01:42:30 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:42.013 01:42:30 -- nvmf/common.sh@7 -- # uname -s 00:06:42.013 01:42:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:42.013 01:42:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:42.013 01:42:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:42.013 01:42:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:42.013 01:42:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:42.013 01:42:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:42.013 01:42:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:42.013 01:42:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:42.013 01:42:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:42.013 01:42:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:42.013 01:42:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.013 01:42:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.013 01:42:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:42.013 01:42:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:42.013 01:42:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:42.013 01:42:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:42.013 01:42:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:42.013 01:42:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:42.013 01:42:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:42.013 01:42:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.013 01:42:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.013 01:42:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.013 01:42:30 -- paths/export.sh@5 -- # export PATH 00:06:42.013 01:42:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.013 01:42:30 -- nvmf/common.sh@46 -- # : 0 00:06:42.013 01:42:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:42.013 01:42:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:42.013 01:42:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:42.013 01:42:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:42.013 01:42:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:42.013 01:42:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:42.013 01:42:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:42.013 01:42:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:42.013 01:42:30 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:42.013 01:42:30 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:42.013 01:42:30 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:42.013 01:42:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:42.013 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:42.272 01:42:30 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:42.272 01:42:30 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:42.272 01:42:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:42.272 01:42:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.272 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:42.272 ************************************ 00:06:42.272 START TEST nvmf_example 00:06:42.272 ************************************ 00:06:42.272 01:42:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:42.272 * Looking for test storage... 00:06:42.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:42.272 01:42:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:42.272 01:42:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:42.272 01:42:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:42.272 01:42:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:42.272 01:42:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:42.272 01:42:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:42.272 01:42:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:42.272 01:42:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:42.272 01:42:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:42.272 01:42:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:42.272 01:42:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:42.272 01:42:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:42.272 01:42:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:42.272 01:42:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:42.272 01:42:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:42.272 01:42:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:42.272 01:42:30 -- scripts/common.sh@344 -- # : 1 00:06:42.272 01:42:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:42.272 01:42:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:42.272 01:42:30 -- scripts/common.sh@364 -- # decimal 1 00:06:42.272 01:42:30 -- scripts/common.sh@352 -- # local d=1 00:06:42.272 01:42:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:42.272 01:42:30 -- scripts/common.sh@354 -- # echo 1 00:06:42.273 01:42:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:42.273 01:42:30 -- scripts/common.sh@365 -- # decimal 2 00:06:42.273 01:42:30 -- scripts/common.sh@352 -- # local d=2 00:06:42.273 01:42:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:42.273 01:42:30 -- scripts/common.sh@354 -- # echo 2 00:06:42.273 01:42:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:42.273 01:42:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:42.273 01:42:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:42.273 01:42:30 -- scripts/common.sh@367 -- # return 0 00:06:42.273 01:42:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:42.273 01:42:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:42.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.273 --rc genhtml_branch_coverage=1 00:06:42.273 --rc genhtml_function_coverage=1 00:06:42.273 --rc genhtml_legend=1 00:06:42.273 --rc geninfo_all_blocks=1 00:06:42.273 --rc geninfo_unexecuted_blocks=1 00:06:42.273 00:06:42.273 ' 00:06:42.273 01:42:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:42.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.273 --rc genhtml_branch_coverage=1 00:06:42.273 --rc genhtml_function_coverage=1 00:06:42.273 --rc genhtml_legend=1 00:06:42.273 --rc geninfo_all_blocks=1 00:06:42.273 --rc geninfo_unexecuted_blocks=1 00:06:42.273 00:06:42.273 ' 00:06:42.273 01:42:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:42.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.273 --rc genhtml_branch_coverage=1 00:06:42.273 --rc genhtml_function_coverage=1 00:06:42.273 --rc genhtml_legend=1 00:06:42.273 --rc geninfo_all_blocks=1 00:06:42.273 --rc geninfo_unexecuted_blocks=1 00:06:42.273 00:06:42.273 ' 00:06:42.273 01:42:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:42.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:42.273 --rc genhtml_branch_coverage=1 00:06:42.273 --rc genhtml_function_coverage=1 00:06:42.273 --rc genhtml_legend=1 00:06:42.273 --rc geninfo_all_blocks=1 00:06:42.273 --rc geninfo_unexecuted_blocks=1 00:06:42.273 00:06:42.273 ' 00:06:42.273 01:42:30 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:42.273 01:42:30 -- nvmf/common.sh@7 -- # uname -s 00:06:42.273 01:42:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:42.273 01:42:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:42.273 01:42:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:42.273 01:42:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:42.273 01:42:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:42.273 01:42:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:42.273 01:42:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:42.273 01:42:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:42.273 01:42:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:42.273 01:42:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:42.273 01:42:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.273 01:42:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.273 01:42:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:42.273 01:42:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:42.273 01:42:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:42.273 01:42:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:42.273 01:42:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:42.273 01:42:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:42.273 01:42:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:42.273 01:42:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.273 01:42:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.273 01:42:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.273 01:42:30 -- paths/export.sh@5 -- # export PATH 00:06:42.273 01:42:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.273 01:42:30 -- nvmf/common.sh@46 -- # : 0 00:06:42.273 01:42:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:42.273 01:42:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:42.273 01:42:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:42.273 01:42:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:42.273 01:42:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:42.273 01:42:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:42.273 01:42:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:42.273 01:42:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:42.273 01:42:30 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:42.273 01:42:30 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:42.273 01:42:30 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:42.273 01:42:30 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:42.273 01:42:30 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:42.273 01:42:30 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:42.273 01:42:30 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:42.273 01:42:30 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:42.273 01:42:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:42.273 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:42.273 01:42:30 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:42.273 01:42:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:42.273 01:42:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:42.273 01:42:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:42.273 01:42:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:42.273 01:42:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:42.273 01:42:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:42.273 01:42:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:42.273 01:42:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:42.273 01:42:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:42.273 01:42:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:42.273 01:42:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:42.273 01:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:44.174 01:42:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:44.174 01:42:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:44.174 01:42:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:44.174 01:42:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:44.174 01:42:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:44.174 01:42:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:44.174 01:42:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:44.174 01:42:32 -- nvmf/common.sh@294 -- # net_devs=() 00:06:44.174 01:42:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:44.174 01:42:32 -- nvmf/common.sh@295 -- # e810=() 00:06:44.174 01:42:32 -- nvmf/common.sh@295 -- # local -ga e810 00:06:44.174 01:42:32 -- nvmf/common.sh@296 -- # x722=() 00:06:44.174 01:42:32 -- nvmf/common.sh@296 -- # local -ga x722 00:06:44.174 01:42:32 -- nvmf/common.sh@297 -- # mlx=() 00:06:44.174 01:42:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:44.174 01:42:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:44.174 01:42:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:44.174 01:42:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:44.174 01:42:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:44.174 01:42:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:44.174 01:42:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:44.174 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:44.174 01:42:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:44.174 01:42:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:44.174 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:44.174 01:42:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:44.174 01:42:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:44.174 01:42:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:44.174 01:42:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:44.174 01:42:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:44.174 01:42:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:44.174 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:44.174 01:42:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:44.174 01:42:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:44.174 01:42:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:44.174 01:42:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:44.174 01:42:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:44.174 01:42:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:44.174 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:44.174 01:42:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:44.174 01:42:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:44.174 01:42:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:44.174 01:42:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:44.174 01:42:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:44.174 01:42:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:44.174 01:42:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:44.174 01:42:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:44.174 01:42:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:44.174 01:42:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:44.174 01:42:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:44.174 01:42:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:44.174 01:42:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:44.174 01:42:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:44.174 01:42:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:44.174 01:42:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:44.174 01:42:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:44.174 01:42:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:44.174 01:42:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:44.174 01:42:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:44.174 01:42:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:44.174 01:42:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:44.433 01:42:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:44.433 01:42:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:44.433 01:42:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:44.433 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:44.433 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:06:44.433 00:06:44.433 --- 10.0.0.2 ping statistics --- 00:06:44.433 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.433 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:06:44.433 01:42:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:44.433 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:44.433 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:06:44.433 00:06:44.433 --- 10.0.0.1 ping statistics --- 00:06:44.433 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.433 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:06:44.433 01:42:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:44.433 01:42:32 -- nvmf/common.sh@410 -- # return 0 00:06:44.433 01:42:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:44.433 01:42:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:44.433 01:42:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:44.433 01:42:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:44.433 01:42:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:44.433 01:42:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:44.433 01:42:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:44.433 01:42:32 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:44.433 01:42:32 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:44.433 01:42:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:44.433 01:42:32 -- common/autotest_common.sh@10 -- # set +x 00:06:44.433 01:42:32 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:44.433 01:42:32 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:44.433 01:42:32 -- target/nvmf_example.sh@34 -- # nvmfpid=3340636 00:06:44.433 01:42:32 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:44.433 01:42:32 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:44.433 01:42:32 -- target/nvmf_example.sh@36 -- # waitforlisten 3340636 00:06:44.433 01:42:32 -- common/autotest_common.sh@829 -- # '[' -z 3340636 ']' 00:06:44.433 01:42:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.433 01:42:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.433 01:42:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.433 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.433 01:42:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.433 01:42:32 -- common/autotest_common.sh@10 -- # set +x 00:06:44.433 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.368 01:42:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:45.368 01:42:33 -- common/autotest_common.sh@862 -- # return 0 00:06:45.368 01:42:33 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:45.368 01:42:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:45.368 01:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.368 01:42:33 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:45.368 01:42:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.368 01:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.368 01:42:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.368 01:42:33 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:45.368 01:42:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.368 01:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.368 01:42:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.368 01:42:33 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:45.368 01:42:33 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:45.368 01:42:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.368 01:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.368 01:42:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.368 01:42:33 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:45.368 01:42:33 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:45.368 01:42:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.368 01:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.368 01:42:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.368 01:42:33 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:45.368 01:42:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.368 01:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.368 01:42:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.368 01:42:33 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:45.368 01:42:33 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:45.368 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.567 Initializing NVMe Controllers 00:06:57.567 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:57.567 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:57.567 Initialization complete. Launching workers. 00:06:57.567 ======================================================== 00:06:57.567 Latency(us) 00:06:57.567 Device Information : IOPS MiB/s Average min max 00:06:57.567 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14965.66 58.46 4276.42 739.30 15906.63 00:06:57.567 ======================================================== 00:06:57.567 Total : 14965.66 58.46 4276.42 739.30 15906.63 00:06:57.567 00:06:57.567 01:42:44 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:57.567 01:42:44 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:57.567 01:42:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:57.567 01:42:44 -- nvmf/common.sh@116 -- # sync 00:06:57.567 01:42:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:57.567 01:42:44 -- nvmf/common.sh@119 -- # set +e 00:06:57.567 01:42:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:57.567 01:42:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:57.567 rmmod nvme_tcp 00:06:57.567 rmmod nvme_fabrics 00:06:57.567 rmmod nvme_keyring 00:06:57.567 01:42:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:57.567 01:42:44 -- nvmf/common.sh@123 -- # set -e 00:06:57.567 01:42:44 -- nvmf/common.sh@124 -- # return 0 00:06:57.567 01:42:44 -- nvmf/common.sh@477 -- # '[' -n 3340636 ']' 00:06:57.567 01:42:44 -- nvmf/common.sh@478 -- # killprocess 3340636 00:06:57.567 01:42:44 -- common/autotest_common.sh@936 -- # '[' -z 3340636 ']' 00:06:57.567 01:42:44 -- common/autotest_common.sh@940 -- # kill -0 3340636 00:06:57.567 01:42:44 -- common/autotest_common.sh@941 -- # uname 00:06:57.567 01:42:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:57.567 01:42:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3340636 00:06:57.567 01:42:44 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:57.567 01:42:44 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:57.567 01:42:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3340636' 00:06:57.567 killing process with pid 3340636 00:06:57.567 01:42:44 -- common/autotest_common.sh@955 -- # kill 3340636 00:06:57.567 01:42:44 -- common/autotest_common.sh@960 -- # wait 3340636 00:06:57.567 nvmf threads initialize successfully 00:06:57.567 bdev subsystem init successfully 00:06:57.567 created a nvmf target service 00:06:57.567 create targets's poll groups done 00:06:57.567 all subsystems of target started 00:06:57.567 nvmf target is running 00:06:57.568 all subsystems of target stopped 00:06:57.568 destroy targets's poll groups done 00:06:57.568 destroyed the nvmf target service 00:06:57.568 bdev subsystem finish successfully 00:06:57.568 nvmf threads destroy successfully 00:06:57.568 01:42:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:57.568 01:42:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:57.568 01:42:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:57.568 01:42:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:57.568 01:42:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:57.568 01:42:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:57.568 01:42:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:57.568 01:42:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:58.135 01:42:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:58.135 01:42:46 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:58.135 01:42:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:58.135 01:42:46 -- common/autotest_common.sh@10 -- # set +x 00:06:58.135 00:06:58.135 real 0m15.930s 00:06:58.135 user 0m44.407s 00:06:58.135 sys 0m3.587s 00:06:58.135 01:42:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.135 01:42:46 -- common/autotest_common.sh@10 -- # set +x 00:06:58.135 ************************************ 00:06:58.135 END TEST nvmf_example 00:06:58.135 ************************************ 00:06:58.135 01:42:46 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:58.135 01:42:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:58.135 01:42:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.135 01:42:46 -- common/autotest_common.sh@10 -- # set +x 00:06:58.135 ************************************ 00:06:58.135 START TEST nvmf_filesystem 00:06:58.135 ************************************ 00:06:58.135 01:42:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:58.135 * Looking for test storage... 00:06:58.135 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.135 01:42:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:58.135 01:42:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:58.135 01:42:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:58.135 01:42:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:58.135 01:42:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:58.135 01:42:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:58.135 01:42:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:58.135 01:42:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:58.135 01:42:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:58.135 01:42:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:58.135 01:42:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:58.135 01:42:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:58.135 01:42:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:58.135 01:42:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:58.135 01:42:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:58.135 01:42:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:58.135 01:42:46 -- scripts/common.sh@344 -- # : 1 00:06:58.135 01:42:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:58.135 01:42:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:58.135 01:42:46 -- scripts/common.sh@364 -- # decimal 1 00:06:58.135 01:42:46 -- scripts/common.sh@352 -- # local d=1 00:06:58.135 01:42:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:58.135 01:42:46 -- scripts/common.sh@354 -- # echo 1 00:06:58.135 01:42:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:58.135 01:42:46 -- scripts/common.sh@365 -- # decimal 2 00:06:58.135 01:42:46 -- scripts/common.sh@352 -- # local d=2 00:06:58.135 01:42:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:58.135 01:42:46 -- scripts/common.sh@354 -- # echo 2 00:06:58.135 01:42:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:58.135 01:42:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:58.135 01:42:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:58.135 01:42:46 -- scripts/common.sh@367 -- # return 0 00:06:58.135 01:42:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:58.135 01:42:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:58.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.135 --rc genhtml_branch_coverage=1 00:06:58.135 --rc genhtml_function_coverage=1 00:06:58.135 --rc genhtml_legend=1 00:06:58.135 --rc geninfo_all_blocks=1 00:06:58.135 --rc geninfo_unexecuted_blocks=1 00:06:58.135 00:06:58.135 ' 00:06:58.135 01:42:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:58.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.135 --rc genhtml_branch_coverage=1 00:06:58.135 --rc genhtml_function_coverage=1 00:06:58.135 --rc genhtml_legend=1 00:06:58.135 --rc geninfo_all_blocks=1 00:06:58.135 --rc geninfo_unexecuted_blocks=1 00:06:58.135 00:06:58.135 ' 00:06:58.135 01:42:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:58.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.135 --rc genhtml_branch_coverage=1 00:06:58.135 --rc genhtml_function_coverage=1 00:06:58.135 --rc genhtml_legend=1 00:06:58.135 --rc geninfo_all_blocks=1 00:06:58.135 --rc geninfo_unexecuted_blocks=1 00:06:58.135 00:06:58.135 ' 00:06:58.135 01:42:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:58.135 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.135 --rc genhtml_branch_coverage=1 00:06:58.135 --rc genhtml_function_coverage=1 00:06:58.135 --rc genhtml_legend=1 00:06:58.135 --rc geninfo_all_blocks=1 00:06:58.135 --rc geninfo_unexecuted_blocks=1 00:06:58.135 00:06:58.135 ' 00:06:58.135 01:42:46 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:58.135 01:42:46 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:58.135 01:42:46 -- common/autotest_common.sh@34 -- # set -e 00:06:58.135 01:42:46 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:58.135 01:42:46 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:58.135 01:42:46 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:58.135 01:42:46 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:58.135 01:42:46 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:58.135 01:42:46 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:58.135 01:42:46 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:58.135 01:42:46 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:58.135 01:42:46 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:58.135 01:42:46 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:58.135 01:42:46 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:58.135 01:42:46 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:58.135 01:42:46 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:58.135 01:42:46 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:58.135 01:42:46 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:58.135 01:42:46 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:58.135 01:42:46 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:58.135 01:42:46 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:58.135 01:42:46 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:58.136 01:42:46 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:58.136 01:42:46 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:58.136 01:42:46 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:58.136 01:42:46 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:58.136 01:42:46 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:58.136 01:42:46 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:58.136 01:42:46 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:58.136 01:42:46 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:58.136 01:42:46 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:58.136 01:42:46 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:58.136 01:42:46 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:58.136 01:42:46 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:58.136 01:42:46 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:58.136 01:42:46 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:58.136 01:42:46 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:58.136 01:42:46 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:58.136 01:42:46 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:58.136 01:42:46 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:58.136 01:42:46 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:58.136 01:42:46 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:58.136 01:42:46 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:58.136 01:42:46 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:58.136 01:42:46 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:58.136 01:42:46 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:58.136 01:42:46 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:58.136 01:42:46 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:58.136 01:42:46 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:58.136 01:42:46 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:58.136 01:42:46 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:58.136 01:42:46 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:58.136 01:42:46 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:58.136 01:42:46 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:58.136 01:42:46 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:58.136 01:42:46 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:58.136 01:42:46 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:58.136 01:42:46 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:58.136 01:42:46 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:58.136 01:42:46 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:58.136 01:42:46 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:58.136 01:42:46 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:58.136 01:42:46 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:58.136 01:42:46 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:58.136 01:42:46 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:58.136 01:42:46 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:58.136 01:42:46 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:58.136 01:42:46 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:58.136 01:42:46 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:58.136 01:42:46 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:58.136 01:42:46 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:58.136 01:42:46 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:58.136 01:42:46 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:58.136 01:42:46 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:58.136 01:42:46 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:58.136 01:42:46 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:58.136 01:42:46 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:58.136 01:42:46 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:58.136 01:42:46 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:58.136 01:42:46 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:58.136 01:42:46 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:58.136 01:42:46 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:58.136 01:42:46 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:58.136 01:42:46 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:58.136 01:42:46 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:58.136 01:42:46 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:58.136 01:42:46 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:58.136 01:42:46 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:58.136 01:42:46 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:58.136 01:42:46 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:58.136 01:42:46 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:58.136 01:42:46 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:58.136 01:42:46 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:58.136 01:42:46 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:58.136 01:42:46 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:58.136 01:42:46 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:58.136 01:42:46 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:58.136 01:42:46 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:58.136 01:42:46 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:58.136 01:42:46 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:58.136 01:42:46 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:58.136 01:42:46 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:58.136 #define SPDK_CONFIG_H 00:06:58.136 #define SPDK_CONFIG_APPS 1 00:06:58.136 #define SPDK_CONFIG_ARCH native 00:06:58.136 #undef SPDK_CONFIG_ASAN 00:06:58.136 #undef SPDK_CONFIG_AVAHI 00:06:58.136 #undef SPDK_CONFIG_CET 00:06:58.136 #define SPDK_CONFIG_COVERAGE 1 00:06:58.136 #define SPDK_CONFIG_CROSS_PREFIX 00:06:58.136 #undef SPDK_CONFIG_CRYPTO 00:06:58.136 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:58.136 #undef SPDK_CONFIG_CUSTOMOCF 00:06:58.136 #undef SPDK_CONFIG_DAOS 00:06:58.136 #define SPDK_CONFIG_DAOS_DIR 00:06:58.136 #define SPDK_CONFIG_DEBUG 1 00:06:58.136 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:58.136 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:58.136 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:58.136 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:58.136 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:58.136 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:58.136 #define SPDK_CONFIG_EXAMPLES 1 00:06:58.136 #undef SPDK_CONFIG_FC 00:06:58.136 #define SPDK_CONFIG_FC_PATH 00:06:58.136 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:58.136 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:58.136 #undef SPDK_CONFIG_FUSE 00:06:58.136 #undef SPDK_CONFIG_FUZZER 00:06:58.136 #define SPDK_CONFIG_FUZZER_LIB 00:06:58.136 #undef SPDK_CONFIG_GOLANG 00:06:58.136 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:58.136 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:58.136 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:58.136 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:58.136 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:58.136 #define SPDK_CONFIG_IDXD 1 00:06:58.136 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:58.136 #undef SPDK_CONFIG_IPSEC_MB 00:06:58.136 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:58.136 #define SPDK_CONFIG_ISAL 1 00:06:58.136 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:58.136 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:58.136 #define SPDK_CONFIG_LIBDIR 00:06:58.136 #undef SPDK_CONFIG_LTO 00:06:58.136 #define SPDK_CONFIG_MAX_LCORES 00:06:58.136 #define SPDK_CONFIG_NVME_CUSE 1 00:06:58.136 #undef SPDK_CONFIG_OCF 00:06:58.136 #define SPDK_CONFIG_OCF_PATH 00:06:58.136 #define SPDK_CONFIG_OPENSSL_PATH 00:06:58.136 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:58.136 #undef SPDK_CONFIG_PGO_USE 00:06:58.136 #define SPDK_CONFIG_PREFIX /usr/local 00:06:58.136 #undef SPDK_CONFIG_RAID5F 00:06:58.136 #undef SPDK_CONFIG_RBD 00:06:58.136 #define SPDK_CONFIG_RDMA 1 00:06:58.136 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:58.136 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:58.136 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:58.136 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:58.136 #define SPDK_CONFIG_SHARED 1 00:06:58.136 #undef SPDK_CONFIG_SMA 00:06:58.136 #define SPDK_CONFIG_TESTS 1 00:06:58.136 #undef SPDK_CONFIG_TSAN 00:06:58.136 #define SPDK_CONFIG_UBLK 1 00:06:58.136 #define SPDK_CONFIG_UBSAN 1 00:06:58.136 #undef SPDK_CONFIG_UNIT_TESTS 00:06:58.136 #undef SPDK_CONFIG_URING 00:06:58.136 #define SPDK_CONFIG_URING_PATH 00:06:58.136 #undef SPDK_CONFIG_URING_ZNS 00:06:58.136 #undef SPDK_CONFIG_USDT 00:06:58.136 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:58.136 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:58.136 #undef SPDK_CONFIG_VFIO_USER 00:06:58.136 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:58.136 #define SPDK_CONFIG_VHOST 1 00:06:58.136 #define SPDK_CONFIG_VIRTIO 1 00:06:58.136 #undef SPDK_CONFIG_VTUNE 00:06:58.136 #define SPDK_CONFIG_VTUNE_DIR 00:06:58.136 #define SPDK_CONFIG_WERROR 1 00:06:58.136 #define SPDK_CONFIG_WPDK_DIR 00:06:58.136 #undef SPDK_CONFIG_XNVME 00:06:58.136 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:58.136 01:42:46 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:58.136 01:42:46 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:58.136 01:42:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:58.136 01:42:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:58.136 01:42:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:58.137 01:42:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.137 01:42:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.137 01:42:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.137 01:42:46 -- paths/export.sh@5 -- # export PATH 00:06:58.137 01:42:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.137 01:42:46 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:58.137 01:42:46 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:58.137 01:42:46 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:58.137 01:42:46 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:58.396 01:42:46 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:58.396 01:42:46 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:58.396 01:42:46 -- pm/common@16 -- # TEST_TAG=N/A 00:06:58.396 01:42:46 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:58.396 01:42:46 -- common/autotest_common.sh@52 -- # : 1 00:06:58.396 01:42:46 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:58.396 01:42:46 -- common/autotest_common.sh@56 -- # : 0 00:06:58.396 01:42:46 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:58.396 01:42:46 -- common/autotest_common.sh@58 -- # : 0 00:06:58.396 01:42:46 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:58.396 01:42:46 -- common/autotest_common.sh@60 -- # : 1 00:06:58.396 01:42:46 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:58.396 01:42:46 -- common/autotest_common.sh@62 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:58.397 01:42:46 -- common/autotest_common.sh@64 -- # : 00:06:58.397 01:42:46 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:58.397 01:42:46 -- common/autotest_common.sh@66 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:58.397 01:42:46 -- common/autotest_common.sh@68 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:58.397 01:42:46 -- common/autotest_common.sh@70 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:58.397 01:42:46 -- common/autotest_common.sh@72 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:58.397 01:42:46 -- common/autotest_common.sh@74 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:58.397 01:42:46 -- common/autotest_common.sh@76 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:58.397 01:42:46 -- common/autotest_common.sh@78 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:58.397 01:42:46 -- common/autotest_common.sh@80 -- # : 1 00:06:58.397 01:42:46 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:58.397 01:42:46 -- common/autotest_common.sh@82 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:58.397 01:42:46 -- common/autotest_common.sh@84 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:58.397 01:42:46 -- common/autotest_common.sh@86 -- # : 1 00:06:58.397 01:42:46 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:58.397 01:42:46 -- common/autotest_common.sh@88 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:58.397 01:42:46 -- common/autotest_common.sh@90 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:58.397 01:42:46 -- common/autotest_common.sh@92 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:58.397 01:42:46 -- common/autotest_common.sh@94 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:58.397 01:42:46 -- common/autotest_common.sh@96 -- # : tcp 00:06:58.397 01:42:46 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:58.397 01:42:46 -- common/autotest_common.sh@98 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:58.397 01:42:46 -- common/autotest_common.sh@100 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:58.397 01:42:46 -- common/autotest_common.sh@102 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:58.397 01:42:46 -- common/autotest_common.sh@104 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:58.397 01:42:46 -- common/autotest_common.sh@106 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:58.397 01:42:46 -- common/autotest_common.sh@108 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:58.397 01:42:46 -- common/autotest_common.sh@110 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:58.397 01:42:46 -- common/autotest_common.sh@112 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:58.397 01:42:46 -- common/autotest_common.sh@114 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:58.397 01:42:46 -- common/autotest_common.sh@116 -- # : 1 00:06:58.397 01:42:46 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:58.397 01:42:46 -- common/autotest_common.sh@118 -- # : 00:06:58.397 01:42:46 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:58.397 01:42:46 -- common/autotest_common.sh@120 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:58.397 01:42:46 -- common/autotest_common.sh@122 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:58.397 01:42:46 -- common/autotest_common.sh@124 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:58.397 01:42:46 -- common/autotest_common.sh@126 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:58.397 01:42:46 -- common/autotest_common.sh@128 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:58.397 01:42:46 -- common/autotest_common.sh@130 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:58.397 01:42:46 -- common/autotest_common.sh@132 -- # : 00:06:58.397 01:42:46 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:58.397 01:42:46 -- common/autotest_common.sh@134 -- # : true 00:06:58.397 01:42:46 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:58.397 01:42:46 -- common/autotest_common.sh@136 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:58.397 01:42:46 -- common/autotest_common.sh@138 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:58.397 01:42:46 -- common/autotest_common.sh@140 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:58.397 01:42:46 -- common/autotest_common.sh@142 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:58.397 01:42:46 -- common/autotest_common.sh@144 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:58.397 01:42:46 -- common/autotest_common.sh@146 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:58.397 01:42:46 -- common/autotest_common.sh@148 -- # : e810 00:06:58.397 01:42:46 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:58.397 01:42:46 -- common/autotest_common.sh@150 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:58.397 01:42:46 -- common/autotest_common.sh@152 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:58.397 01:42:46 -- common/autotest_common.sh@154 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:58.397 01:42:46 -- common/autotest_common.sh@156 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:58.397 01:42:46 -- common/autotest_common.sh@158 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:58.397 01:42:46 -- common/autotest_common.sh@160 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:58.397 01:42:46 -- common/autotest_common.sh@163 -- # : 00:06:58.397 01:42:46 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:58.397 01:42:46 -- common/autotest_common.sh@165 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:58.397 01:42:46 -- common/autotest_common.sh@167 -- # : 0 00:06:58.397 01:42:46 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:58.397 01:42:46 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.397 01:42:46 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:58.397 01:42:46 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:58.397 01:42:46 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:58.397 01:42:46 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:58.397 01:42:46 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:58.397 01:42:46 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:58.397 01:42:46 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:58.397 01:42:46 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:58.398 01:42:46 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:58.398 01:42:46 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:58.398 01:42:46 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:58.398 01:42:46 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:58.398 01:42:46 -- common/autotest_common.sh@196 -- # cat 00:06:58.398 01:42:46 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:58.398 01:42:46 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:58.398 01:42:46 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:58.398 01:42:46 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:58.398 01:42:46 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:58.398 01:42:46 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:58.398 01:42:46 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:58.398 01:42:46 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:58.398 01:42:46 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:58.398 01:42:46 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:58.398 01:42:46 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:58.398 01:42:46 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:58.398 01:42:46 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:58.398 01:42:46 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:58.398 01:42:46 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:58.398 01:42:46 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:58.398 01:42:46 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:58.398 01:42:46 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:58.398 01:42:46 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:58.398 01:42:46 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:58.398 01:42:46 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:58.398 01:42:46 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:58.398 01:42:46 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:58.398 01:42:46 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:58.398 01:42:46 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:58.398 01:42:46 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:58.398 01:42:46 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:58.398 01:42:46 -- common/autotest_common.sh@259 -- # valgrind= 00:06:58.398 01:42:46 -- common/autotest_common.sh@265 -- # uname -s 00:06:58.398 01:42:46 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:58.398 01:42:46 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:58.398 01:42:46 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:58.398 01:42:46 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:58.398 01:42:46 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:58.398 01:42:46 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:58.398 01:42:46 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:58.398 01:42:46 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:58.398 01:42:46 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:58.398 01:42:46 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:58.398 01:42:46 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:58.398 01:42:46 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:58.398 01:42:46 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:58.398 01:42:46 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:58.398 01:42:46 -- common/autotest_common.sh@319 -- # [[ -z 3342391 ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@319 -- # kill -0 3342391 00:06:58.398 01:42:46 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:58.398 01:42:46 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:58.398 01:42:46 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:58.398 01:42:46 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:58.398 01:42:46 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:58.398 01:42:46 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:58.398 01:42:46 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:58.398 01:42:46 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.0CiA19 00:06:58.398 01:42:46 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:58.398 01:42:46 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.0CiA19/tests/target /tmp/spdk.0CiA19 00:06:58.398 01:42:46 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@328 -- # df -T 00:06:58.398 01:42:46 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:58.398 01:42:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:58.398 01:42:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=55353167872 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988511744 00:06:58.398 01:42:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=6635343872 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991663104 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:06:58.398 01:42:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:58.398 01:42:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993711104 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:06:58.398 01:42:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=544768 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:58.398 01:42:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:58.398 01:42:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:58.398 01:42:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:58.398 01:42:46 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:58.398 * Looking for test storage... 00:06:58.398 01:42:46 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:58.398 01:42:46 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:58.398 01:42:46 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.398 01:42:46 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:58.398 01:42:46 -- common/autotest_common.sh@373 -- # mount=/ 00:06:58.398 01:42:46 -- common/autotest_common.sh@375 -- # target_space=55353167872 00:06:58.398 01:42:46 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:58.398 01:42:46 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:58.398 01:42:46 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:58.398 01:42:46 -- common/autotest_common.sh@382 -- # new_size=8849936384 00:06:58.398 01:42:46 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:58.398 01:42:46 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.399 01:42:46 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.399 01:42:46 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.399 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.399 01:42:46 -- common/autotest_common.sh@390 -- # return 0 00:06:58.399 01:42:46 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:58.399 01:42:46 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:58.399 01:42:46 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:58.399 01:42:46 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:58.399 01:42:46 -- common/autotest_common.sh@1682 -- # true 00:06:58.399 01:42:46 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:58.399 01:42:46 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:58.399 01:42:46 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:58.399 01:42:46 -- common/autotest_common.sh@27 -- # exec 00:06:58.399 01:42:46 -- common/autotest_common.sh@29 -- # exec 00:06:58.399 01:42:46 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:58.399 01:42:46 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:58.399 01:42:46 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:58.399 01:42:46 -- common/autotest_common.sh@18 -- # set -x 00:06:58.399 01:42:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:58.399 01:42:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:58.399 01:42:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:58.399 01:42:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:58.399 01:42:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:58.399 01:42:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:58.399 01:42:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:58.399 01:42:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:58.399 01:42:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:58.399 01:42:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:58.399 01:42:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:58.399 01:42:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:58.399 01:42:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:58.399 01:42:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:58.399 01:42:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:58.399 01:42:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:58.399 01:42:46 -- scripts/common.sh@344 -- # : 1 00:06:58.399 01:42:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:58.399 01:42:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:58.399 01:42:46 -- scripts/common.sh@364 -- # decimal 1 00:06:58.399 01:42:46 -- scripts/common.sh@352 -- # local d=1 00:06:58.399 01:42:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:58.399 01:42:46 -- scripts/common.sh@354 -- # echo 1 00:06:58.399 01:42:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:58.399 01:42:46 -- scripts/common.sh@365 -- # decimal 2 00:06:58.399 01:42:46 -- scripts/common.sh@352 -- # local d=2 00:06:58.399 01:42:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:58.399 01:42:46 -- scripts/common.sh@354 -- # echo 2 00:06:58.399 01:42:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:58.399 01:42:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:58.399 01:42:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:58.399 01:42:46 -- scripts/common.sh@367 -- # return 0 00:06:58.399 01:42:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:58.399 01:42:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:58.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.399 --rc genhtml_branch_coverage=1 00:06:58.399 --rc genhtml_function_coverage=1 00:06:58.399 --rc genhtml_legend=1 00:06:58.399 --rc geninfo_all_blocks=1 00:06:58.399 --rc geninfo_unexecuted_blocks=1 00:06:58.399 00:06:58.399 ' 00:06:58.399 01:42:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:58.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.399 --rc genhtml_branch_coverage=1 00:06:58.399 --rc genhtml_function_coverage=1 00:06:58.399 --rc genhtml_legend=1 00:06:58.399 --rc geninfo_all_blocks=1 00:06:58.399 --rc geninfo_unexecuted_blocks=1 00:06:58.399 00:06:58.399 ' 00:06:58.399 01:42:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:58.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.399 --rc genhtml_branch_coverage=1 00:06:58.399 --rc genhtml_function_coverage=1 00:06:58.399 --rc genhtml_legend=1 00:06:58.399 --rc geninfo_all_blocks=1 00:06:58.399 --rc geninfo_unexecuted_blocks=1 00:06:58.399 00:06:58.399 ' 00:06:58.399 01:42:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:58.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:58.399 --rc genhtml_branch_coverage=1 00:06:58.399 --rc genhtml_function_coverage=1 00:06:58.399 --rc genhtml_legend=1 00:06:58.399 --rc geninfo_all_blocks=1 00:06:58.399 --rc geninfo_unexecuted_blocks=1 00:06:58.399 00:06:58.399 ' 00:06:58.399 01:42:46 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:58.399 01:42:46 -- nvmf/common.sh@7 -- # uname -s 00:06:58.399 01:42:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:58.399 01:42:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:58.399 01:42:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:58.399 01:42:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:58.399 01:42:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:58.399 01:42:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:58.399 01:42:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:58.399 01:42:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:58.399 01:42:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:58.399 01:42:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:58.399 01:42:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:58.399 01:42:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:58.399 01:42:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:58.399 01:42:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:58.399 01:42:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:58.399 01:42:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:58.399 01:42:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:58.399 01:42:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:58.399 01:42:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:58.399 01:42:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.399 01:42:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.399 01:42:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.399 01:42:46 -- paths/export.sh@5 -- # export PATH 00:06:58.399 01:42:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.399 01:42:46 -- nvmf/common.sh@46 -- # : 0 00:06:58.399 01:42:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:58.399 01:42:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:58.399 01:42:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:58.399 01:42:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:58.399 01:42:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:58.399 01:42:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:58.399 01:42:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:58.399 01:42:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:58.399 01:42:46 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:58.399 01:42:46 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:58.399 01:42:46 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:58.399 01:42:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:58.399 01:42:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:58.399 01:42:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:58.399 01:42:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:58.399 01:42:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:58.399 01:42:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:58.399 01:42:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:58.399 01:42:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:58.399 01:42:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:58.399 01:42:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:58.399 01:42:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:58.399 01:42:46 -- common/autotest_common.sh@10 -- # set +x 00:07:00.930 01:42:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:00.930 01:42:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:00.930 01:42:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:00.930 01:42:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:00.930 01:42:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:00.930 01:42:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:00.930 01:42:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:00.930 01:42:48 -- nvmf/common.sh@294 -- # net_devs=() 00:07:00.930 01:42:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:00.930 01:42:48 -- nvmf/common.sh@295 -- # e810=() 00:07:00.930 01:42:48 -- nvmf/common.sh@295 -- # local -ga e810 00:07:00.930 01:42:48 -- nvmf/common.sh@296 -- # x722=() 00:07:00.930 01:42:48 -- nvmf/common.sh@296 -- # local -ga x722 00:07:00.930 01:42:48 -- nvmf/common.sh@297 -- # mlx=() 00:07:00.930 01:42:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:00.930 01:42:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:00.930 01:42:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:00.930 01:42:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:00.930 01:42:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:00.930 01:42:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:00.930 01:42:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:00.930 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:00.930 01:42:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:00.930 01:42:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:00.930 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:00.930 01:42:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:00.930 01:42:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:00.930 01:42:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:00.930 01:42:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:00.930 01:42:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:00.930 01:42:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:00.930 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:00.930 01:42:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:00.930 01:42:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:00.930 01:42:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:00.930 01:42:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:00.930 01:42:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:00.930 01:42:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:00.930 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:00.930 01:42:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:00.930 01:42:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:00.930 01:42:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:00.930 01:42:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:00.930 01:42:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:00.930 01:42:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:00.930 01:42:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:00.930 01:42:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:00.930 01:42:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:00.930 01:42:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:00.930 01:42:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:00.930 01:42:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:00.930 01:42:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:00.930 01:42:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:00.930 01:42:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:00.930 01:42:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:00.930 01:42:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:00.930 01:42:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:00.930 01:42:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:00.930 01:42:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:00.930 01:42:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:00.930 01:42:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:00.930 01:42:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:00.930 01:42:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:00.930 01:42:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:00.930 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:00.930 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:07:00.930 00:07:00.930 --- 10.0.0.2 ping statistics --- 00:07:00.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:00.930 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:07:00.930 01:42:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:00.930 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:00.930 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:07:00.930 00:07:00.930 --- 10.0.0.1 ping statistics --- 00:07:00.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:00.930 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:07:00.930 01:42:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:00.930 01:42:49 -- nvmf/common.sh@410 -- # return 0 00:07:00.930 01:42:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:00.930 01:42:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:00.930 01:42:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:00.930 01:42:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:00.930 01:42:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:00.930 01:42:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:00.930 01:42:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:00.930 01:42:49 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:00.930 01:42:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:00.930 01:42:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.930 01:42:49 -- common/autotest_common.sh@10 -- # set +x 00:07:00.930 ************************************ 00:07:00.930 START TEST nvmf_filesystem_no_in_capsule 00:07:00.930 ************************************ 00:07:00.930 01:42:49 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:00.930 01:42:49 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:00.930 01:42:49 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:00.930 01:42:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:00.930 01:42:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:00.930 01:42:49 -- common/autotest_common.sh@10 -- # set +x 00:07:00.930 01:42:49 -- nvmf/common.sh@469 -- # nvmfpid=3344043 00:07:00.930 01:42:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:00.930 01:42:49 -- nvmf/common.sh@470 -- # waitforlisten 3344043 00:07:00.930 01:42:49 -- common/autotest_common.sh@829 -- # '[' -z 3344043 ']' 00:07:00.930 01:42:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.930 01:42:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:00.930 01:42:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.930 01:42:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:00.930 01:42:49 -- common/autotest_common.sh@10 -- # set +x 00:07:00.930 [2024-11-19 01:42:49.158453] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.930 [2024-11-19 01:42:49.158528] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:00.930 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.930 [2024-11-19 01:42:49.223379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:00.930 [2024-11-19 01:42:49.334516] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:00.930 [2024-11-19 01:42:49.334690] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:00.930 [2024-11-19 01:42:49.334723] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:00.930 [2024-11-19 01:42:49.334736] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:00.930 [2024-11-19 01:42:49.334792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:00.930 [2024-11-19 01:42:49.335008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:00.930 [2024-11-19 01:42:49.335029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:00.930 [2024-11-19 01:42:49.335032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.864 01:42:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:01.864 01:42:50 -- common/autotest_common.sh@862 -- # return 0 00:07:01.864 01:42:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:01.864 01:42:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:01.864 01:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:01.864 01:42:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:01.864 01:42:50 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:01.864 01:42:50 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:01.864 01:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.864 01:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:01.864 [2024-11-19 01:42:50.173288] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:01.864 01:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.864 01:42:50 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:01.864 01:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.864 01:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:01.864 Malloc1 00:07:01.864 01:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.864 01:42:50 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:01.864 01:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.864 01:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:01.864 01:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.864 01:42:50 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:01.864 01:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.864 01:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:01.864 01:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.864 01:42:50 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:01.864 01:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.864 01:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:01.864 [2024-11-19 01:42:50.353256] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:01.864 01:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.864 01:42:50 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:01.864 01:42:50 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:01.864 01:42:50 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:01.864 01:42:50 -- common/autotest_common.sh@1369 -- # local bs 00:07:01.864 01:42:50 -- common/autotest_common.sh@1370 -- # local nb 00:07:01.864 01:42:50 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:01.864 01:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:01.864 01:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:01.864 01:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:01.864 01:42:50 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:01.864 { 00:07:01.864 "name": "Malloc1", 00:07:01.864 "aliases": [ 00:07:01.864 "00e71fe3-2e28-4407-89e8-acf9ba724f69" 00:07:01.864 ], 00:07:01.864 "product_name": "Malloc disk", 00:07:01.864 "block_size": 512, 00:07:01.864 "num_blocks": 1048576, 00:07:01.864 "uuid": "00e71fe3-2e28-4407-89e8-acf9ba724f69", 00:07:01.864 "assigned_rate_limits": { 00:07:01.864 "rw_ios_per_sec": 0, 00:07:01.864 "rw_mbytes_per_sec": 0, 00:07:01.864 "r_mbytes_per_sec": 0, 00:07:01.864 "w_mbytes_per_sec": 0 00:07:01.864 }, 00:07:01.864 "claimed": true, 00:07:01.864 "claim_type": "exclusive_write", 00:07:01.864 "zoned": false, 00:07:01.864 "supported_io_types": { 00:07:01.864 "read": true, 00:07:01.864 "write": true, 00:07:01.864 "unmap": true, 00:07:01.864 "write_zeroes": true, 00:07:01.864 "flush": true, 00:07:01.864 "reset": true, 00:07:01.864 "compare": false, 00:07:01.864 "compare_and_write": false, 00:07:01.864 "abort": true, 00:07:01.864 "nvme_admin": false, 00:07:01.864 "nvme_io": false 00:07:01.864 }, 00:07:01.864 "memory_domains": [ 00:07:01.864 { 00:07:01.864 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:01.864 "dma_device_type": 2 00:07:01.864 } 00:07:01.864 ], 00:07:01.864 "driver_specific": {} 00:07:01.864 } 00:07:01.864 ]' 00:07:01.864 01:42:50 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:02.122 01:42:50 -- common/autotest_common.sh@1372 -- # bs=512 00:07:02.122 01:42:50 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:02.122 01:42:50 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:02.122 01:42:50 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:02.122 01:42:50 -- common/autotest_common.sh@1377 -- # echo 512 00:07:02.122 01:42:50 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:02.122 01:42:50 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:02.688 01:42:51 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:02.688 01:42:51 -- common/autotest_common.sh@1187 -- # local i=0 00:07:02.688 01:42:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:02.688 01:42:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:02.688 01:42:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:05.215 01:42:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:05.215 01:42:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:05.215 01:42:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:05.215 01:42:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:05.215 01:42:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:05.215 01:42:53 -- common/autotest_common.sh@1197 -- # return 0 00:07:05.215 01:42:53 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:05.215 01:42:53 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:05.215 01:42:53 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:05.215 01:42:53 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:05.215 01:42:53 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:05.215 01:42:53 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:05.215 01:42:53 -- setup/common.sh@80 -- # echo 536870912 00:07:05.215 01:42:53 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:05.215 01:42:53 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:05.215 01:42:53 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:05.215 01:42:53 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:05.215 01:42:53 -- target/filesystem.sh@69 -- # partprobe 00:07:06.152 01:42:54 -- target/filesystem.sh@70 -- # sleep 1 00:07:07.157 01:42:55 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:07.157 01:42:55 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:07.157 01:42:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:07.157 01:42:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.157 01:42:55 -- common/autotest_common.sh@10 -- # set +x 00:07:07.157 ************************************ 00:07:07.157 START TEST filesystem_ext4 00:07:07.157 ************************************ 00:07:07.157 01:42:55 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:07.157 01:42:55 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:07.157 01:42:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:07.157 01:42:55 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:07.157 01:42:55 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:07.157 01:42:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:07.157 01:42:55 -- common/autotest_common.sh@914 -- # local i=0 00:07:07.157 01:42:55 -- common/autotest_common.sh@915 -- # local force 00:07:07.157 01:42:55 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:07.157 01:42:55 -- common/autotest_common.sh@918 -- # force=-F 00:07:07.157 01:42:55 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:07.157 mke2fs 1.47.0 (5-Feb-2023) 00:07:07.157 Discarding device blocks: 0/522240 done 00:07:07.157 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:07.157 Filesystem UUID: 616d91f6-002f-4b8f-9c6d-50e1cce4f472 00:07:07.157 Superblock backups stored on blocks: 00:07:07.157 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:07.157 00:07:07.157 Allocating group tables: 0/64 done 00:07:07.157 Writing inode tables: 0/64 done 00:07:07.415 Creating journal (8192 blocks): done 00:07:09.718 Writing superblocks and filesystem accounting information: 0/64 done 00:07:09.718 00:07:09.718 01:42:58 -- common/autotest_common.sh@931 -- # return 0 00:07:09.718 01:42:58 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:16.268 01:43:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:16.268 01:43:04 -- target/filesystem.sh@25 -- # sync 00:07:16.268 01:43:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:16.268 01:43:04 -- target/filesystem.sh@27 -- # sync 00:07:16.268 01:43:04 -- target/filesystem.sh@29 -- # i=0 00:07:16.268 01:43:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:16.268 01:43:04 -- target/filesystem.sh@37 -- # kill -0 3344043 00:07:16.268 01:43:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:16.268 01:43:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:16.268 01:43:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:16.268 01:43:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:16.268 00:07:16.268 real 0m8.690s 00:07:16.268 user 0m0.016s 00:07:16.268 sys 0m0.075s 00:07:16.268 01:43:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.268 01:43:04 -- common/autotest_common.sh@10 -- # set +x 00:07:16.268 ************************************ 00:07:16.268 END TEST filesystem_ext4 00:07:16.268 ************************************ 00:07:16.268 01:43:04 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:16.268 01:43:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:16.268 01:43:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.268 01:43:04 -- common/autotest_common.sh@10 -- # set +x 00:07:16.268 ************************************ 00:07:16.268 START TEST filesystem_btrfs 00:07:16.268 ************************************ 00:07:16.268 01:43:04 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:16.268 01:43:04 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:16.268 01:43:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:16.268 01:43:04 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:16.268 01:43:04 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:16.268 01:43:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:16.268 01:43:04 -- common/autotest_common.sh@914 -- # local i=0 00:07:16.268 01:43:04 -- common/autotest_common.sh@915 -- # local force 00:07:16.268 01:43:04 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:16.268 01:43:04 -- common/autotest_common.sh@920 -- # force=-f 00:07:16.268 01:43:04 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:16.268 btrfs-progs v6.8.1 00:07:16.268 See https://btrfs.readthedocs.io for more information. 00:07:16.268 00:07:16.268 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:16.269 NOTE: several default settings have changed in version 5.15, please make sure 00:07:16.269 this does not affect your deployments: 00:07:16.269 - DUP for metadata (-m dup) 00:07:16.269 - enabled no-holes (-O no-holes) 00:07:16.269 - enabled free-space-tree (-R free-space-tree) 00:07:16.269 00:07:16.269 Label: (null) 00:07:16.269 UUID: f205b323-ce70-4c08-9188-224bd55ee247 00:07:16.269 Node size: 16384 00:07:16.269 Sector size: 4096 (CPU page size: 4096) 00:07:16.269 Filesystem size: 510.00MiB 00:07:16.269 Block group profiles: 00:07:16.269 Data: single 8.00MiB 00:07:16.269 Metadata: DUP 32.00MiB 00:07:16.269 System: DUP 8.00MiB 00:07:16.269 SSD detected: yes 00:07:16.269 Zoned device: no 00:07:16.269 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:16.269 Checksum: crc32c 00:07:16.269 Number of devices: 1 00:07:16.269 Devices: 00:07:16.269 ID SIZE PATH 00:07:16.269 1 510.00MiB /dev/nvme0n1p1 00:07:16.269 00:07:16.269 01:43:04 -- common/autotest_common.sh@931 -- # return 0 00:07:16.269 01:43:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:16.834 01:43:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:16.834 01:43:05 -- target/filesystem.sh@25 -- # sync 00:07:16.834 01:43:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:16.834 01:43:05 -- target/filesystem.sh@27 -- # sync 00:07:16.834 01:43:05 -- target/filesystem.sh@29 -- # i=0 00:07:16.834 01:43:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:16.834 01:43:05 -- target/filesystem.sh@37 -- # kill -0 3344043 00:07:16.834 01:43:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:16.834 01:43:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:16.834 01:43:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:16.834 01:43:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:16.834 00:07:16.834 real 0m0.899s 00:07:16.834 user 0m0.018s 00:07:16.834 sys 0m0.109s 00:07:16.834 01:43:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.834 01:43:05 -- common/autotest_common.sh@10 -- # set +x 00:07:16.834 ************************************ 00:07:16.834 END TEST filesystem_btrfs 00:07:16.834 ************************************ 00:07:16.834 01:43:05 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:16.834 01:43:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:16.834 01:43:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.834 01:43:05 -- common/autotest_common.sh@10 -- # set +x 00:07:16.834 ************************************ 00:07:16.834 START TEST filesystem_xfs 00:07:16.834 ************************************ 00:07:16.834 01:43:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:16.834 01:43:05 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:16.834 01:43:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:16.834 01:43:05 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:16.834 01:43:05 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:16.834 01:43:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:16.834 01:43:05 -- common/autotest_common.sh@914 -- # local i=0 00:07:16.834 01:43:05 -- common/autotest_common.sh@915 -- # local force 00:07:16.834 01:43:05 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:16.834 01:43:05 -- common/autotest_common.sh@920 -- # force=-f 00:07:16.834 01:43:05 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:16.834 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:16.834 = sectsz=512 attr=2, projid32bit=1 00:07:16.834 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:16.834 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:16.834 data = bsize=4096 blocks=130560, imaxpct=25 00:07:16.834 = sunit=0 swidth=0 blks 00:07:16.834 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:16.834 log =internal log bsize=4096 blocks=16384, version=2 00:07:16.834 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:16.834 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:17.767 Discarding blocks...Done. 00:07:17.767 01:43:06 -- common/autotest_common.sh@931 -- # return 0 00:07:17.767 01:43:06 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:20.291 01:43:08 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:20.291 01:43:08 -- target/filesystem.sh@25 -- # sync 00:07:20.291 01:43:08 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:20.291 01:43:08 -- target/filesystem.sh@27 -- # sync 00:07:20.291 01:43:08 -- target/filesystem.sh@29 -- # i=0 00:07:20.291 01:43:08 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:20.291 01:43:08 -- target/filesystem.sh@37 -- # kill -0 3344043 00:07:20.291 01:43:08 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:20.291 01:43:08 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:20.291 01:43:08 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:20.291 01:43:08 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:20.291 00:07:20.291 real 0m3.222s 00:07:20.291 user 0m0.012s 00:07:20.291 sys 0m0.062s 00:07:20.291 01:43:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.291 01:43:08 -- common/autotest_common.sh@10 -- # set +x 00:07:20.291 ************************************ 00:07:20.291 END TEST filesystem_xfs 00:07:20.291 ************************************ 00:07:20.291 01:43:08 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:20.291 01:43:08 -- target/filesystem.sh@93 -- # sync 00:07:20.291 01:43:08 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:20.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:20.291 01:43:08 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:20.291 01:43:08 -- common/autotest_common.sh@1208 -- # local i=0 00:07:20.291 01:43:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:20.291 01:43:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:20.291 01:43:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:20.291 01:43:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:20.291 01:43:08 -- common/autotest_common.sh@1220 -- # return 0 00:07:20.291 01:43:08 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:20.291 01:43:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.291 01:43:08 -- common/autotest_common.sh@10 -- # set +x 00:07:20.291 01:43:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.291 01:43:08 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:20.291 01:43:08 -- target/filesystem.sh@101 -- # killprocess 3344043 00:07:20.291 01:43:08 -- common/autotest_common.sh@936 -- # '[' -z 3344043 ']' 00:07:20.291 01:43:08 -- common/autotest_common.sh@940 -- # kill -0 3344043 00:07:20.291 01:43:08 -- common/autotest_common.sh@941 -- # uname 00:07:20.291 01:43:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:20.291 01:43:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3344043 00:07:20.291 01:43:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:20.291 01:43:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:20.291 01:43:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3344043' 00:07:20.291 killing process with pid 3344043 00:07:20.291 01:43:08 -- common/autotest_common.sh@955 -- # kill 3344043 00:07:20.291 01:43:08 -- common/autotest_common.sh@960 -- # wait 3344043 00:07:20.856 01:43:09 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:20.856 00:07:20.856 real 0m19.994s 00:07:20.856 user 1m17.473s 00:07:20.856 sys 0m2.331s 00:07:20.856 01:43:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.856 01:43:09 -- common/autotest_common.sh@10 -- # set +x 00:07:20.856 ************************************ 00:07:20.856 END TEST nvmf_filesystem_no_in_capsule 00:07:20.856 ************************************ 00:07:20.856 01:43:09 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:20.856 01:43:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:20.856 01:43:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.856 01:43:09 -- common/autotest_common.sh@10 -- # set +x 00:07:20.856 ************************************ 00:07:20.856 START TEST nvmf_filesystem_in_capsule 00:07:20.856 ************************************ 00:07:20.856 01:43:09 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:20.856 01:43:09 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:20.856 01:43:09 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:20.856 01:43:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:20.856 01:43:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:20.856 01:43:09 -- common/autotest_common.sh@10 -- # set +x 00:07:20.856 01:43:09 -- nvmf/common.sh@469 -- # nvmfpid=3346728 00:07:20.856 01:43:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:20.856 01:43:09 -- nvmf/common.sh@470 -- # waitforlisten 3346728 00:07:20.856 01:43:09 -- common/autotest_common.sh@829 -- # '[' -z 3346728 ']' 00:07:20.856 01:43:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:20.856 01:43:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:20.856 01:43:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:20.856 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:20.856 01:43:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:20.856 01:43:09 -- common/autotest_common.sh@10 -- # set +x 00:07:20.856 [2024-11-19 01:43:09.185183] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.856 [2024-11-19 01:43:09.185276] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:20.856 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.856 [2024-11-19 01:43:09.252803] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:20.856 [2024-11-19 01:43:09.362278] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:20.856 [2024-11-19 01:43:09.362416] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:20.856 [2024-11-19 01:43:09.362434] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:20.856 [2024-11-19 01:43:09.362448] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:20.856 [2024-11-19 01:43:09.362518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:20.856 [2024-11-19 01:43:09.362577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:20.856 [2024-11-19 01:43:09.362579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.856 [2024-11-19 01:43:09.362545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:21.788 01:43:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:21.788 01:43:10 -- common/autotest_common.sh@862 -- # return 0 00:07:21.788 01:43:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:21.788 01:43:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:21.788 01:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:21.788 01:43:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:21.788 01:43:10 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:21.788 01:43:10 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:21.788 01:43:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.789 01:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:21.789 [2024-11-19 01:43:10.220366] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:21.789 01:43:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.789 01:43:10 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:21.789 01:43:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.789 01:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:22.048 Malloc1 00:07:22.048 01:43:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:22.048 01:43:10 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:22.048 01:43:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:22.048 01:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:22.048 01:43:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:22.048 01:43:10 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:22.048 01:43:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:22.048 01:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:22.048 01:43:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:22.048 01:43:10 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:22.048 01:43:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:22.048 01:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:22.048 [2024-11-19 01:43:10.412507] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:22.048 01:43:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:22.048 01:43:10 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:22.048 01:43:10 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:22.048 01:43:10 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:22.049 01:43:10 -- common/autotest_common.sh@1369 -- # local bs 00:07:22.049 01:43:10 -- common/autotest_common.sh@1370 -- # local nb 00:07:22.049 01:43:10 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:22.049 01:43:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:22.049 01:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:22.049 01:43:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:22.049 01:43:10 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:22.049 { 00:07:22.049 "name": "Malloc1", 00:07:22.049 "aliases": [ 00:07:22.049 "916a2343-9e1d-44f7-b8b4-930c5c0c0645" 00:07:22.049 ], 00:07:22.049 "product_name": "Malloc disk", 00:07:22.049 "block_size": 512, 00:07:22.049 "num_blocks": 1048576, 00:07:22.049 "uuid": "916a2343-9e1d-44f7-b8b4-930c5c0c0645", 00:07:22.049 "assigned_rate_limits": { 00:07:22.049 "rw_ios_per_sec": 0, 00:07:22.049 "rw_mbytes_per_sec": 0, 00:07:22.049 "r_mbytes_per_sec": 0, 00:07:22.049 "w_mbytes_per_sec": 0 00:07:22.049 }, 00:07:22.049 "claimed": true, 00:07:22.049 "claim_type": "exclusive_write", 00:07:22.049 "zoned": false, 00:07:22.049 "supported_io_types": { 00:07:22.049 "read": true, 00:07:22.049 "write": true, 00:07:22.049 "unmap": true, 00:07:22.049 "write_zeroes": true, 00:07:22.049 "flush": true, 00:07:22.049 "reset": true, 00:07:22.049 "compare": false, 00:07:22.049 "compare_and_write": false, 00:07:22.049 "abort": true, 00:07:22.049 "nvme_admin": false, 00:07:22.049 "nvme_io": false 00:07:22.049 }, 00:07:22.049 "memory_domains": [ 00:07:22.049 { 00:07:22.049 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:22.049 "dma_device_type": 2 00:07:22.049 } 00:07:22.049 ], 00:07:22.049 "driver_specific": {} 00:07:22.049 } 00:07:22.049 ]' 00:07:22.049 01:43:10 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:22.049 01:43:10 -- common/autotest_common.sh@1372 -- # bs=512 00:07:22.049 01:43:10 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:22.049 01:43:10 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:22.049 01:43:10 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:22.049 01:43:10 -- common/autotest_common.sh@1377 -- # echo 512 00:07:22.049 01:43:10 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:22.049 01:43:10 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:22.614 01:43:11 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:22.614 01:43:11 -- common/autotest_common.sh@1187 -- # local i=0 00:07:22.614 01:43:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:22.614 01:43:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:22.614 01:43:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:25.140 01:43:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:25.140 01:43:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:25.140 01:43:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:25.140 01:43:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:25.140 01:43:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:25.140 01:43:13 -- common/autotest_common.sh@1197 -- # return 0 00:07:25.140 01:43:13 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:25.140 01:43:13 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:25.140 01:43:13 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:25.140 01:43:13 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:25.140 01:43:13 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:25.140 01:43:13 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:25.140 01:43:13 -- setup/common.sh@80 -- # echo 536870912 00:07:25.140 01:43:13 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:25.140 01:43:13 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:25.140 01:43:13 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:25.140 01:43:13 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:25.140 01:43:13 -- target/filesystem.sh@69 -- # partprobe 00:07:25.140 01:43:13 -- target/filesystem.sh@70 -- # sleep 1 00:07:26.513 01:43:14 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:26.513 01:43:14 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:26.513 01:43:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:26.513 01:43:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.513 01:43:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.513 ************************************ 00:07:26.513 START TEST filesystem_in_capsule_ext4 00:07:26.513 ************************************ 00:07:26.513 01:43:14 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:26.513 01:43:14 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:26.513 01:43:14 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:26.513 01:43:14 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:26.513 01:43:14 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:26.513 01:43:14 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:26.513 01:43:14 -- common/autotest_common.sh@914 -- # local i=0 00:07:26.513 01:43:14 -- common/autotest_common.sh@915 -- # local force 00:07:26.513 01:43:14 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:26.513 01:43:14 -- common/autotest_common.sh@918 -- # force=-F 00:07:26.513 01:43:14 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:26.513 mke2fs 1.47.0 (5-Feb-2023) 00:07:26.513 Discarding device blocks: 0/522240 done 00:07:26.513 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:26.513 Filesystem UUID: ba652a52-14a2-4ebf-bd98-046f011bb3c3 00:07:26.513 Superblock backups stored on blocks: 00:07:26.513 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:26.513 00:07:26.513 Allocating group tables: 0/64 done 00:07:26.513 Writing inode tables: 0/64 done 00:07:26.513 Creating journal (8192 blocks): done 00:07:27.960 Writing superblocks and filesystem accounting information: 0/64 done 00:07:27.960 00:07:27.960 01:43:16 -- common/autotest_common.sh@931 -- # return 0 00:07:27.960 01:43:16 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:34.513 01:43:21 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:34.513 01:43:21 -- target/filesystem.sh@25 -- # sync 00:07:34.513 01:43:21 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:34.513 01:43:21 -- target/filesystem.sh@27 -- # sync 00:07:34.513 01:43:21 -- target/filesystem.sh@29 -- # i=0 00:07:34.513 01:43:21 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:34.513 01:43:21 -- target/filesystem.sh@37 -- # kill -0 3346728 00:07:34.513 01:43:21 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:34.513 01:43:21 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:34.513 01:43:21 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:34.513 01:43:21 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:34.513 00:07:34.513 real 0m7.253s 00:07:34.513 user 0m0.022s 00:07:34.513 sys 0m0.064s 00:07:34.513 01:43:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.513 01:43:21 -- common/autotest_common.sh@10 -- # set +x 00:07:34.513 ************************************ 00:07:34.513 END TEST filesystem_in_capsule_ext4 00:07:34.513 ************************************ 00:07:34.513 01:43:21 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:34.513 01:43:21 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:34.513 01:43:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.513 01:43:21 -- common/autotest_common.sh@10 -- # set +x 00:07:34.513 ************************************ 00:07:34.513 START TEST filesystem_in_capsule_btrfs 00:07:34.513 ************************************ 00:07:34.513 01:43:21 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:34.513 01:43:21 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:34.513 01:43:21 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:34.513 01:43:21 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:34.513 01:43:21 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:34.513 01:43:21 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:34.513 01:43:21 -- common/autotest_common.sh@914 -- # local i=0 00:07:34.513 01:43:21 -- common/autotest_common.sh@915 -- # local force 00:07:34.513 01:43:21 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:34.513 01:43:21 -- common/autotest_common.sh@920 -- # force=-f 00:07:34.513 01:43:21 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:34.513 btrfs-progs v6.8.1 00:07:34.513 See https://btrfs.readthedocs.io for more information. 00:07:34.513 00:07:34.513 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:34.513 NOTE: several default settings have changed in version 5.15, please make sure 00:07:34.513 this does not affect your deployments: 00:07:34.513 - DUP for metadata (-m dup) 00:07:34.513 - enabled no-holes (-O no-holes) 00:07:34.513 - enabled free-space-tree (-R free-space-tree) 00:07:34.513 00:07:34.513 Label: (null) 00:07:34.513 UUID: dbe2731e-56cd-4484-87b6-82a3bc3638c2 00:07:34.513 Node size: 16384 00:07:34.513 Sector size: 4096 (CPU page size: 4096) 00:07:34.513 Filesystem size: 510.00MiB 00:07:34.513 Block group profiles: 00:07:34.513 Data: single 8.00MiB 00:07:34.514 Metadata: DUP 32.00MiB 00:07:34.514 System: DUP 8.00MiB 00:07:34.514 SSD detected: yes 00:07:34.514 Zoned device: no 00:07:34.514 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:34.514 Checksum: crc32c 00:07:34.514 Number of devices: 1 00:07:34.514 Devices: 00:07:34.514 ID SIZE PATH 00:07:34.514 1 510.00MiB /dev/nvme0n1p1 00:07:34.514 00:07:34.514 01:43:22 -- common/autotest_common.sh@931 -- # return 0 00:07:34.514 01:43:22 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:34.514 01:43:22 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:34.514 01:43:22 -- target/filesystem.sh@25 -- # sync 00:07:34.514 01:43:22 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:34.514 01:43:22 -- target/filesystem.sh@27 -- # sync 00:07:34.514 01:43:22 -- target/filesystem.sh@29 -- # i=0 00:07:34.514 01:43:22 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:34.514 01:43:22 -- target/filesystem.sh@37 -- # kill -0 3346728 00:07:34.514 01:43:22 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:34.514 01:43:22 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:34.514 01:43:22 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:34.514 01:43:22 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:34.514 00:07:34.514 real 0m1.009s 00:07:34.514 user 0m0.012s 00:07:34.514 sys 0m0.110s 00:07:34.514 01:43:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.514 01:43:22 -- common/autotest_common.sh@10 -- # set +x 00:07:34.514 ************************************ 00:07:34.514 END TEST filesystem_in_capsule_btrfs 00:07:34.514 ************************************ 00:07:34.514 01:43:22 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:34.514 01:43:22 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:34.514 01:43:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.514 01:43:22 -- common/autotest_common.sh@10 -- # set +x 00:07:34.514 ************************************ 00:07:34.514 START TEST filesystem_in_capsule_xfs 00:07:34.514 ************************************ 00:07:34.514 01:43:22 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:34.514 01:43:22 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:34.514 01:43:22 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:34.514 01:43:22 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:34.514 01:43:22 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:34.514 01:43:22 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:34.514 01:43:22 -- common/autotest_common.sh@914 -- # local i=0 00:07:34.514 01:43:22 -- common/autotest_common.sh@915 -- # local force 00:07:34.514 01:43:22 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:34.514 01:43:22 -- common/autotest_common.sh@920 -- # force=-f 00:07:34.514 01:43:22 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:34.772 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:34.772 = sectsz=512 attr=2, projid32bit=1 00:07:34.772 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:34.772 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:34.772 data = bsize=4096 blocks=130560, imaxpct=25 00:07:34.772 = sunit=0 swidth=0 blks 00:07:34.772 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:34.772 log =internal log bsize=4096 blocks=16384, version=2 00:07:34.772 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:34.772 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:35.336 Discarding blocks...Done. 00:07:35.336 01:43:23 -- common/autotest_common.sh@931 -- # return 0 00:07:35.336 01:43:23 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:37.232 01:43:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:37.232 01:43:25 -- target/filesystem.sh@25 -- # sync 00:07:37.232 01:43:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:37.232 01:43:25 -- target/filesystem.sh@27 -- # sync 00:07:37.232 01:43:25 -- target/filesystem.sh@29 -- # i=0 00:07:37.232 01:43:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:37.232 01:43:25 -- target/filesystem.sh@37 -- # kill -0 3346728 00:07:37.232 01:43:25 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:37.232 01:43:25 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:37.232 01:43:25 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:37.232 01:43:25 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:37.232 00:07:37.232 real 0m2.748s 00:07:37.232 user 0m0.022s 00:07:37.232 sys 0m0.053s 00:07:37.232 01:43:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.232 01:43:25 -- common/autotest_common.sh@10 -- # set +x 00:07:37.232 ************************************ 00:07:37.232 END TEST filesystem_in_capsule_xfs 00:07:37.232 ************************************ 00:07:37.232 01:43:25 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:37.232 01:43:25 -- target/filesystem.sh@93 -- # sync 00:07:37.232 01:43:25 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:37.490 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.490 01:43:25 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:37.490 01:43:25 -- common/autotest_common.sh@1208 -- # local i=0 00:07:37.490 01:43:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:37.490 01:43:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:37.490 01:43:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:37.490 01:43:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:37.490 01:43:25 -- common/autotest_common.sh@1220 -- # return 0 00:07:37.490 01:43:25 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:37.490 01:43:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.490 01:43:25 -- common/autotest_common.sh@10 -- # set +x 00:07:37.490 01:43:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.490 01:43:25 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:37.490 01:43:25 -- target/filesystem.sh@101 -- # killprocess 3346728 00:07:37.490 01:43:25 -- common/autotest_common.sh@936 -- # '[' -z 3346728 ']' 00:07:37.490 01:43:25 -- common/autotest_common.sh@940 -- # kill -0 3346728 00:07:37.490 01:43:25 -- common/autotest_common.sh@941 -- # uname 00:07:37.490 01:43:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:37.490 01:43:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3346728 00:07:37.490 01:43:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:37.490 01:43:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:37.490 01:43:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3346728' 00:07:37.490 killing process with pid 3346728 00:07:37.490 01:43:25 -- common/autotest_common.sh@955 -- # kill 3346728 00:07:37.490 01:43:25 -- common/autotest_common.sh@960 -- # wait 3346728 00:07:38.057 01:43:26 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:38.057 00:07:38.057 real 0m17.275s 00:07:38.057 user 1m6.800s 00:07:38.057 sys 0m2.170s 00:07:38.057 01:43:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.057 01:43:26 -- common/autotest_common.sh@10 -- # set +x 00:07:38.057 ************************************ 00:07:38.057 END TEST nvmf_filesystem_in_capsule 00:07:38.057 ************************************ 00:07:38.057 01:43:26 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:38.057 01:43:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:38.057 01:43:26 -- nvmf/common.sh@116 -- # sync 00:07:38.057 01:43:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:38.057 01:43:26 -- nvmf/common.sh@119 -- # set +e 00:07:38.057 01:43:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:38.057 01:43:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:38.057 rmmod nvme_tcp 00:07:38.057 rmmod nvme_fabrics 00:07:38.057 rmmod nvme_keyring 00:07:38.057 01:43:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:38.057 01:43:26 -- nvmf/common.sh@123 -- # set -e 00:07:38.057 01:43:26 -- nvmf/common.sh@124 -- # return 0 00:07:38.057 01:43:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:38.057 01:43:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:38.057 01:43:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:38.057 01:43:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:38.057 01:43:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:38.057 01:43:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:38.057 01:43:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:38.057 01:43:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:38.057 01:43:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:40.594 01:43:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:40.594 00:07:40.594 real 0m42.006s 00:07:40.594 user 2m25.367s 00:07:40.594 sys 0m6.158s 00:07:40.594 01:43:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:40.594 01:43:28 -- common/autotest_common.sh@10 -- # set +x 00:07:40.594 ************************************ 00:07:40.594 END TEST nvmf_filesystem 00:07:40.594 ************************************ 00:07:40.594 01:43:28 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:40.594 01:43:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:40.594 01:43:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:40.594 01:43:28 -- common/autotest_common.sh@10 -- # set +x 00:07:40.594 ************************************ 00:07:40.594 START TEST nvmf_discovery 00:07:40.594 ************************************ 00:07:40.594 01:43:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:40.594 * Looking for test storage... 00:07:40.594 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:40.594 01:43:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:40.594 01:43:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:40.594 01:43:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:40.594 01:43:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:40.594 01:43:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:40.594 01:43:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:40.594 01:43:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:40.594 01:43:28 -- scripts/common.sh@335 -- # IFS=.-: 00:07:40.594 01:43:28 -- scripts/common.sh@335 -- # read -ra ver1 00:07:40.594 01:43:28 -- scripts/common.sh@336 -- # IFS=.-: 00:07:40.594 01:43:28 -- scripts/common.sh@336 -- # read -ra ver2 00:07:40.594 01:43:28 -- scripts/common.sh@337 -- # local 'op=<' 00:07:40.594 01:43:28 -- scripts/common.sh@339 -- # ver1_l=2 00:07:40.594 01:43:28 -- scripts/common.sh@340 -- # ver2_l=1 00:07:40.594 01:43:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:40.594 01:43:28 -- scripts/common.sh@343 -- # case "$op" in 00:07:40.594 01:43:28 -- scripts/common.sh@344 -- # : 1 00:07:40.594 01:43:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:40.594 01:43:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:40.594 01:43:28 -- scripts/common.sh@364 -- # decimal 1 00:07:40.594 01:43:28 -- scripts/common.sh@352 -- # local d=1 00:07:40.594 01:43:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:40.594 01:43:28 -- scripts/common.sh@354 -- # echo 1 00:07:40.594 01:43:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:40.594 01:43:28 -- scripts/common.sh@365 -- # decimal 2 00:07:40.594 01:43:28 -- scripts/common.sh@352 -- # local d=2 00:07:40.594 01:43:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:40.594 01:43:28 -- scripts/common.sh@354 -- # echo 2 00:07:40.594 01:43:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:40.594 01:43:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:40.594 01:43:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:40.594 01:43:28 -- scripts/common.sh@367 -- # return 0 00:07:40.594 01:43:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:40.594 01:43:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:40.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.594 --rc genhtml_branch_coverage=1 00:07:40.594 --rc genhtml_function_coverage=1 00:07:40.594 --rc genhtml_legend=1 00:07:40.594 --rc geninfo_all_blocks=1 00:07:40.594 --rc geninfo_unexecuted_blocks=1 00:07:40.594 00:07:40.594 ' 00:07:40.594 01:43:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:40.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.594 --rc genhtml_branch_coverage=1 00:07:40.594 --rc genhtml_function_coverage=1 00:07:40.594 --rc genhtml_legend=1 00:07:40.594 --rc geninfo_all_blocks=1 00:07:40.594 --rc geninfo_unexecuted_blocks=1 00:07:40.594 00:07:40.594 ' 00:07:40.594 01:43:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:40.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.595 --rc genhtml_branch_coverage=1 00:07:40.595 --rc genhtml_function_coverage=1 00:07:40.595 --rc genhtml_legend=1 00:07:40.595 --rc geninfo_all_blocks=1 00:07:40.595 --rc geninfo_unexecuted_blocks=1 00:07:40.595 00:07:40.595 ' 00:07:40.595 01:43:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:40.595 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.595 --rc genhtml_branch_coverage=1 00:07:40.595 --rc genhtml_function_coverage=1 00:07:40.595 --rc genhtml_legend=1 00:07:40.595 --rc geninfo_all_blocks=1 00:07:40.595 --rc geninfo_unexecuted_blocks=1 00:07:40.595 00:07:40.595 ' 00:07:40.595 01:43:28 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:40.595 01:43:28 -- nvmf/common.sh@7 -- # uname -s 00:07:40.595 01:43:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:40.595 01:43:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:40.595 01:43:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:40.595 01:43:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:40.595 01:43:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:40.595 01:43:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:40.595 01:43:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:40.595 01:43:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:40.595 01:43:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:40.595 01:43:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:40.595 01:43:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:40.595 01:43:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:40.595 01:43:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:40.595 01:43:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:40.595 01:43:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:40.595 01:43:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:40.595 01:43:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:40.595 01:43:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:40.595 01:43:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:40.595 01:43:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.595 01:43:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.595 01:43:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.595 01:43:28 -- paths/export.sh@5 -- # export PATH 00:07:40.595 01:43:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.595 01:43:28 -- nvmf/common.sh@46 -- # : 0 00:07:40.595 01:43:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:40.595 01:43:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:40.595 01:43:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:40.595 01:43:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:40.595 01:43:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:40.595 01:43:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:40.595 01:43:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:40.595 01:43:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:40.595 01:43:28 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:40.595 01:43:28 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:40.595 01:43:28 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:40.595 01:43:28 -- target/discovery.sh@15 -- # hash nvme 00:07:40.595 01:43:28 -- target/discovery.sh@20 -- # nvmftestinit 00:07:40.595 01:43:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:40.595 01:43:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:40.595 01:43:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:40.595 01:43:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:40.595 01:43:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:40.595 01:43:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:40.595 01:43:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:40.595 01:43:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:40.595 01:43:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:40.595 01:43:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:40.595 01:43:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:40.595 01:43:28 -- common/autotest_common.sh@10 -- # set +x 00:07:42.498 01:43:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:42.498 01:43:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:42.498 01:43:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:42.498 01:43:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:42.498 01:43:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:42.498 01:43:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:42.498 01:43:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:42.498 01:43:30 -- nvmf/common.sh@294 -- # net_devs=() 00:07:42.498 01:43:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:42.498 01:43:30 -- nvmf/common.sh@295 -- # e810=() 00:07:42.498 01:43:30 -- nvmf/common.sh@295 -- # local -ga e810 00:07:42.499 01:43:30 -- nvmf/common.sh@296 -- # x722=() 00:07:42.499 01:43:30 -- nvmf/common.sh@296 -- # local -ga x722 00:07:42.499 01:43:30 -- nvmf/common.sh@297 -- # mlx=() 00:07:42.499 01:43:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:42.499 01:43:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:42.499 01:43:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:42.499 01:43:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:42.499 01:43:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:42.499 01:43:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:42.499 01:43:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:42.499 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:42.499 01:43:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:42.499 01:43:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:42.499 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:42.499 01:43:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:42.499 01:43:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:42.499 01:43:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:42.499 01:43:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:42.499 01:43:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:42.499 01:43:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:42.499 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:42.499 01:43:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:42.499 01:43:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:42.499 01:43:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:42.499 01:43:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:42.499 01:43:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:42.499 01:43:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:42.499 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:42.499 01:43:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:42.499 01:43:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:42.499 01:43:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:42.499 01:43:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:42.499 01:43:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:42.499 01:43:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:42.499 01:43:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:42.499 01:43:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:42.499 01:43:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:42.499 01:43:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:42.499 01:43:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:42.499 01:43:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:42.499 01:43:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:42.499 01:43:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:42.499 01:43:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:42.499 01:43:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:42.499 01:43:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:42.499 01:43:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:42.499 01:43:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:42.499 01:43:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:42.499 01:43:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:42.499 01:43:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:42.499 01:43:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:42.499 01:43:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:42.499 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:42.499 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:07:42.499 00:07:42.499 --- 10.0.0.2 ping statistics --- 00:07:42.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.499 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:07:42.499 01:43:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:42.499 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:42.499 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:07:42.499 00:07:42.499 --- 10.0.0.1 ping statistics --- 00:07:42.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.499 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:07:42.499 01:43:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:42.499 01:43:30 -- nvmf/common.sh@410 -- # return 0 00:07:42.499 01:43:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:42.499 01:43:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:42.499 01:43:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:42.499 01:43:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:42.499 01:43:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:42.499 01:43:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:42.499 01:43:30 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:42.499 01:43:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:42.499 01:43:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:42.499 01:43:30 -- common/autotest_common.sh@10 -- # set +x 00:07:42.499 01:43:30 -- nvmf/common.sh@469 -- # nvmfpid=3350964 00:07:42.499 01:43:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:42.499 01:43:30 -- nvmf/common.sh@470 -- # waitforlisten 3350964 00:07:42.499 01:43:30 -- common/autotest_common.sh@829 -- # '[' -z 3350964 ']' 00:07:42.499 01:43:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:42.499 01:43:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:42.499 01:43:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:42.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:42.499 01:43:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:42.499 01:43:30 -- common/autotest_common.sh@10 -- # set +x 00:07:42.499 [2024-11-19 01:43:31.025722] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:42.499 [2024-11-19 01:43:31.025792] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:42.758 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.758 [2024-11-19 01:43:31.097049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:42.758 [2024-11-19 01:43:31.221167] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:42.758 [2024-11-19 01:43:31.221337] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:42.758 [2024-11-19 01:43:31.221356] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:42.758 [2024-11-19 01:43:31.221371] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:42.758 [2024-11-19 01:43:31.223663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:42.758 [2024-11-19 01:43:31.223697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:42.758 [2024-11-19 01:43:31.223751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:42.758 [2024-11-19 01:43:31.223754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.691 01:43:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:43.691 01:43:32 -- common/autotest_common.sh@862 -- # return 0 00:07:43.691 01:43:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:43.691 01:43:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:43.691 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.691 01:43:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:43.691 01:43:32 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:43.691 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.691 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.691 [2024-11-19 01:43:32.121494] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:43.691 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.691 01:43:32 -- target/discovery.sh@26 -- # seq 1 4 00:07:43.691 01:43:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.691 01:43:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:43.691 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.691 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.691 Null1 00:07:43.691 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.691 01:43:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:43.691 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.691 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.691 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.691 01:43:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:43.691 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.691 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.691 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.691 01:43:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:43.691 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.691 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.691 [2024-11-19 01:43:32.161782] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:43.691 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.691 01:43:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.691 01:43:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 Null2 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.692 01:43:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 Null3 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.692 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.692 01:43:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.692 01:43:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:43.692 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.692 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.950 Null4 00:07:43.950 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.950 01:43:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:43.950 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.950 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.951 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.951 01:43:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:43.951 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.951 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.951 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.951 01:43:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:43.951 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.951 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.951 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.951 01:43:32 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:43.951 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.951 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.951 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.951 01:43:32 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:43.951 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.951 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.951 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.951 01:43:32 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:43.951 00:07:43.951 Discovery Log Number of Records 6, Generation counter 6 00:07:43.951 =====Discovery Log Entry 0====== 00:07:43.951 trtype: tcp 00:07:43.951 adrfam: ipv4 00:07:43.951 subtype: current discovery subsystem 00:07:43.951 treq: not required 00:07:43.951 portid: 0 00:07:43.951 trsvcid: 4420 00:07:43.951 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:43.951 traddr: 10.0.0.2 00:07:43.951 eflags: explicit discovery connections, duplicate discovery information 00:07:43.951 sectype: none 00:07:43.951 =====Discovery Log Entry 1====== 00:07:43.951 trtype: tcp 00:07:43.951 adrfam: ipv4 00:07:43.951 subtype: nvme subsystem 00:07:43.951 treq: not required 00:07:43.951 portid: 0 00:07:43.951 trsvcid: 4420 00:07:43.951 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:43.951 traddr: 10.0.0.2 00:07:43.951 eflags: none 00:07:43.951 sectype: none 00:07:43.951 =====Discovery Log Entry 2====== 00:07:43.951 trtype: tcp 00:07:43.951 adrfam: ipv4 00:07:43.951 subtype: nvme subsystem 00:07:43.951 treq: not required 00:07:43.951 portid: 0 00:07:43.951 trsvcid: 4420 00:07:43.951 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:43.951 traddr: 10.0.0.2 00:07:43.951 eflags: none 00:07:43.951 sectype: none 00:07:43.951 =====Discovery Log Entry 3====== 00:07:43.951 trtype: tcp 00:07:43.951 adrfam: ipv4 00:07:43.951 subtype: nvme subsystem 00:07:43.951 treq: not required 00:07:43.951 portid: 0 00:07:43.951 trsvcid: 4420 00:07:43.951 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:43.951 traddr: 10.0.0.2 00:07:43.951 eflags: none 00:07:43.951 sectype: none 00:07:43.951 =====Discovery Log Entry 4====== 00:07:43.951 trtype: tcp 00:07:43.951 adrfam: ipv4 00:07:43.951 subtype: nvme subsystem 00:07:43.951 treq: not required 00:07:43.951 portid: 0 00:07:43.951 trsvcid: 4420 00:07:43.951 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:43.951 traddr: 10.0.0.2 00:07:43.951 eflags: none 00:07:43.951 sectype: none 00:07:43.951 =====Discovery Log Entry 5====== 00:07:43.951 trtype: tcp 00:07:43.951 adrfam: ipv4 00:07:43.951 subtype: discovery subsystem referral 00:07:43.951 treq: not required 00:07:43.951 portid: 0 00:07:43.951 trsvcid: 4430 00:07:43.951 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:43.951 traddr: 10.0.0.2 00:07:43.951 eflags: none 00:07:43.951 sectype: none 00:07:43.951 01:43:32 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:43.951 Perform nvmf subsystem discovery via RPC 00:07:43.951 01:43:32 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:43.951 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.951 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.951 [2024-11-19 01:43:32.454567] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:43.951 [ 00:07:43.951 { 00:07:43.951 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:43.951 "subtype": "Discovery", 00:07:43.951 "listen_addresses": [ 00:07:43.951 { 00:07:43.951 "transport": "TCP", 00:07:43.951 "trtype": "TCP", 00:07:43.951 "adrfam": "IPv4", 00:07:43.951 "traddr": "10.0.0.2", 00:07:43.951 "trsvcid": "4420" 00:07:43.951 } 00:07:43.951 ], 00:07:43.951 "allow_any_host": true, 00:07:43.951 "hosts": [] 00:07:43.951 }, 00:07:43.951 { 00:07:43.951 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:43.951 "subtype": "NVMe", 00:07:43.951 "listen_addresses": [ 00:07:43.951 { 00:07:43.951 "transport": "TCP", 00:07:43.951 "trtype": "TCP", 00:07:43.951 "adrfam": "IPv4", 00:07:43.951 "traddr": "10.0.0.2", 00:07:43.951 "trsvcid": "4420" 00:07:43.951 } 00:07:43.951 ], 00:07:43.951 "allow_any_host": true, 00:07:43.951 "hosts": [], 00:07:43.951 "serial_number": "SPDK00000000000001", 00:07:43.951 "model_number": "SPDK bdev Controller", 00:07:43.951 "max_namespaces": 32, 00:07:43.951 "min_cntlid": 1, 00:07:43.951 "max_cntlid": 65519, 00:07:43.951 "namespaces": [ 00:07:43.951 { 00:07:43.951 "nsid": 1, 00:07:43.951 "bdev_name": "Null1", 00:07:43.951 "name": "Null1", 00:07:43.951 "nguid": "B02E939CF0504719813B87EBD55D625D", 00:07:43.951 "uuid": "b02e939c-f050-4719-813b-87ebd55d625d" 00:07:43.951 } 00:07:43.951 ] 00:07:43.951 }, 00:07:43.951 { 00:07:43.951 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:43.951 "subtype": "NVMe", 00:07:43.951 "listen_addresses": [ 00:07:43.951 { 00:07:43.951 "transport": "TCP", 00:07:43.951 "trtype": "TCP", 00:07:43.951 "adrfam": "IPv4", 00:07:43.951 "traddr": "10.0.0.2", 00:07:43.951 "trsvcid": "4420" 00:07:43.951 } 00:07:43.951 ], 00:07:43.951 "allow_any_host": true, 00:07:43.951 "hosts": [], 00:07:43.951 "serial_number": "SPDK00000000000002", 00:07:43.951 "model_number": "SPDK bdev Controller", 00:07:43.951 "max_namespaces": 32, 00:07:43.951 "min_cntlid": 1, 00:07:43.951 "max_cntlid": 65519, 00:07:43.951 "namespaces": [ 00:07:43.951 { 00:07:43.951 "nsid": 1, 00:07:43.951 "bdev_name": "Null2", 00:07:43.951 "name": "Null2", 00:07:43.951 "nguid": "06C9B0CCFBC24795B7B9D6C6B523ECC0", 00:07:43.951 "uuid": "06c9b0cc-fbc2-4795-b7b9-d6c6b523ecc0" 00:07:43.951 } 00:07:43.951 ] 00:07:43.951 }, 00:07:43.951 { 00:07:43.951 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:43.951 "subtype": "NVMe", 00:07:43.951 "listen_addresses": [ 00:07:43.951 { 00:07:43.951 "transport": "TCP", 00:07:43.951 "trtype": "TCP", 00:07:43.951 "adrfam": "IPv4", 00:07:43.951 "traddr": "10.0.0.2", 00:07:43.951 "trsvcid": "4420" 00:07:43.951 } 00:07:43.951 ], 00:07:43.951 "allow_any_host": true, 00:07:43.951 "hosts": [], 00:07:43.951 "serial_number": "SPDK00000000000003", 00:07:43.951 "model_number": "SPDK bdev Controller", 00:07:43.951 "max_namespaces": 32, 00:07:43.951 "min_cntlid": 1, 00:07:43.951 "max_cntlid": 65519, 00:07:43.951 "namespaces": [ 00:07:43.951 { 00:07:43.951 "nsid": 1, 00:07:43.951 "bdev_name": "Null3", 00:07:43.951 "name": "Null3", 00:07:43.951 "nguid": "DA073B08D9E941C78962E1498AA274B4", 00:07:43.951 "uuid": "da073b08-d9e9-41c7-8962-e1498aa274b4" 00:07:43.951 } 00:07:43.951 ] 00:07:43.951 }, 00:07:43.951 { 00:07:43.951 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:43.951 "subtype": "NVMe", 00:07:43.951 "listen_addresses": [ 00:07:43.951 { 00:07:43.951 "transport": "TCP", 00:07:43.951 "trtype": "TCP", 00:07:43.951 "adrfam": "IPv4", 00:07:43.951 "traddr": "10.0.0.2", 00:07:43.951 "trsvcid": "4420" 00:07:43.951 } 00:07:43.951 ], 00:07:43.951 "allow_any_host": true, 00:07:43.951 "hosts": [], 00:07:43.951 "serial_number": "SPDK00000000000004", 00:07:43.951 "model_number": "SPDK bdev Controller", 00:07:43.951 "max_namespaces": 32, 00:07:43.951 "min_cntlid": 1, 00:07:43.951 "max_cntlid": 65519, 00:07:43.951 "namespaces": [ 00:07:43.951 { 00:07:43.951 "nsid": 1, 00:07:43.951 "bdev_name": "Null4", 00:07:43.951 "name": "Null4", 00:07:43.951 "nguid": "43F99AB25C0B41358D0C3ABD6CD9D1FB", 00:07:43.951 "uuid": "43f99ab2-5c0b-4135-8d0c-3abd6cd9d1fb" 00:07:43.951 } 00:07:43.951 ] 00:07:43.951 } 00:07:43.951 ] 00:07:43.951 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.951 01:43:32 -- target/discovery.sh@42 -- # seq 1 4 00:07:43.951 01:43:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:43.951 01:43:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:43.951 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.951 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.951 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.951 01:43:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:43.951 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.952 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:43.952 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.952 01:43:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:43.952 01:43:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:43.952 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.952 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:44.210 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.210 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:44.210 01:43:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:44.210 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.210 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:44.210 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.210 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:44.210 01:43:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:44.210 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.210 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:44.210 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.210 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:44.210 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.210 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:44.210 01:43:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.210 01:43:32 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:44.210 01:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.210 01:43:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.210 01:43:32 -- target/discovery.sh@49 -- # check_bdevs= 00:07:44.210 01:43:32 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:44.210 01:43:32 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:44.210 01:43:32 -- target/discovery.sh@57 -- # nvmftestfini 00:07:44.210 01:43:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:44.210 01:43:32 -- nvmf/common.sh@116 -- # sync 00:07:44.210 01:43:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:44.210 01:43:32 -- nvmf/common.sh@119 -- # set +e 00:07:44.210 01:43:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:44.210 01:43:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:44.210 rmmod nvme_tcp 00:07:44.210 rmmod nvme_fabrics 00:07:44.210 rmmod nvme_keyring 00:07:44.210 01:43:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:44.210 01:43:32 -- nvmf/common.sh@123 -- # set -e 00:07:44.210 01:43:32 -- nvmf/common.sh@124 -- # return 0 00:07:44.210 01:43:32 -- nvmf/common.sh@477 -- # '[' -n 3350964 ']' 00:07:44.210 01:43:32 -- nvmf/common.sh@478 -- # killprocess 3350964 00:07:44.210 01:43:32 -- common/autotest_common.sh@936 -- # '[' -z 3350964 ']' 00:07:44.210 01:43:32 -- common/autotest_common.sh@940 -- # kill -0 3350964 00:07:44.210 01:43:32 -- common/autotest_common.sh@941 -- # uname 00:07:44.210 01:43:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:44.210 01:43:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3350964 00:07:44.210 01:43:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:44.210 01:43:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:44.210 01:43:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3350964' 00:07:44.210 killing process with pid 3350964 00:07:44.210 01:43:32 -- common/autotest_common.sh@955 -- # kill 3350964 00:07:44.210 [2024-11-19 01:43:32.704557] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:44.210 01:43:32 -- common/autotest_common.sh@960 -- # wait 3350964 00:07:44.470 01:43:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:44.470 01:43:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:44.470 01:43:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:44.470 01:43:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:44.470 01:43:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:44.470 01:43:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:44.470 01:43:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:44.470 01:43:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:47.007 01:43:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:47.007 00:07:47.007 real 0m6.473s 00:07:47.007 user 0m8.132s 00:07:47.007 sys 0m1.937s 00:07:47.007 01:43:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.007 01:43:35 -- common/autotest_common.sh@10 -- # set +x 00:07:47.007 ************************************ 00:07:47.007 END TEST nvmf_discovery 00:07:47.007 ************************************ 00:07:47.007 01:43:35 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:47.007 01:43:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:47.007 01:43:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.007 01:43:35 -- common/autotest_common.sh@10 -- # set +x 00:07:47.007 ************************************ 00:07:47.007 START TEST nvmf_referrals 00:07:47.007 ************************************ 00:07:47.007 01:43:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:47.007 * Looking for test storage... 00:07:47.007 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.007 01:43:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:47.007 01:43:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:47.007 01:43:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:47.007 01:43:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:47.007 01:43:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:47.007 01:43:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:47.007 01:43:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:47.007 01:43:35 -- scripts/common.sh@335 -- # IFS=.-: 00:07:47.007 01:43:35 -- scripts/common.sh@335 -- # read -ra ver1 00:07:47.007 01:43:35 -- scripts/common.sh@336 -- # IFS=.-: 00:07:47.007 01:43:35 -- scripts/common.sh@336 -- # read -ra ver2 00:07:47.007 01:43:35 -- scripts/common.sh@337 -- # local 'op=<' 00:07:47.007 01:43:35 -- scripts/common.sh@339 -- # ver1_l=2 00:07:47.007 01:43:35 -- scripts/common.sh@340 -- # ver2_l=1 00:07:47.007 01:43:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:47.007 01:43:35 -- scripts/common.sh@343 -- # case "$op" in 00:07:47.007 01:43:35 -- scripts/common.sh@344 -- # : 1 00:07:47.007 01:43:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:47.007 01:43:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:47.007 01:43:35 -- scripts/common.sh@364 -- # decimal 1 00:07:47.007 01:43:35 -- scripts/common.sh@352 -- # local d=1 00:07:47.007 01:43:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:47.007 01:43:35 -- scripts/common.sh@354 -- # echo 1 00:07:47.007 01:43:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:47.007 01:43:35 -- scripts/common.sh@365 -- # decimal 2 00:07:47.007 01:43:35 -- scripts/common.sh@352 -- # local d=2 00:07:47.007 01:43:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:47.007 01:43:35 -- scripts/common.sh@354 -- # echo 2 00:07:47.007 01:43:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:47.007 01:43:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:47.007 01:43:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:47.007 01:43:35 -- scripts/common.sh@367 -- # return 0 00:07:47.007 01:43:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:47.007 01:43:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:47.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.007 --rc genhtml_branch_coverage=1 00:07:47.007 --rc genhtml_function_coverage=1 00:07:47.007 --rc genhtml_legend=1 00:07:47.007 --rc geninfo_all_blocks=1 00:07:47.007 --rc geninfo_unexecuted_blocks=1 00:07:47.007 00:07:47.007 ' 00:07:47.007 01:43:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:47.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.007 --rc genhtml_branch_coverage=1 00:07:47.007 --rc genhtml_function_coverage=1 00:07:47.007 --rc genhtml_legend=1 00:07:47.007 --rc geninfo_all_blocks=1 00:07:47.007 --rc geninfo_unexecuted_blocks=1 00:07:47.007 00:07:47.007 ' 00:07:47.007 01:43:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:47.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.007 --rc genhtml_branch_coverage=1 00:07:47.007 --rc genhtml_function_coverage=1 00:07:47.007 --rc genhtml_legend=1 00:07:47.007 --rc geninfo_all_blocks=1 00:07:47.007 --rc geninfo_unexecuted_blocks=1 00:07:47.007 00:07:47.007 ' 00:07:47.007 01:43:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:47.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.007 --rc genhtml_branch_coverage=1 00:07:47.007 --rc genhtml_function_coverage=1 00:07:47.007 --rc genhtml_legend=1 00:07:47.007 --rc geninfo_all_blocks=1 00:07:47.007 --rc geninfo_unexecuted_blocks=1 00:07:47.007 00:07:47.007 ' 00:07:47.007 01:43:35 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:47.007 01:43:35 -- nvmf/common.sh@7 -- # uname -s 00:07:47.007 01:43:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:47.007 01:43:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:47.007 01:43:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:47.007 01:43:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:47.007 01:43:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:47.007 01:43:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:47.007 01:43:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:47.008 01:43:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:47.008 01:43:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:47.008 01:43:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:47.008 01:43:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.008 01:43:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.008 01:43:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:47.008 01:43:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:47.008 01:43:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:47.008 01:43:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:47.008 01:43:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:47.008 01:43:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:47.008 01:43:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:47.008 01:43:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.008 01:43:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.008 01:43:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.008 01:43:35 -- paths/export.sh@5 -- # export PATH 00:07:47.008 01:43:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.008 01:43:35 -- nvmf/common.sh@46 -- # : 0 00:07:47.008 01:43:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:47.008 01:43:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:47.008 01:43:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:47.008 01:43:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:47.008 01:43:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:47.008 01:43:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:47.008 01:43:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:47.008 01:43:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:47.008 01:43:35 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:47.008 01:43:35 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:47.008 01:43:35 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:47.008 01:43:35 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:47.008 01:43:35 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:47.008 01:43:35 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:47.008 01:43:35 -- target/referrals.sh@37 -- # nvmftestinit 00:07:47.008 01:43:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:47.008 01:43:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:47.008 01:43:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:47.008 01:43:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:47.008 01:43:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:47.008 01:43:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:47.008 01:43:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:47.008 01:43:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:47.008 01:43:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:47.008 01:43:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:47.008 01:43:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:47.008 01:43:35 -- common/autotest_common.sh@10 -- # set +x 00:07:48.910 01:43:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:48.910 01:43:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:48.910 01:43:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:48.910 01:43:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:48.910 01:43:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:48.910 01:43:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:48.910 01:43:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:48.910 01:43:37 -- nvmf/common.sh@294 -- # net_devs=() 00:07:48.910 01:43:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:48.910 01:43:37 -- nvmf/common.sh@295 -- # e810=() 00:07:48.910 01:43:37 -- nvmf/common.sh@295 -- # local -ga e810 00:07:48.910 01:43:37 -- nvmf/common.sh@296 -- # x722=() 00:07:48.910 01:43:37 -- nvmf/common.sh@296 -- # local -ga x722 00:07:48.910 01:43:37 -- nvmf/common.sh@297 -- # mlx=() 00:07:48.910 01:43:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:48.910 01:43:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:48.910 01:43:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:48.910 01:43:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:48.910 01:43:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:48.910 01:43:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:48.910 01:43:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:48.910 01:43:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:48.910 01:43:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.911 01:43:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:48.911 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:48.911 01:43:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.911 01:43:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:48.911 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:48.911 01:43:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:48.911 01:43:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.911 01:43:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.911 01:43:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.911 01:43:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.911 01:43:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:48.911 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:48.911 01:43:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.911 01:43:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.911 01:43:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.911 01:43:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.911 01:43:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.911 01:43:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:48.911 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:48.911 01:43:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.911 01:43:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:48.911 01:43:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:48.911 01:43:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:48.911 01:43:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:48.911 01:43:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:48.911 01:43:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:48.911 01:43:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:48.911 01:43:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:48.911 01:43:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:48.911 01:43:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:48.911 01:43:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:48.911 01:43:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:48.911 01:43:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:48.911 01:43:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:48.911 01:43:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:48.911 01:43:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:48.911 01:43:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:48.911 01:43:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:48.911 01:43:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:48.911 01:43:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:48.911 01:43:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:48.911 01:43:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:48.911 01:43:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:48.911 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:48.911 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:07:48.911 00:07:48.911 --- 10.0.0.2 ping statistics --- 00:07:48.911 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.911 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:07:48.911 01:43:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:48.911 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:48.911 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:07:48.911 00:07:48.911 --- 10.0.0.1 ping statistics --- 00:07:48.911 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.911 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:07:48.911 01:43:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:48.911 01:43:37 -- nvmf/common.sh@410 -- # return 0 00:07:48.911 01:43:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:48.911 01:43:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:48.911 01:43:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:48.911 01:43:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:48.911 01:43:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:48.911 01:43:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:48.911 01:43:37 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:48.911 01:43:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:48.911 01:43:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:48.911 01:43:37 -- common/autotest_common.sh@10 -- # set +x 00:07:48.911 01:43:37 -- nvmf/common.sh@469 -- # nvmfpid=3353110 00:07:48.911 01:43:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:48.911 01:43:37 -- nvmf/common.sh@470 -- # waitforlisten 3353110 00:07:48.911 01:43:37 -- common/autotest_common.sh@829 -- # '[' -z 3353110 ']' 00:07:48.911 01:43:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.911 01:43:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.911 01:43:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.911 01:43:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.911 01:43:37 -- common/autotest_common.sh@10 -- # set +x 00:07:49.170 [2024-11-19 01:43:37.463736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:49.170 [2024-11-19 01:43:37.463814] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:49.170 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.170 [2024-11-19 01:43:37.533488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:49.170 [2024-11-19 01:43:37.655414] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.170 [2024-11-19 01:43:37.655568] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:49.170 [2024-11-19 01:43:37.655587] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:49.170 [2024-11-19 01:43:37.655601] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:49.170 [2024-11-19 01:43:37.655665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:49.170 [2024-11-19 01:43:37.655696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:49.170 [2024-11-19 01:43:37.655749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:49.170 [2024-11-19 01:43:37.655753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.224 01:43:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:50.224 01:43:38 -- common/autotest_common.sh@862 -- # return 0 00:07:50.224 01:43:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:50.224 01:43:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 01:43:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:50.224 01:43:38 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 [2024-11-19 01:43:38.462213] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:50.224 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 [2024-11-19 01:43:38.474426] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:50.224 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.224 01:43:38 -- target/referrals.sh@48 -- # jq length 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:50.224 01:43:38 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:50.224 01:43:38 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:50.224 01:43:38 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.224 01:43:38 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.224 01:43:38 -- target/referrals.sh@21 -- # sort 00:07:50.224 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:50.224 01:43:38 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:50.224 01:43:38 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:50.224 01:43:38 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:50.224 01:43:38 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.224 01:43:38 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:50.224 01:43:38 -- target/referrals.sh@26 -- # sort 00:07:50.224 01:43:38 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:50.224 01:43:38 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:50.224 01:43:38 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:50.224 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.224 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.482 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.482 01:43:38 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:50.482 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.482 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.482 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.482 01:43:38 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:50.482 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.482 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.482 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.482 01:43:38 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.482 01:43:38 -- target/referrals.sh@56 -- # jq length 00:07:50.482 01:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.482 01:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:50.482 01:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.482 01:43:38 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:50.482 01:43:38 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:50.482 01:43:38 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:50.482 01:43:38 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:50.482 01:43:38 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.482 01:43:38 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:50.482 01:43:38 -- target/referrals.sh@26 -- # sort 00:07:50.740 01:43:39 -- target/referrals.sh@26 -- # echo 00:07:50.740 01:43:39 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:50.740 01:43:39 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:50.740 01:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.740 01:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:50.740 01:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.740 01:43:39 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:50.740 01:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.740 01:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:50.740 01:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.740 01:43:39 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:50.740 01:43:39 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:50.740 01:43:39 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.740 01:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.740 01:43:39 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:50.740 01:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:50.740 01:43:39 -- target/referrals.sh@21 -- # sort 00:07:50.740 01:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.740 01:43:39 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:50.740 01:43:39 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:50.740 01:43:39 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:50.740 01:43:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:50.740 01:43:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:50.740 01:43:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.740 01:43:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:50.740 01:43:39 -- target/referrals.sh@26 -- # sort 00:07:50.740 01:43:39 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:50.740 01:43:39 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:50.740 01:43:39 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:50.740 01:43:39 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:50.740 01:43:39 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:50.740 01:43:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.740 01:43:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:50.997 01:43:39 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:50.997 01:43:39 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:50.997 01:43:39 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:50.997 01:43:39 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:50.997 01:43:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.997 01:43:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:51.255 01:43:39 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:51.255 01:43:39 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:51.255 01:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.255 01:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:51.255 01:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.255 01:43:39 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:51.255 01:43:39 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:51.255 01:43:39 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:51.255 01:43:39 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:51.255 01:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.255 01:43:39 -- target/referrals.sh@21 -- # sort 00:07:51.255 01:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:51.255 01:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.255 01:43:39 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:51.255 01:43:39 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:51.255 01:43:39 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:51.255 01:43:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:51.255 01:43:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:51.255 01:43:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.255 01:43:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:51.255 01:43:39 -- target/referrals.sh@26 -- # sort 00:07:51.512 01:43:39 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:51.512 01:43:39 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:51.512 01:43:39 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:51.512 01:43:39 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:51.512 01:43:39 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:51.512 01:43:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.512 01:43:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:51.770 01:43:40 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:51.770 01:43:40 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:51.770 01:43:40 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:51.770 01:43:40 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:51.770 01:43:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.770 01:43:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:51.770 01:43:40 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:51.770 01:43:40 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:51.770 01:43:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.770 01:43:40 -- common/autotest_common.sh@10 -- # set +x 00:07:51.770 01:43:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.770 01:43:40 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:51.770 01:43:40 -- target/referrals.sh@82 -- # jq length 00:07:51.770 01:43:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.770 01:43:40 -- common/autotest_common.sh@10 -- # set +x 00:07:51.770 01:43:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.027 01:43:40 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:52.027 01:43:40 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:52.027 01:43:40 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:52.027 01:43:40 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:52.027 01:43:40 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:52.027 01:43:40 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:52.027 01:43:40 -- target/referrals.sh@26 -- # sort 00:07:52.027 01:43:40 -- target/referrals.sh@26 -- # echo 00:07:52.027 01:43:40 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:52.027 01:43:40 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:52.027 01:43:40 -- target/referrals.sh@86 -- # nvmftestfini 00:07:52.027 01:43:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:52.027 01:43:40 -- nvmf/common.sh@116 -- # sync 00:07:52.027 01:43:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:52.027 01:43:40 -- nvmf/common.sh@119 -- # set +e 00:07:52.027 01:43:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:52.027 01:43:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:52.027 rmmod nvme_tcp 00:07:52.285 rmmod nvme_fabrics 00:07:52.285 rmmod nvme_keyring 00:07:52.285 01:43:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:52.285 01:43:40 -- nvmf/common.sh@123 -- # set -e 00:07:52.285 01:43:40 -- nvmf/common.sh@124 -- # return 0 00:07:52.285 01:43:40 -- nvmf/common.sh@477 -- # '[' -n 3353110 ']' 00:07:52.285 01:43:40 -- nvmf/common.sh@478 -- # killprocess 3353110 00:07:52.285 01:43:40 -- common/autotest_common.sh@936 -- # '[' -z 3353110 ']' 00:07:52.285 01:43:40 -- common/autotest_common.sh@940 -- # kill -0 3353110 00:07:52.285 01:43:40 -- common/autotest_common.sh@941 -- # uname 00:07:52.285 01:43:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:52.285 01:43:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3353110 00:07:52.285 01:43:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:52.285 01:43:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:52.285 01:43:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3353110' 00:07:52.285 killing process with pid 3353110 00:07:52.285 01:43:40 -- common/autotest_common.sh@955 -- # kill 3353110 00:07:52.285 01:43:40 -- common/autotest_common.sh@960 -- # wait 3353110 00:07:52.544 01:43:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:52.544 01:43:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:52.544 01:43:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:52.544 01:43:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:52.544 01:43:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:52.544 01:43:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.544 01:43:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.544 01:43:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:54.448 01:43:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:54.448 00:07:54.448 real 0m7.898s 00:07:54.448 user 0m14.563s 00:07:54.448 sys 0m2.275s 00:07:54.448 01:43:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:54.448 01:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:54.448 ************************************ 00:07:54.448 END TEST nvmf_referrals 00:07:54.448 ************************************ 00:07:54.448 01:43:42 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:54.448 01:43:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:54.448 01:43:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.448 01:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:54.448 ************************************ 00:07:54.448 START TEST nvmf_connect_disconnect 00:07:54.448 ************************************ 00:07:54.448 01:43:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:54.706 * Looking for test storage... 00:07:54.706 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:54.706 01:43:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:54.706 01:43:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:54.706 01:43:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:54.706 01:43:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:54.706 01:43:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:54.706 01:43:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:54.706 01:43:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:54.706 01:43:43 -- scripts/common.sh@335 -- # IFS=.-: 00:07:54.706 01:43:43 -- scripts/common.sh@335 -- # read -ra ver1 00:07:54.707 01:43:43 -- scripts/common.sh@336 -- # IFS=.-: 00:07:54.707 01:43:43 -- scripts/common.sh@336 -- # read -ra ver2 00:07:54.707 01:43:43 -- scripts/common.sh@337 -- # local 'op=<' 00:07:54.707 01:43:43 -- scripts/common.sh@339 -- # ver1_l=2 00:07:54.707 01:43:43 -- scripts/common.sh@340 -- # ver2_l=1 00:07:54.707 01:43:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:54.707 01:43:43 -- scripts/common.sh@343 -- # case "$op" in 00:07:54.707 01:43:43 -- scripts/common.sh@344 -- # : 1 00:07:54.707 01:43:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:54.707 01:43:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:54.707 01:43:43 -- scripts/common.sh@364 -- # decimal 1 00:07:54.707 01:43:43 -- scripts/common.sh@352 -- # local d=1 00:07:54.707 01:43:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:54.707 01:43:43 -- scripts/common.sh@354 -- # echo 1 00:07:54.707 01:43:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:54.707 01:43:43 -- scripts/common.sh@365 -- # decimal 2 00:07:54.707 01:43:43 -- scripts/common.sh@352 -- # local d=2 00:07:54.707 01:43:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:54.707 01:43:43 -- scripts/common.sh@354 -- # echo 2 00:07:54.707 01:43:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:54.707 01:43:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:54.707 01:43:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:54.707 01:43:43 -- scripts/common.sh@367 -- # return 0 00:07:54.707 01:43:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:54.707 01:43:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:54.707 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.707 --rc genhtml_branch_coverage=1 00:07:54.707 --rc genhtml_function_coverage=1 00:07:54.707 --rc genhtml_legend=1 00:07:54.707 --rc geninfo_all_blocks=1 00:07:54.707 --rc geninfo_unexecuted_blocks=1 00:07:54.707 00:07:54.707 ' 00:07:54.707 01:43:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:54.707 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.707 --rc genhtml_branch_coverage=1 00:07:54.707 --rc genhtml_function_coverage=1 00:07:54.707 --rc genhtml_legend=1 00:07:54.707 --rc geninfo_all_blocks=1 00:07:54.707 --rc geninfo_unexecuted_blocks=1 00:07:54.707 00:07:54.707 ' 00:07:54.707 01:43:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:54.707 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.707 --rc genhtml_branch_coverage=1 00:07:54.707 --rc genhtml_function_coverage=1 00:07:54.707 --rc genhtml_legend=1 00:07:54.707 --rc geninfo_all_blocks=1 00:07:54.707 --rc geninfo_unexecuted_blocks=1 00:07:54.707 00:07:54.707 ' 00:07:54.707 01:43:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:54.707 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.707 --rc genhtml_branch_coverage=1 00:07:54.707 --rc genhtml_function_coverage=1 00:07:54.707 --rc genhtml_legend=1 00:07:54.707 --rc geninfo_all_blocks=1 00:07:54.707 --rc geninfo_unexecuted_blocks=1 00:07:54.707 00:07:54.707 ' 00:07:54.707 01:43:43 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:54.707 01:43:43 -- nvmf/common.sh@7 -- # uname -s 00:07:54.707 01:43:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:54.707 01:43:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:54.707 01:43:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:54.707 01:43:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:54.707 01:43:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:54.707 01:43:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:54.707 01:43:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:54.707 01:43:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:54.707 01:43:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:54.707 01:43:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:54.707 01:43:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:54.707 01:43:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:54.707 01:43:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:54.707 01:43:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:54.707 01:43:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:54.707 01:43:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:54.707 01:43:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:54.707 01:43:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:54.707 01:43:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:54.707 01:43:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.707 01:43:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.707 01:43:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.707 01:43:43 -- paths/export.sh@5 -- # export PATH 00:07:54.707 01:43:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.707 01:43:43 -- nvmf/common.sh@46 -- # : 0 00:07:54.707 01:43:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:54.707 01:43:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:54.707 01:43:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:54.707 01:43:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:54.707 01:43:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:54.707 01:43:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:54.707 01:43:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:54.707 01:43:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:54.707 01:43:43 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:54.707 01:43:43 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:54.707 01:43:43 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:54.707 01:43:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:54.707 01:43:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:54.707 01:43:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:54.707 01:43:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:54.707 01:43:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:54.707 01:43:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:54.707 01:43:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:54.707 01:43:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:54.707 01:43:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:54.707 01:43:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:54.707 01:43:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:54.707 01:43:43 -- common/autotest_common.sh@10 -- # set +x 00:07:57.234 01:43:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:57.234 01:43:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:57.234 01:43:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:57.234 01:43:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:57.234 01:43:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:57.234 01:43:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:57.234 01:43:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:57.234 01:43:45 -- nvmf/common.sh@294 -- # net_devs=() 00:07:57.234 01:43:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:57.234 01:43:45 -- nvmf/common.sh@295 -- # e810=() 00:07:57.234 01:43:45 -- nvmf/common.sh@295 -- # local -ga e810 00:07:57.234 01:43:45 -- nvmf/common.sh@296 -- # x722=() 00:07:57.234 01:43:45 -- nvmf/common.sh@296 -- # local -ga x722 00:07:57.234 01:43:45 -- nvmf/common.sh@297 -- # mlx=() 00:07:57.234 01:43:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:57.234 01:43:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:57.234 01:43:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:57.234 01:43:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:57.234 01:43:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:57.234 01:43:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:57.234 01:43:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:57.234 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:57.234 01:43:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:57.234 01:43:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:57.234 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:57.234 01:43:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:57.234 01:43:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:57.234 01:43:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:57.234 01:43:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:57.234 01:43:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:57.234 01:43:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:57.234 01:43:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:57.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:57.235 01:43:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:57.235 01:43:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:57.235 01:43:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:57.235 01:43:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:57.235 01:43:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:57.235 01:43:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:57.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:57.235 01:43:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:57.235 01:43:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:57.235 01:43:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:57.235 01:43:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:57.235 01:43:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:57.235 01:43:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:57.235 01:43:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:57.235 01:43:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:57.235 01:43:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:57.235 01:43:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:57.235 01:43:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:57.235 01:43:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:57.235 01:43:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:57.235 01:43:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:57.235 01:43:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:57.235 01:43:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:57.235 01:43:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:57.235 01:43:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:57.235 01:43:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:57.235 01:43:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:57.235 01:43:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:57.235 01:43:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:57.235 01:43:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:57.235 01:43:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:57.235 01:43:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:57.235 01:43:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:57.235 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:57.235 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:07:57.235 00:07:57.235 --- 10.0.0.2 ping statistics --- 00:07:57.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:57.235 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:07:57.235 01:43:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:57.235 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:57.235 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:07:57.235 00:07:57.235 --- 10.0.0.1 ping statistics --- 00:07:57.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:57.235 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:07:57.235 01:43:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:57.235 01:43:45 -- nvmf/common.sh@410 -- # return 0 00:07:57.235 01:43:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:57.235 01:43:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:57.235 01:43:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:57.235 01:43:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:57.235 01:43:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:57.235 01:43:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:57.235 01:43:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:57.235 01:43:45 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:57.235 01:43:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:57.235 01:43:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:57.235 01:43:45 -- common/autotest_common.sh@10 -- # set +x 00:07:57.235 01:43:45 -- nvmf/common.sh@469 -- # nvmfpid=3355618 00:07:57.235 01:43:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:57.235 01:43:45 -- nvmf/common.sh@470 -- # waitforlisten 3355618 00:07:57.235 01:43:45 -- common/autotest_common.sh@829 -- # '[' -z 3355618 ']' 00:07:57.235 01:43:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:57.235 01:43:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:57.235 01:43:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:57.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:57.235 01:43:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:57.235 01:43:45 -- common/autotest_common.sh@10 -- # set +x 00:07:57.235 [2024-11-19 01:43:45.385582] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:57.235 [2024-11-19 01:43:45.385687] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:57.235 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.235 [2024-11-19 01:43:45.454238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:57.235 [2024-11-19 01:43:45.567333] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:57.235 [2024-11-19 01:43:45.567477] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:57.235 [2024-11-19 01:43:45.567494] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:57.235 [2024-11-19 01:43:45.567506] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:57.235 [2024-11-19 01:43:45.567587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:57.235 [2024-11-19 01:43:45.567673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:57.235 [2024-11-19 01:43:45.567677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:57.235 [2024-11-19 01:43:45.567614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:58.168 01:43:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:58.168 01:43:46 -- common/autotest_common.sh@862 -- # return 0 00:07:58.168 01:43:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:58.168 01:43:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:58.168 01:43:46 -- common/autotest_common.sh@10 -- # set +x 00:07:58.168 01:43:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:58.168 01:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.168 01:43:46 -- common/autotest_common.sh@10 -- # set +x 00:07:58.168 [2024-11-19 01:43:46.413301] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:58.168 01:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:58.168 01:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.168 01:43:46 -- common/autotest_common.sh@10 -- # set +x 00:07:58.168 01:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:58.168 01:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.168 01:43:46 -- common/autotest_common.sh@10 -- # set +x 00:07:58.168 01:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:58.168 01:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.168 01:43:46 -- common/autotest_common.sh@10 -- # set +x 00:07:58.168 01:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:58.168 01:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:58.168 01:43:46 -- common/autotest_common.sh@10 -- # set +x 00:07:58.168 [2024-11-19 01:43:46.465160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:58.168 01:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:58.168 01:43:46 -- target/connect_disconnect.sh@34 -- # set +x 00:08:00.692 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.114 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.642 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.167 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.074 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.599 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.021 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.546 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.073 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.599 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.495 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.500 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.027 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.462 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.987 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.940 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.838 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.792 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.318 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.703 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.176 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.701 [2024-11-19 01:45:09.717407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1da6420 is same with the state(5) to be set 00:09:21.701 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.121 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.646 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.172 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.070 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.055 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.533 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.383 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.909 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.434 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.861 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.290 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.890 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.415 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.257 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.782 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.306 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.726 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.252 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.778 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.198 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.197 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.622 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.149 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.675 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.102 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.578 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.476 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.003 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.048 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.903 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.853 01:47:38 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:49.853 01:47:38 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:49.853 01:47:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:49.853 01:47:38 -- nvmf/common.sh@116 -- # sync 00:11:49.853 01:47:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:49.853 01:47:38 -- nvmf/common.sh@119 -- # set +e 00:11:49.853 01:47:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:49.853 01:47:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:49.853 rmmod nvme_tcp 00:11:49.853 rmmod nvme_fabrics 00:11:49.853 rmmod nvme_keyring 00:11:49.854 01:47:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:49.854 01:47:38 -- nvmf/common.sh@123 -- # set -e 00:11:49.854 01:47:38 -- nvmf/common.sh@124 -- # return 0 00:11:49.854 01:47:38 -- nvmf/common.sh@477 -- # '[' -n 3355618 ']' 00:11:49.854 01:47:38 -- nvmf/common.sh@478 -- # killprocess 3355618 00:11:49.854 01:47:38 -- common/autotest_common.sh@936 -- # '[' -z 3355618 ']' 00:11:49.854 01:47:38 -- common/autotest_common.sh@940 -- # kill -0 3355618 00:11:49.854 01:47:38 -- common/autotest_common.sh@941 -- # uname 00:11:49.854 01:47:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:49.854 01:47:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3355618 00:11:49.854 01:47:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:49.854 01:47:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:49.854 01:47:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3355618' 00:11:49.854 killing process with pid 3355618 00:11:49.854 01:47:38 -- common/autotest_common.sh@955 -- # kill 3355618 00:11:49.854 01:47:38 -- common/autotest_common.sh@960 -- # wait 3355618 00:11:50.112 01:47:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:50.112 01:47:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:50.112 01:47:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:50.112 01:47:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:50.112 01:47:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:50.112 01:47:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:50.112 01:47:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:50.112 01:47:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:52.647 01:47:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:52.647 00:11:52.647 real 3m57.657s 00:11:52.647 user 15m5.972s 00:11:52.647 sys 0m34.985s 00:11:52.647 01:47:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:52.647 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:11:52.647 ************************************ 00:11:52.647 END TEST nvmf_connect_disconnect 00:11:52.647 ************************************ 00:11:52.647 01:47:40 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:52.647 01:47:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:52.647 01:47:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:52.647 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:11:52.647 ************************************ 00:11:52.647 START TEST nvmf_multitarget 00:11:52.647 ************************************ 00:11:52.647 01:47:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:52.647 * Looking for test storage... 00:11:52.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:52.647 01:47:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:52.647 01:47:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:52.647 01:47:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:52.647 01:47:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:52.647 01:47:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:52.647 01:47:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:52.647 01:47:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:52.647 01:47:40 -- scripts/common.sh@335 -- # IFS=.-: 00:11:52.647 01:47:40 -- scripts/common.sh@335 -- # read -ra ver1 00:11:52.647 01:47:40 -- scripts/common.sh@336 -- # IFS=.-: 00:11:52.647 01:47:40 -- scripts/common.sh@336 -- # read -ra ver2 00:11:52.647 01:47:40 -- scripts/common.sh@337 -- # local 'op=<' 00:11:52.647 01:47:40 -- scripts/common.sh@339 -- # ver1_l=2 00:11:52.647 01:47:40 -- scripts/common.sh@340 -- # ver2_l=1 00:11:52.647 01:47:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:52.647 01:47:40 -- scripts/common.sh@343 -- # case "$op" in 00:11:52.647 01:47:40 -- scripts/common.sh@344 -- # : 1 00:11:52.647 01:47:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:52.647 01:47:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:52.647 01:47:40 -- scripts/common.sh@364 -- # decimal 1 00:11:52.647 01:47:40 -- scripts/common.sh@352 -- # local d=1 00:11:52.647 01:47:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:52.647 01:47:40 -- scripts/common.sh@354 -- # echo 1 00:11:52.647 01:47:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:52.647 01:47:40 -- scripts/common.sh@365 -- # decimal 2 00:11:52.647 01:47:40 -- scripts/common.sh@352 -- # local d=2 00:11:52.647 01:47:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:52.647 01:47:40 -- scripts/common.sh@354 -- # echo 2 00:11:52.647 01:47:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:52.647 01:47:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:52.647 01:47:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:52.647 01:47:40 -- scripts/common.sh@367 -- # return 0 00:11:52.647 01:47:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:52.647 01:47:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:52.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.647 --rc genhtml_branch_coverage=1 00:11:52.647 --rc genhtml_function_coverage=1 00:11:52.647 --rc genhtml_legend=1 00:11:52.647 --rc geninfo_all_blocks=1 00:11:52.647 --rc geninfo_unexecuted_blocks=1 00:11:52.647 00:11:52.647 ' 00:11:52.647 01:47:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:52.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.647 --rc genhtml_branch_coverage=1 00:11:52.647 --rc genhtml_function_coverage=1 00:11:52.647 --rc genhtml_legend=1 00:11:52.647 --rc geninfo_all_blocks=1 00:11:52.647 --rc geninfo_unexecuted_blocks=1 00:11:52.647 00:11:52.647 ' 00:11:52.647 01:47:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:52.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.647 --rc genhtml_branch_coverage=1 00:11:52.647 --rc genhtml_function_coverage=1 00:11:52.647 --rc genhtml_legend=1 00:11:52.647 --rc geninfo_all_blocks=1 00:11:52.647 --rc geninfo_unexecuted_blocks=1 00:11:52.647 00:11:52.647 ' 00:11:52.647 01:47:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:52.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.647 --rc genhtml_branch_coverage=1 00:11:52.647 --rc genhtml_function_coverage=1 00:11:52.647 --rc genhtml_legend=1 00:11:52.647 --rc geninfo_all_blocks=1 00:11:52.647 --rc geninfo_unexecuted_blocks=1 00:11:52.647 00:11:52.647 ' 00:11:52.647 01:47:40 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:52.647 01:47:40 -- nvmf/common.sh@7 -- # uname -s 00:11:52.647 01:47:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:52.647 01:47:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:52.647 01:47:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:52.647 01:47:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:52.647 01:47:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:52.648 01:47:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:52.648 01:47:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:52.648 01:47:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:52.648 01:47:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:52.648 01:47:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:52.648 01:47:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:52.648 01:47:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:52.648 01:47:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:52.648 01:47:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:52.648 01:47:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:52.648 01:47:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:52.648 01:47:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:52.648 01:47:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:52.648 01:47:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:52.648 01:47:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.648 01:47:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.648 01:47:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.648 01:47:40 -- paths/export.sh@5 -- # export PATH 00:11:52.648 01:47:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.648 01:47:40 -- nvmf/common.sh@46 -- # : 0 00:11:52.648 01:47:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:52.648 01:47:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:52.648 01:47:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:52.648 01:47:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:52.648 01:47:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:52.648 01:47:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:52.648 01:47:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:52.648 01:47:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:52.648 01:47:40 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:52.648 01:47:40 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:52.648 01:47:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:52.648 01:47:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:52.648 01:47:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:52.648 01:47:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:52.648 01:47:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:52.648 01:47:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:52.648 01:47:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:52.648 01:47:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:52.648 01:47:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:52.648 01:47:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:52.648 01:47:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:52.648 01:47:40 -- common/autotest_common.sh@10 -- # set +x 00:11:54.551 01:47:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:54.551 01:47:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:54.551 01:47:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:54.551 01:47:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:54.551 01:47:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:54.551 01:47:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:54.551 01:47:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:54.551 01:47:42 -- nvmf/common.sh@294 -- # net_devs=() 00:11:54.551 01:47:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:54.551 01:47:42 -- nvmf/common.sh@295 -- # e810=() 00:11:54.551 01:47:42 -- nvmf/common.sh@295 -- # local -ga e810 00:11:54.551 01:47:42 -- nvmf/common.sh@296 -- # x722=() 00:11:54.551 01:47:42 -- nvmf/common.sh@296 -- # local -ga x722 00:11:54.551 01:47:42 -- nvmf/common.sh@297 -- # mlx=() 00:11:54.551 01:47:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:54.551 01:47:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:54.551 01:47:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:54.552 01:47:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:54.552 01:47:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:54.552 01:47:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:54.552 01:47:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:54.552 01:47:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:54.552 01:47:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:54.552 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:54.552 01:47:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:54.552 01:47:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:54.552 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:54.552 01:47:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:54.552 01:47:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:54.552 01:47:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:54.552 01:47:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:54.552 01:47:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:54.552 01:47:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:54.552 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:54.552 01:47:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:54.552 01:47:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:54.552 01:47:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:54.552 01:47:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:54.552 01:47:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:54.552 01:47:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:54.552 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:54.552 01:47:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:54.552 01:47:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:54.552 01:47:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:54.552 01:47:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:54.552 01:47:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:54.552 01:47:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:54.552 01:47:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:54.552 01:47:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:54.552 01:47:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:54.552 01:47:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:54.552 01:47:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:54.552 01:47:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:54.552 01:47:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:54.552 01:47:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:54.552 01:47:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:54.552 01:47:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:54.552 01:47:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:54.552 01:47:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:54.552 01:47:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:54.552 01:47:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:54.552 01:47:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:54.552 01:47:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:54.552 01:47:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:54.552 01:47:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:54.552 01:47:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:54.552 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:54.552 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:11:54.552 00:11:54.552 --- 10.0.0.2 ping statistics --- 00:11:54.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:54.552 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:11:54.552 01:47:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:54.552 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:54.552 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:11:54.552 00:11:54.552 --- 10.0.0.1 ping statistics --- 00:11:54.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:54.552 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:11:54.552 01:47:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:54.552 01:47:43 -- nvmf/common.sh@410 -- # return 0 00:11:54.552 01:47:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:54.552 01:47:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:54.552 01:47:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:54.552 01:47:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:54.552 01:47:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:54.552 01:47:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:54.552 01:47:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:54.552 01:47:43 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:54.552 01:47:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:54.552 01:47:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:54.552 01:47:43 -- common/autotest_common.sh@10 -- # set +x 00:11:54.552 01:47:43 -- nvmf/common.sh@469 -- # nvmfpid=3387823 00:11:54.552 01:47:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:54.552 01:47:43 -- nvmf/common.sh@470 -- # waitforlisten 3387823 00:11:54.552 01:47:43 -- common/autotest_common.sh@829 -- # '[' -z 3387823 ']' 00:11:54.552 01:47:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:54.552 01:47:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:54.552 01:47:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:54.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:54.552 01:47:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:54.552 01:47:43 -- common/autotest_common.sh@10 -- # set +x 00:11:54.810 [2024-11-19 01:47:43.098666] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:54.810 [2024-11-19 01:47:43.098751] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:54.810 EAL: No free 2048 kB hugepages reported on node 1 00:11:54.810 [2024-11-19 01:47:43.163260] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:54.810 [2024-11-19 01:47:43.267958] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:54.810 [2024-11-19 01:47:43.268107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:54.810 [2024-11-19 01:47:43.268141] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:54.810 [2024-11-19 01:47:43.268154] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:54.810 [2024-11-19 01:47:43.268225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:54.810 [2024-11-19 01:47:43.268277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:54.810 [2024-11-19 01:47:43.268303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:54.810 [2024-11-19 01:47:43.268306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:55.743 01:47:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:55.743 01:47:44 -- common/autotest_common.sh@862 -- # return 0 00:11:55.743 01:47:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:55.743 01:47:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:55.743 01:47:44 -- common/autotest_common.sh@10 -- # set +x 00:11:55.743 01:47:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:55.743 01:47:44 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:55.743 01:47:44 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:55.743 01:47:44 -- target/multitarget.sh@21 -- # jq length 00:11:55.743 01:47:44 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:55.743 01:47:44 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:56.001 "nvmf_tgt_1" 00:11:56.001 01:47:44 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:56.001 "nvmf_tgt_2" 00:11:56.001 01:47:44 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:56.001 01:47:44 -- target/multitarget.sh@28 -- # jq length 00:11:56.258 01:47:44 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:56.258 01:47:44 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:56.258 true 00:11:56.258 01:47:44 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:56.258 true 00:11:56.258 01:47:44 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:56.258 01:47:44 -- target/multitarget.sh@35 -- # jq length 00:11:56.517 01:47:44 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:56.517 01:47:44 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:56.517 01:47:44 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:56.517 01:47:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:56.517 01:47:44 -- nvmf/common.sh@116 -- # sync 00:11:56.517 01:47:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:56.517 01:47:44 -- nvmf/common.sh@119 -- # set +e 00:11:56.517 01:47:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:56.517 01:47:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:56.517 rmmod nvme_tcp 00:11:56.517 rmmod nvme_fabrics 00:11:56.517 rmmod nvme_keyring 00:11:56.517 01:47:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:56.517 01:47:44 -- nvmf/common.sh@123 -- # set -e 00:11:56.517 01:47:44 -- nvmf/common.sh@124 -- # return 0 00:11:56.517 01:47:44 -- nvmf/common.sh@477 -- # '[' -n 3387823 ']' 00:11:56.517 01:47:44 -- nvmf/common.sh@478 -- # killprocess 3387823 00:11:56.517 01:47:44 -- common/autotest_common.sh@936 -- # '[' -z 3387823 ']' 00:11:56.517 01:47:44 -- common/autotest_common.sh@940 -- # kill -0 3387823 00:11:56.517 01:47:44 -- common/autotest_common.sh@941 -- # uname 00:11:56.517 01:47:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:56.517 01:47:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3387823 00:11:56.517 01:47:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:56.517 01:47:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:56.517 01:47:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3387823' 00:11:56.517 killing process with pid 3387823 00:11:56.517 01:47:44 -- common/autotest_common.sh@955 -- # kill 3387823 00:11:56.517 01:47:44 -- common/autotest_common.sh@960 -- # wait 3387823 00:11:56.776 01:47:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:56.776 01:47:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:56.776 01:47:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:56.776 01:47:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:56.776 01:47:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:56.776 01:47:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.776 01:47:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.776 01:47:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:59.313 01:47:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:59.313 00:11:59.313 real 0m6.609s 00:11:59.313 user 0m9.492s 00:11:59.313 sys 0m1.997s 00:11:59.313 01:47:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:59.313 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:11:59.313 ************************************ 00:11:59.313 END TEST nvmf_multitarget 00:11:59.313 ************************************ 00:11:59.313 01:47:47 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:59.313 01:47:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:59.313 01:47:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:59.313 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:11:59.313 ************************************ 00:11:59.313 START TEST nvmf_rpc 00:11:59.313 ************************************ 00:11:59.313 01:47:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:59.313 * Looking for test storage... 00:11:59.313 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:59.313 01:47:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:59.313 01:47:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:59.313 01:47:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:59.313 01:47:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:59.313 01:47:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:59.313 01:47:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:59.313 01:47:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:59.313 01:47:47 -- scripts/common.sh@335 -- # IFS=.-: 00:11:59.313 01:47:47 -- scripts/common.sh@335 -- # read -ra ver1 00:11:59.313 01:47:47 -- scripts/common.sh@336 -- # IFS=.-: 00:11:59.313 01:47:47 -- scripts/common.sh@336 -- # read -ra ver2 00:11:59.313 01:47:47 -- scripts/common.sh@337 -- # local 'op=<' 00:11:59.313 01:47:47 -- scripts/common.sh@339 -- # ver1_l=2 00:11:59.313 01:47:47 -- scripts/common.sh@340 -- # ver2_l=1 00:11:59.313 01:47:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:59.313 01:47:47 -- scripts/common.sh@343 -- # case "$op" in 00:11:59.313 01:47:47 -- scripts/common.sh@344 -- # : 1 00:11:59.313 01:47:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:59.313 01:47:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:59.313 01:47:47 -- scripts/common.sh@364 -- # decimal 1 00:11:59.313 01:47:47 -- scripts/common.sh@352 -- # local d=1 00:11:59.313 01:47:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:59.313 01:47:47 -- scripts/common.sh@354 -- # echo 1 00:11:59.313 01:47:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:59.313 01:47:47 -- scripts/common.sh@365 -- # decimal 2 00:11:59.313 01:47:47 -- scripts/common.sh@352 -- # local d=2 00:11:59.313 01:47:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:59.313 01:47:47 -- scripts/common.sh@354 -- # echo 2 00:11:59.313 01:47:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:59.313 01:47:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:59.313 01:47:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:59.313 01:47:47 -- scripts/common.sh@367 -- # return 0 00:11:59.313 01:47:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:59.313 01:47:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:59.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.313 --rc genhtml_branch_coverage=1 00:11:59.313 --rc genhtml_function_coverage=1 00:11:59.313 --rc genhtml_legend=1 00:11:59.313 --rc geninfo_all_blocks=1 00:11:59.313 --rc geninfo_unexecuted_blocks=1 00:11:59.313 00:11:59.313 ' 00:11:59.313 01:47:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:59.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.313 --rc genhtml_branch_coverage=1 00:11:59.313 --rc genhtml_function_coverage=1 00:11:59.313 --rc genhtml_legend=1 00:11:59.313 --rc geninfo_all_blocks=1 00:11:59.313 --rc geninfo_unexecuted_blocks=1 00:11:59.313 00:11:59.313 ' 00:11:59.313 01:47:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:59.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.313 --rc genhtml_branch_coverage=1 00:11:59.313 --rc genhtml_function_coverage=1 00:11:59.313 --rc genhtml_legend=1 00:11:59.313 --rc geninfo_all_blocks=1 00:11:59.313 --rc geninfo_unexecuted_blocks=1 00:11:59.313 00:11:59.313 ' 00:11:59.313 01:47:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:59.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:59.313 --rc genhtml_branch_coverage=1 00:11:59.313 --rc genhtml_function_coverage=1 00:11:59.313 --rc genhtml_legend=1 00:11:59.313 --rc geninfo_all_blocks=1 00:11:59.313 --rc geninfo_unexecuted_blocks=1 00:11:59.313 00:11:59.313 ' 00:11:59.313 01:47:47 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:59.313 01:47:47 -- nvmf/common.sh@7 -- # uname -s 00:11:59.313 01:47:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:59.313 01:47:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:59.313 01:47:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:59.313 01:47:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:59.313 01:47:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:59.313 01:47:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:59.313 01:47:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:59.313 01:47:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:59.313 01:47:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:59.313 01:47:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:59.313 01:47:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:59.313 01:47:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:59.313 01:47:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:59.313 01:47:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:59.313 01:47:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:59.314 01:47:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:59.314 01:47:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:59.314 01:47:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:59.314 01:47:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:59.314 01:47:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.314 01:47:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.314 01:47:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.314 01:47:47 -- paths/export.sh@5 -- # export PATH 00:11:59.314 01:47:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:59.314 01:47:47 -- nvmf/common.sh@46 -- # : 0 00:11:59.314 01:47:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:59.314 01:47:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:59.314 01:47:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:59.314 01:47:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:59.314 01:47:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:59.314 01:47:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:59.314 01:47:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:59.314 01:47:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:59.314 01:47:47 -- target/rpc.sh@11 -- # loops=5 00:11:59.314 01:47:47 -- target/rpc.sh@23 -- # nvmftestinit 00:11:59.314 01:47:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:59.314 01:47:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:59.314 01:47:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:59.314 01:47:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:59.314 01:47:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:59.314 01:47:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:59.314 01:47:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:59.314 01:47:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:59.314 01:47:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:59.314 01:47:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:59.314 01:47:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:59.314 01:47:47 -- common/autotest_common.sh@10 -- # set +x 00:12:01.215 01:47:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:01.215 01:47:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:01.215 01:47:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:01.215 01:47:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:01.215 01:47:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:01.215 01:47:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:01.215 01:47:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:01.215 01:47:49 -- nvmf/common.sh@294 -- # net_devs=() 00:12:01.215 01:47:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:01.215 01:47:49 -- nvmf/common.sh@295 -- # e810=() 00:12:01.215 01:47:49 -- nvmf/common.sh@295 -- # local -ga e810 00:12:01.215 01:47:49 -- nvmf/common.sh@296 -- # x722=() 00:12:01.215 01:47:49 -- nvmf/common.sh@296 -- # local -ga x722 00:12:01.215 01:47:49 -- nvmf/common.sh@297 -- # mlx=() 00:12:01.215 01:47:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:01.215 01:47:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:01.215 01:47:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:01.215 01:47:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:01.215 01:47:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:01.215 01:47:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:01.215 01:47:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:01.215 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:01.215 01:47:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:01.215 01:47:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:01.215 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:01.215 01:47:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:01.215 01:47:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:01.216 01:47:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:01.216 01:47:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:01.216 01:47:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:01.216 01:47:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:01.216 01:47:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:01.216 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:01.216 01:47:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:01.216 01:47:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:01.216 01:47:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:01.216 01:47:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:01.216 01:47:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:01.216 01:47:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:01.216 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:01.216 01:47:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:01.216 01:47:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:01.216 01:47:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:01.216 01:47:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:01.216 01:47:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:01.216 01:47:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:01.216 01:47:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:01.216 01:47:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:01.216 01:47:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:01.216 01:47:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:01.216 01:47:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:01.216 01:47:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:01.216 01:47:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:01.216 01:47:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:01.216 01:47:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:01.216 01:47:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:01.216 01:47:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:01.216 01:47:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:01.216 01:47:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:01.216 01:47:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:01.216 01:47:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:01.216 01:47:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:01.216 01:47:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:01.216 01:47:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:01.216 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:01.216 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.375 ms 00:12:01.216 00:12:01.216 --- 10.0.0.2 ping statistics --- 00:12:01.216 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:01.216 rtt min/avg/max/mdev = 0.375/0.375/0.375/0.000 ms 00:12:01.216 01:47:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:01.216 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:01.216 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:12:01.216 00:12:01.216 --- 10.0.0.1 ping statistics --- 00:12:01.216 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:01.216 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:12:01.216 01:47:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:01.216 01:47:49 -- nvmf/common.sh@410 -- # return 0 00:12:01.216 01:47:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:01.216 01:47:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:01.216 01:47:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:01.216 01:47:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:01.216 01:47:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:01.216 01:47:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:01.216 01:47:49 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:01.216 01:47:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:01.216 01:47:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:01.216 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:12:01.216 01:47:49 -- nvmf/common.sh@469 -- # nvmfpid=3390070 00:12:01.216 01:47:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:01.216 01:47:49 -- nvmf/common.sh@470 -- # waitforlisten 3390070 00:12:01.216 01:47:49 -- common/autotest_common.sh@829 -- # '[' -z 3390070 ']' 00:12:01.216 01:47:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:01.216 01:47:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:01.216 01:47:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:01.216 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:01.216 01:47:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:01.216 01:47:49 -- common/autotest_common.sh@10 -- # set +x 00:12:01.474 [2024-11-19 01:47:49.799013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:01.474 [2024-11-19 01:47:49.799100] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:01.474 EAL: No free 2048 kB hugepages reported on node 1 00:12:01.474 [2024-11-19 01:47:49.875101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:01.474 [2024-11-19 01:47:49.995998] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:01.474 [2024-11-19 01:47:49.996153] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:01.474 [2024-11-19 01:47:49.996172] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:01.474 [2024-11-19 01:47:49.996187] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:01.474 [2024-11-19 01:47:49.996244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:01.474 [2024-11-19 01:47:49.996271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:01.474 [2024-11-19 01:47:49.996323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:01.474 [2024-11-19 01:47:49.996326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:02.411 01:47:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:02.411 01:47:50 -- common/autotest_common.sh@862 -- # return 0 00:12:02.411 01:47:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:02.411 01:47:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:02.411 01:47:50 -- common/autotest_common.sh@10 -- # set +x 00:12:02.411 01:47:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:02.411 01:47:50 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:02.411 01:47:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.411 01:47:50 -- common/autotest_common.sh@10 -- # set +x 00:12:02.411 01:47:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.411 01:47:50 -- target/rpc.sh@26 -- # stats='{ 00:12:02.411 "tick_rate": 2700000000, 00:12:02.411 "poll_groups": [ 00:12:02.411 { 00:12:02.411 "name": "nvmf_tgt_poll_group_0", 00:12:02.411 "admin_qpairs": 0, 00:12:02.411 "io_qpairs": 0, 00:12:02.411 "current_admin_qpairs": 0, 00:12:02.411 "current_io_qpairs": 0, 00:12:02.411 "pending_bdev_io": 0, 00:12:02.411 "completed_nvme_io": 0, 00:12:02.411 "transports": [] 00:12:02.411 }, 00:12:02.411 { 00:12:02.411 "name": "nvmf_tgt_poll_group_1", 00:12:02.411 "admin_qpairs": 0, 00:12:02.411 "io_qpairs": 0, 00:12:02.411 "current_admin_qpairs": 0, 00:12:02.411 "current_io_qpairs": 0, 00:12:02.411 "pending_bdev_io": 0, 00:12:02.411 "completed_nvme_io": 0, 00:12:02.411 "transports": [] 00:12:02.411 }, 00:12:02.411 { 00:12:02.411 "name": "nvmf_tgt_poll_group_2", 00:12:02.411 "admin_qpairs": 0, 00:12:02.411 "io_qpairs": 0, 00:12:02.411 "current_admin_qpairs": 0, 00:12:02.411 "current_io_qpairs": 0, 00:12:02.411 "pending_bdev_io": 0, 00:12:02.411 "completed_nvme_io": 0, 00:12:02.411 "transports": [] 00:12:02.411 }, 00:12:02.411 { 00:12:02.411 "name": "nvmf_tgt_poll_group_3", 00:12:02.411 "admin_qpairs": 0, 00:12:02.411 "io_qpairs": 0, 00:12:02.411 "current_admin_qpairs": 0, 00:12:02.411 "current_io_qpairs": 0, 00:12:02.411 "pending_bdev_io": 0, 00:12:02.411 "completed_nvme_io": 0, 00:12:02.411 "transports": [] 00:12:02.411 } 00:12:02.411 ] 00:12:02.411 }' 00:12:02.411 01:47:50 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:02.411 01:47:50 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:02.411 01:47:50 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:02.411 01:47:50 -- target/rpc.sh@15 -- # wc -l 00:12:02.411 01:47:50 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:02.411 01:47:50 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:02.411 01:47:50 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:02.411 01:47:50 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:02.411 01:47:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.411 01:47:50 -- common/autotest_common.sh@10 -- # set +x 00:12:02.411 [2024-11-19 01:47:50.955767] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:02.670 01:47:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:50 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:02.670 01:47:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.670 01:47:50 -- common/autotest_common.sh@10 -- # set +x 00:12:02.670 01:47:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:50 -- target/rpc.sh@33 -- # stats='{ 00:12:02.670 "tick_rate": 2700000000, 00:12:02.670 "poll_groups": [ 00:12:02.670 { 00:12:02.670 "name": "nvmf_tgt_poll_group_0", 00:12:02.670 "admin_qpairs": 0, 00:12:02.670 "io_qpairs": 0, 00:12:02.670 "current_admin_qpairs": 0, 00:12:02.670 "current_io_qpairs": 0, 00:12:02.670 "pending_bdev_io": 0, 00:12:02.670 "completed_nvme_io": 0, 00:12:02.670 "transports": [ 00:12:02.670 { 00:12:02.670 "trtype": "TCP" 00:12:02.670 } 00:12:02.670 ] 00:12:02.670 }, 00:12:02.670 { 00:12:02.670 "name": "nvmf_tgt_poll_group_1", 00:12:02.670 "admin_qpairs": 0, 00:12:02.670 "io_qpairs": 0, 00:12:02.670 "current_admin_qpairs": 0, 00:12:02.670 "current_io_qpairs": 0, 00:12:02.670 "pending_bdev_io": 0, 00:12:02.670 "completed_nvme_io": 0, 00:12:02.670 "transports": [ 00:12:02.670 { 00:12:02.670 "trtype": "TCP" 00:12:02.670 } 00:12:02.670 ] 00:12:02.670 }, 00:12:02.670 { 00:12:02.670 "name": "nvmf_tgt_poll_group_2", 00:12:02.670 "admin_qpairs": 0, 00:12:02.670 "io_qpairs": 0, 00:12:02.670 "current_admin_qpairs": 0, 00:12:02.670 "current_io_qpairs": 0, 00:12:02.670 "pending_bdev_io": 0, 00:12:02.670 "completed_nvme_io": 0, 00:12:02.670 "transports": [ 00:12:02.670 { 00:12:02.670 "trtype": "TCP" 00:12:02.670 } 00:12:02.670 ] 00:12:02.670 }, 00:12:02.670 { 00:12:02.670 "name": "nvmf_tgt_poll_group_3", 00:12:02.670 "admin_qpairs": 0, 00:12:02.670 "io_qpairs": 0, 00:12:02.670 "current_admin_qpairs": 0, 00:12:02.670 "current_io_qpairs": 0, 00:12:02.670 "pending_bdev_io": 0, 00:12:02.670 "completed_nvme_io": 0, 00:12:02.670 "transports": [ 00:12:02.670 { 00:12:02.670 "trtype": "TCP" 00:12:02.670 } 00:12:02.670 ] 00:12:02.670 } 00:12:02.670 ] 00:12:02.670 }' 00:12:02.670 01:47:50 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:02.670 01:47:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:02.670 01:47:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:02.670 01:47:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:02.670 01:47:51 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:02.670 01:47:51 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:02.670 01:47:51 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:02.670 01:47:51 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:02.670 01:47:51 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:02.670 01:47:51 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:02.670 01:47:51 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:02.670 01:47:51 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:02.670 01:47:51 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:02.670 01:47:51 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:02.670 01:47:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.670 01:47:51 -- common/autotest_common.sh@10 -- # set +x 00:12:02.670 Malloc1 00:12:02.670 01:47:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:51 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:02.670 01:47:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.670 01:47:51 -- common/autotest_common.sh@10 -- # set +x 00:12:02.670 01:47:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:51 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:02.670 01:47:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.670 01:47:51 -- common/autotest_common.sh@10 -- # set +x 00:12:02.670 01:47:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:51 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:02.670 01:47:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.670 01:47:51 -- common/autotest_common.sh@10 -- # set +x 00:12:02.670 01:47:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:51 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.670 01:47:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.670 01:47:51 -- common/autotest_common.sh@10 -- # set +x 00:12:02.670 [2024-11-19 01:47:51.109299] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.670 01:47:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:51 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:02.670 01:47:51 -- common/autotest_common.sh@650 -- # local es=0 00:12:02.670 01:47:51 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:02.670 01:47:51 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:02.670 01:47:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.670 01:47:51 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:02.670 01:47:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.670 01:47:51 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:02.670 01:47:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.670 01:47:51 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:02.670 01:47:51 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:02.670 01:47:51 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:02.670 [2024-11-19 01:47:51.131820] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:02.670 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:02.670 could not add new controller: failed to write to nvme-fabrics device 00:12:02.670 01:47:51 -- common/autotest_common.sh@653 -- # es=1 00:12:02.670 01:47:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:02.670 01:47:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:02.670 01:47:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:02.670 01:47:51 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:02.670 01:47:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.670 01:47:51 -- common/autotest_common.sh@10 -- # set +x 00:12:02.670 01:47:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.670 01:47:51 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:03.604 01:47:51 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:03.604 01:47:51 -- common/autotest_common.sh@1187 -- # local i=0 00:12:03.604 01:47:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:03.604 01:47:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:03.604 01:47:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:05.503 01:47:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:05.503 01:47:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:05.503 01:47:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:05.503 01:47:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:05.503 01:47:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:05.503 01:47:53 -- common/autotest_common.sh@1197 -- # return 0 00:12:05.503 01:47:53 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:05.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.503 01:47:53 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:05.503 01:47:53 -- common/autotest_common.sh@1208 -- # local i=0 00:12:05.503 01:47:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:05.503 01:47:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.503 01:47:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:05.503 01:47:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.503 01:47:53 -- common/autotest_common.sh@1220 -- # return 0 00:12:05.503 01:47:53 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:05.503 01:47:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.503 01:47:53 -- common/autotest_common.sh@10 -- # set +x 00:12:05.503 01:47:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.503 01:47:53 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.503 01:47:53 -- common/autotest_common.sh@650 -- # local es=0 00:12:05.503 01:47:53 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.503 01:47:53 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:05.503 01:47:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:05.503 01:47:53 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:05.503 01:47:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:05.503 01:47:53 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:05.503 01:47:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:05.503 01:47:53 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:05.503 01:47:53 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:05.503 01:47:53 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.503 [2024-11-19 01:47:53.966687] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:05.503 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:05.503 could not add new controller: failed to write to nvme-fabrics device 00:12:05.503 01:47:53 -- common/autotest_common.sh@653 -- # es=1 00:12:05.503 01:47:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:05.503 01:47:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:05.504 01:47:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:05.504 01:47:53 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:05.504 01:47:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.504 01:47:53 -- common/autotest_common.sh@10 -- # set +x 00:12:05.504 01:47:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.504 01:47:54 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:06.069 01:47:54 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:06.069 01:47:54 -- common/autotest_common.sh@1187 -- # local i=0 00:12:06.069 01:47:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:06.069 01:47:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:06.069 01:47:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:08.654 01:47:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:08.654 01:47:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:08.654 01:47:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:08.654 01:47:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:08.654 01:47:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:08.654 01:47:56 -- common/autotest_common.sh@1197 -- # return 0 00:12:08.654 01:47:56 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:08.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.654 01:47:56 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:08.654 01:47:56 -- common/autotest_common.sh@1208 -- # local i=0 00:12:08.654 01:47:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:08.654 01:47:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.654 01:47:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:08.654 01:47:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.654 01:47:56 -- common/autotest_common.sh@1220 -- # return 0 00:12:08.654 01:47:56 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.654 01:47:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.654 01:47:56 -- common/autotest_common.sh@10 -- # set +x 00:12:08.654 01:47:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.654 01:47:56 -- target/rpc.sh@81 -- # seq 1 5 00:12:08.654 01:47:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:08.654 01:47:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.654 01:47:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.654 01:47:56 -- common/autotest_common.sh@10 -- # set +x 00:12:08.654 01:47:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.654 01:47:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.654 01:47:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.654 01:47:56 -- common/autotest_common.sh@10 -- # set +x 00:12:08.654 [2024-11-19 01:47:56.750001] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.654 01:47:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.654 01:47:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:08.654 01:47:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.654 01:47:56 -- common/autotest_common.sh@10 -- # set +x 00:12:08.654 01:47:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.654 01:47:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.654 01:47:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.654 01:47:56 -- common/autotest_common.sh@10 -- # set +x 00:12:08.654 01:47:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.654 01:47:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:08.912 01:47:57 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:08.912 01:47:57 -- common/autotest_common.sh@1187 -- # local i=0 00:12:08.912 01:47:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:08.912 01:47:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:08.912 01:47:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:11.436 01:47:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:11.436 01:47:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:11.436 01:47:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:11.436 01:47:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:11.436 01:47:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:11.436 01:47:59 -- common/autotest_common.sh@1197 -- # return 0 00:12:11.436 01:47:59 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:11.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.436 01:47:59 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:11.436 01:47:59 -- common/autotest_common.sh@1208 -- # local i=0 00:12:11.436 01:47:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:11.436 01:47:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:11.436 01:47:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:11.436 01:47:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:11.436 01:47:59 -- common/autotest_common.sh@1220 -- # return 0 00:12:11.436 01:47:59 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:11.436 01:47:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.436 01:47:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.436 01:47:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.436 01:47:59 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:11.436 01:47:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.436 01:47:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.436 01:47:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.436 01:47:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:11.436 01:47:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:11.436 01:47:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.436 01:47:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.436 01:47:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.436 01:47:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:11.436 01:47:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.436 01:47:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.436 [2024-11-19 01:47:59.490579] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:11.436 01:47:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.436 01:47:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:11.436 01:47:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.436 01:47:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.436 01:47:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.436 01:47:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:11.436 01:47:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:11.436 01:47:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.436 01:47:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:11.436 01:47:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:11.694 01:48:00 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:11.694 01:48:00 -- common/autotest_common.sh@1187 -- # local i=0 00:12:11.694 01:48:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:11.694 01:48:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:11.694 01:48:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:14.218 01:48:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:14.218 01:48:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:14.218 01:48:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:14.218 01:48:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:14.218 01:48:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:14.218 01:48:02 -- common/autotest_common.sh@1197 -- # return 0 00:12:14.218 01:48:02 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:14.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.218 01:48:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:14.218 01:48:02 -- common/autotest_common.sh@1208 -- # local i=0 00:12:14.218 01:48:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:14.218 01:48:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.218 01:48:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:14.218 01:48:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.218 01:48:02 -- common/autotest_common.sh@1220 -- # return 0 00:12:14.218 01:48:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:14.218 01:48:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.218 01:48:02 -- common/autotest_common.sh@10 -- # set +x 00:12:14.218 01:48:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.218 01:48:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:14.218 01:48:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.218 01:48:02 -- common/autotest_common.sh@10 -- # set +x 00:12:14.218 01:48:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.218 01:48:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:14.218 01:48:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:14.218 01:48:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.218 01:48:02 -- common/autotest_common.sh@10 -- # set +x 00:12:14.218 01:48:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.218 01:48:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:14.218 01:48:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.218 01:48:02 -- common/autotest_common.sh@10 -- # set +x 00:12:14.218 [2024-11-19 01:48:02.340745] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:14.218 01:48:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.218 01:48:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:14.218 01:48:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.218 01:48:02 -- common/autotest_common.sh@10 -- # set +x 00:12:14.218 01:48:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.218 01:48:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:14.218 01:48:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.218 01:48:02 -- common/autotest_common.sh@10 -- # set +x 00:12:14.218 01:48:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.218 01:48:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:14.476 01:48:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:14.476 01:48:02 -- common/autotest_common.sh@1187 -- # local i=0 00:12:14.476 01:48:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:14.476 01:48:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:14.476 01:48:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:17.003 01:48:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:17.003 01:48:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:17.003 01:48:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:17.003 01:48:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:17.003 01:48:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:17.003 01:48:04 -- common/autotest_common.sh@1197 -- # return 0 00:12:17.003 01:48:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:17.003 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:17.003 01:48:05 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:17.003 01:48:05 -- common/autotest_common.sh@1208 -- # local i=0 00:12:17.003 01:48:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:17.003 01:48:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:17.003 01:48:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:17.003 01:48:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:17.003 01:48:05 -- common/autotest_common.sh@1220 -- # return 0 00:12:17.003 01:48:05 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:17.003 01:48:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:17.003 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:12:17.003 01:48:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:17.003 01:48:05 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:17.003 01:48:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:17.003 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:12:17.003 01:48:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:17.003 01:48:05 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:17.003 01:48:05 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:17.003 01:48:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:17.003 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:12:17.003 01:48:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:17.003 01:48:05 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:17.003 01:48:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:17.003 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:12:17.003 [2024-11-19 01:48:05.067082] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:17.003 01:48:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:17.003 01:48:05 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:17.003 01:48:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:17.003 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:12:17.003 01:48:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:17.003 01:48:05 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:17.003 01:48:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:17.004 01:48:05 -- common/autotest_common.sh@10 -- # set +x 00:12:17.004 01:48:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:17.004 01:48:05 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:17.261 01:48:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:17.261 01:48:05 -- common/autotest_common.sh@1187 -- # local i=0 00:12:17.261 01:48:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:17.261 01:48:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:17.261 01:48:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:19.787 01:48:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:19.787 01:48:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:19.787 01:48:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:19.787 01:48:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:19.787 01:48:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:19.787 01:48:07 -- common/autotest_common.sh@1197 -- # return 0 00:12:19.787 01:48:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:19.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.787 01:48:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:19.787 01:48:07 -- common/autotest_common.sh@1208 -- # local i=0 00:12:19.787 01:48:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:19.787 01:48:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.787 01:48:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:19.787 01:48:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.787 01:48:07 -- common/autotest_common.sh@1220 -- # return 0 00:12:19.787 01:48:07 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:19.787 01:48:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.787 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.787 01:48:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.787 01:48:07 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.787 01:48:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.787 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.787 01:48:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.787 01:48:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:19.787 01:48:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.787 01:48:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.787 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.787 01:48:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.787 01:48:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.787 01:48:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.787 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.787 [2024-11-19 01:48:07.911546] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.787 01:48:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.787 01:48:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:19.787 01:48:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.787 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.787 01:48:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.787 01:48:07 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.787 01:48:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.787 01:48:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.787 01:48:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.787 01:48:07 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:20.352 01:48:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:20.353 01:48:08 -- common/autotest_common.sh@1187 -- # local i=0 00:12:20.353 01:48:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:20.353 01:48:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:20.353 01:48:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:22.247 01:48:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:22.247 01:48:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:22.247 01:48:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:22.247 01:48:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:22.247 01:48:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:22.247 01:48:10 -- common/autotest_common.sh@1197 -- # return 0 00:12:22.247 01:48:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:22.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.247 01:48:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:22.247 01:48:10 -- common/autotest_common.sh@1208 -- # local i=0 00:12:22.247 01:48:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:22.247 01:48:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:22.247 01:48:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:22.247 01:48:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:22.247 01:48:10 -- common/autotest_common.sh@1220 -- # return 0 00:12:22.247 01:48:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:22.247 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.247 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.247 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.247 01:48:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.247 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.247 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@99 -- # seq 1 5 00:12:22.248 01:48:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.248 01:48:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 [2024-11-19 01:48:10.738700] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.248 01:48:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.248 [2024-11-19 01:48:10.786773] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.248 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.248 01:48:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.248 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.248 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.506 01:48:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 [2024-11-19 01:48:10.834945] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.506 01:48:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 [2024-11-19 01:48:10.883122] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:22.506 01:48:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 [2024-11-19 01:48:10.931285] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:22.506 01:48:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.506 01:48:10 -- common/autotest_common.sh@10 -- # set +x 00:12:22.506 01:48:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.506 01:48:10 -- target/rpc.sh@110 -- # stats='{ 00:12:22.506 "tick_rate": 2700000000, 00:12:22.506 "poll_groups": [ 00:12:22.506 { 00:12:22.506 "name": "nvmf_tgt_poll_group_0", 00:12:22.506 "admin_qpairs": 2, 00:12:22.506 "io_qpairs": 84, 00:12:22.506 "current_admin_qpairs": 0, 00:12:22.506 "current_io_qpairs": 0, 00:12:22.506 "pending_bdev_io": 0, 00:12:22.506 "completed_nvme_io": 262, 00:12:22.506 "transports": [ 00:12:22.507 { 00:12:22.507 "trtype": "TCP" 00:12:22.507 } 00:12:22.507 ] 00:12:22.507 }, 00:12:22.507 { 00:12:22.507 "name": "nvmf_tgt_poll_group_1", 00:12:22.507 "admin_qpairs": 2, 00:12:22.507 "io_qpairs": 84, 00:12:22.507 "current_admin_qpairs": 0, 00:12:22.507 "current_io_qpairs": 0, 00:12:22.507 "pending_bdev_io": 0, 00:12:22.507 "completed_nvme_io": 136, 00:12:22.507 "transports": [ 00:12:22.507 { 00:12:22.507 "trtype": "TCP" 00:12:22.507 } 00:12:22.507 ] 00:12:22.507 }, 00:12:22.507 { 00:12:22.507 "name": "nvmf_tgt_poll_group_2", 00:12:22.507 "admin_qpairs": 1, 00:12:22.507 "io_qpairs": 84, 00:12:22.507 "current_admin_qpairs": 0, 00:12:22.507 "current_io_qpairs": 0, 00:12:22.507 "pending_bdev_io": 0, 00:12:22.507 "completed_nvme_io": 134, 00:12:22.507 "transports": [ 00:12:22.507 { 00:12:22.507 "trtype": "TCP" 00:12:22.507 } 00:12:22.507 ] 00:12:22.507 }, 00:12:22.507 { 00:12:22.507 "name": "nvmf_tgt_poll_group_3", 00:12:22.507 "admin_qpairs": 2, 00:12:22.507 "io_qpairs": 84, 00:12:22.507 "current_admin_qpairs": 0, 00:12:22.507 "current_io_qpairs": 0, 00:12:22.507 "pending_bdev_io": 0, 00:12:22.507 "completed_nvme_io": 154, 00:12:22.507 "transports": [ 00:12:22.507 { 00:12:22.507 "trtype": "TCP" 00:12:22.507 } 00:12:22.507 ] 00:12:22.507 } 00:12:22.507 ] 00:12:22.507 }' 00:12:22.507 01:48:10 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:22.507 01:48:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:22.507 01:48:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:22.507 01:48:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:22.507 01:48:11 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:22.507 01:48:11 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:22.507 01:48:11 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:22.507 01:48:11 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:22.507 01:48:11 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:22.764 01:48:11 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:22.764 01:48:11 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:22.764 01:48:11 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:22.765 01:48:11 -- target/rpc.sh@123 -- # nvmftestfini 00:12:22.765 01:48:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:22.765 01:48:11 -- nvmf/common.sh@116 -- # sync 00:12:22.765 01:48:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:22.765 01:48:11 -- nvmf/common.sh@119 -- # set +e 00:12:22.765 01:48:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:22.765 01:48:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:22.765 rmmod nvme_tcp 00:12:22.765 rmmod nvme_fabrics 00:12:22.765 rmmod nvme_keyring 00:12:22.765 01:48:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:22.765 01:48:11 -- nvmf/common.sh@123 -- # set -e 00:12:22.765 01:48:11 -- nvmf/common.sh@124 -- # return 0 00:12:22.765 01:48:11 -- nvmf/common.sh@477 -- # '[' -n 3390070 ']' 00:12:22.765 01:48:11 -- nvmf/common.sh@478 -- # killprocess 3390070 00:12:22.765 01:48:11 -- common/autotest_common.sh@936 -- # '[' -z 3390070 ']' 00:12:22.765 01:48:11 -- common/autotest_common.sh@940 -- # kill -0 3390070 00:12:22.765 01:48:11 -- common/autotest_common.sh@941 -- # uname 00:12:22.765 01:48:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:22.765 01:48:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3390070 00:12:22.765 01:48:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:22.765 01:48:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:22.765 01:48:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3390070' 00:12:22.765 killing process with pid 3390070 00:12:22.765 01:48:11 -- common/autotest_common.sh@955 -- # kill 3390070 00:12:22.765 01:48:11 -- common/autotest_common.sh@960 -- # wait 3390070 00:12:23.023 01:48:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:23.024 01:48:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:23.024 01:48:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:23.024 01:48:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:23.024 01:48:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:23.024 01:48:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:23.024 01:48:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:23.024 01:48:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:25.555 01:48:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:25.555 00:12:25.555 real 0m26.222s 00:12:25.555 user 1m25.282s 00:12:25.555 sys 0m4.289s 00:12:25.555 01:48:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:25.555 01:48:13 -- common/autotest_common.sh@10 -- # set +x 00:12:25.555 ************************************ 00:12:25.555 END TEST nvmf_rpc 00:12:25.555 ************************************ 00:12:25.555 01:48:13 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:25.555 01:48:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:25.555 01:48:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:25.555 01:48:13 -- common/autotest_common.sh@10 -- # set +x 00:12:25.555 ************************************ 00:12:25.555 START TEST nvmf_invalid 00:12:25.555 ************************************ 00:12:25.556 01:48:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:25.556 * Looking for test storage... 00:12:25.556 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:25.556 01:48:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:25.556 01:48:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:25.556 01:48:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:25.556 01:48:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:25.556 01:48:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:25.556 01:48:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:25.556 01:48:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:25.556 01:48:13 -- scripts/common.sh@335 -- # IFS=.-: 00:12:25.556 01:48:13 -- scripts/common.sh@335 -- # read -ra ver1 00:12:25.556 01:48:13 -- scripts/common.sh@336 -- # IFS=.-: 00:12:25.556 01:48:13 -- scripts/common.sh@336 -- # read -ra ver2 00:12:25.556 01:48:13 -- scripts/common.sh@337 -- # local 'op=<' 00:12:25.556 01:48:13 -- scripts/common.sh@339 -- # ver1_l=2 00:12:25.556 01:48:13 -- scripts/common.sh@340 -- # ver2_l=1 00:12:25.556 01:48:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:25.556 01:48:13 -- scripts/common.sh@343 -- # case "$op" in 00:12:25.556 01:48:13 -- scripts/common.sh@344 -- # : 1 00:12:25.556 01:48:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:25.556 01:48:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:25.556 01:48:13 -- scripts/common.sh@364 -- # decimal 1 00:12:25.556 01:48:13 -- scripts/common.sh@352 -- # local d=1 00:12:25.556 01:48:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:25.556 01:48:13 -- scripts/common.sh@354 -- # echo 1 00:12:25.556 01:48:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:25.556 01:48:13 -- scripts/common.sh@365 -- # decimal 2 00:12:25.556 01:48:13 -- scripts/common.sh@352 -- # local d=2 00:12:25.556 01:48:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:25.556 01:48:13 -- scripts/common.sh@354 -- # echo 2 00:12:25.556 01:48:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:25.556 01:48:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:25.556 01:48:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:25.556 01:48:13 -- scripts/common.sh@367 -- # return 0 00:12:25.556 01:48:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:25.556 01:48:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:25.556 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.556 --rc genhtml_branch_coverage=1 00:12:25.556 --rc genhtml_function_coverage=1 00:12:25.556 --rc genhtml_legend=1 00:12:25.556 --rc geninfo_all_blocks=1 00:12:25.556 --rc geninfo_unexecuted_blocks=1 00:12:25.556 00:12:25.556 ' 00:12:25.556 01:48:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:25.556 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.556 --rc genhtml_branch_coverage=1 00:12:25.556 --rc genhtml_function_coverage=1 00:12:25.556 --rc genhtml_legend=1 00:12:25.556 --rc geninfo_all_blocks=1 00:12:25.556 --rc geninfo_unexecuted_blocks=1 00:12:25.556 00:12:25.556 ' 00:12:25.556 01:48:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:25.556 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.556 --rc genhtml_branch_coverage=1 00:12:25.556 --rc genhtml_function_coverage=1 00:12:25.556 --rc genhtml_legend=1 00:12:25.556 --rc geninfo_all_blocks=1 00:12:25.556 --rc geninfo_unexecuted_blocks=1 00:12:25.556 00:12:25.556 ' 00:12:25.556 01:48:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:25.556 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.556 --rc genhtml_branch_coverage=1 00:12:25.556 --rc genhtml_function_coverage=1 00:12:25.556 --rc genhtml_legend=1 00:12:25.556 --rc geninfo_all_blocks=1 00:12:25.556 --rc geninfo_unexecuted_blocks=1 00:12:25.556 00:12:25.556 ' 00:12:25.556 01:48:13 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:25.556 01:48:13 -- nvmf/common.sh@7 -- # uname -s 00:12:25.556 01:48:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:25.556 01:48:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:25.556 01:48:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:25.556 01:48:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:25.556 01:48:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:25.556 01:48:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:25.556 01:48:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:25.556 01:48:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:25.556 01:48:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:25.556 01:48:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:25.556 01:48:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:25.556 01:48:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:25.556 01:48:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:25.556 01:48:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:25.556 01:48:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:25.556 01:48:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:25.556 01:48:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:25.556 01:48:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:25.556 01:48:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:25.556 01:48:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.556 01:48:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.556 01:48:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.556 01:48:13 -- paths/export.sh@5 -- # export PATH 00:12:25.556 01:48:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.556 01:48:13 -- nvmf/common.sh@46 -- # : 0 00:12:25.556 01:48:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:25.556 01:48:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:25.556 01:48:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:25.556 01:48:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:25.556 01:48:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:25.556 01:48:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:25.556 01:48:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:25.556 01:48:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:25.556 01:48:13 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:25.556 01:48:13 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:25.556 01:48:13 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:25.556 01:48:13 -- target/invalid.sh@14 -- # target=foobar 00:12:25.556 01:48:13 -- target/invalid.sh@16 -- # RANDOM=0 00:12:25.556 01:48:13 -- target/invalid.sh@34 -- # nvmftestinit 00:12:25.556 01:48:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:25.556 01:48:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:25.556 01:48:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:25.556 01:48:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:25.556 01:48:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:25.556 01:48:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:25.556 01:48:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:25.556 01:48:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:25.556 01:48:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:25.556 01:48:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:25.556 01:48:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:25.556 01:48:13 -- common/autotest_common.sh@10 -- # set +x 00:12:27.460 01:48:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:27.460 01:48:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:27.460 01:48:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:27.460 01:48:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:27.460 01:48:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:27.460 01:48:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:27.460 01:48:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:27.460 01:48:15 -- nvmf/common.sh@294 -- # net_devs=() 00:12:27.460 01:48:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:27.460 01:48:15 -- nvmf/common.sh@295 -- # e810=() 00:12:27.460 01:48:15 -- nvmf/common.sh@295 -- # local -ga e810 00:12:27.460 01:48:15 -- nvmf/common.sh@296 -- # x722=() 00:12:27.460 01:48:15 -- nvmf/common.sh@296 -- # local -ga x722 00:12:27.460 01:48:15 -- nvmf/common.sh@297 -- # mlx=() 00:12:27.460 01:48:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:27.460 01:48:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:27.460 01:48:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:27.460 01:48:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:27.460 01:48:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:27.460 01:48:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:27.460 01:48:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:27.460 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:27.460 01:48:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:27.460 01:48:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:27.460 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:27.460 01:48:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:27.460 01:48:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:27.460 01:48:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:27.460 01:48:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:27.460 01:48:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:27.460 01:48:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:27.460 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:27.460 01:48:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:27.460 01:48:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:27.460 01:48:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:27.460 01:48:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:27.460 01:48:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:27.460 01:48:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:27.460 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:27.460 01:48:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:27.460 01:48:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:27.460 01:48:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:27.460 01:48:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:27.460 01:48:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:27.460 01:48:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:27.460 01:48:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:27.460 01:48:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:27.460 01:48:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:27.460 01:48:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:27.460 01:48:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:27.460 01:48:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:27.460 01:48:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:27.460 01:48:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:27.460 01:48:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:27.460 01:48:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:27.460 01:48:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:27.460 01:48:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:27.460 01:48:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:27.460 01:48:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:27.460 01:48:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:27.460 01:48:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:27.719 01:48:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:27.719 01:48:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:27.719 01:48:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:27.719 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:27.719 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:12:27.719 00:12:27.719 --- 10.0.0.2 ping statistics --- 00:12:27.719 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:27.719 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:12:27.719 01:48:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:27.719 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:27.719 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:12:27.719 00:12:27.719 --- 10.0.0.1 ping statistics --- 00:12:27.719 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:27.719 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:12:27.719 01:48:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:27.719 01:48:16 -- nvmf/common.sh@410 -- # return 0 00:12:27.719 01:48:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:27.719 01:48:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:27.719 01:48:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:27.719 01:48:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:27.719 01:48:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:27.719 01:48:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:27.719 01:48:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:27.719 01:48:16 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:27.719 01:48:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:27.719 01:48:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:27.719 01:48:16 -- common/autotest_common.sh@10 -- # set +x 00:12:27.719 01:48:16 -- nvmf/common.sh@469 -- # nvmfpid=3395412 00:12:27.719 01:48:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:27.719 01:48:16 -- nvmf/common.sh@470 -- # waitforlisten 3395412 00:12:27.719 01:48:16 -- common/autotest_common.sh@829 -- # '[' -z 3395412 ']' 00:12:27.719 01:48:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:27.719 01:48:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:27.719 01:48:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:27.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:27.719 01:48:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:27.719 01:48:16 -- common/autotest_common.sh@10 -- # set +x 00:12:27.719 [2024-11-19 01:48:16.097719] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:27.719 [2024-11-19 01:48:16.097790] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:27.719 EAL: No free 2048 kB hugepages reported on node 1 00:12:27.719 [2024-11-19 01:48:16.167808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:27.977 [2024-11-19 01:48:16.288952] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:27.977 [2024-11-19 01:48:16.289106] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:27.977 [2024-11-19 01:48:16.289126] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:27.977 [2024-11-19 01:48:16.289140] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:27.977 [2024-11-19 01:48:16.289197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:27.977 [2024-11-19 01:48:16.289254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:27.977 [2024-11-19 01:48:16.289308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:27.977 [2024-11-19 01:48:16.289311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:28.910 01:48:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:28.910 01:48:17 -- common/autotest_common.sh@862 -- # return 0 00:12:28.910 01:48:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:28.910 01:48:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:28.910 01:48:17 -- common/autotest_common.sh@10 -- # set +x 00:12:28.910 01:48:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:28.910 01:48:17 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:28.910 01:48:17 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode5635 00:12:28.910 [2024-11-19 01:48:17.422188] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:28.910 01:48:17 -- target/invalid.sh@40 -- # out='request: 00:12:28.910 { 00:12:28.910 "nqn": "nqn.2016-06.io.spdk:cnode5635", 00:12:28.910 "tgt_name": "foobar", 00:12:28.910 "method": "nvmf_create_subsystem", 00:12:28.910 "req_id": 1 00:12:28.910 } 00:12:28.910 Got JSON-RPC error response 00:12:28.910 response: 00:12:28.910 { 00:12:28.910 "code": -32603, 00:12:28.910 "message": "Unable to find target foobar" 00:12:28.910 }' 00:12:28.910 01:48:17 -- target/invalid.sh@41 -- # [[ request: 00:12:28.910 { 00:12:28.910 "nqn": "nqn.2016-06.io.spdk:cnode5635", 00:12:28.910 "tgt_name": "foobar", 00:12:28.910 "method": "nvmf_create_subsystem", 00:12:28.910 "req_id": 1 00:12:28.910 } 00:12:28.910 Got JSON-RPC error response 00:12:28.910 response: 00:12:28.910 { 00:12:28.910 "code": -32603, 00:12:28.910 "message": "Unable to find target foobar" 00:12:28.910 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:28.910 01:48:17 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:28.910 01:48:17 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode10175 00:12:29.168 [2024-11-19 01:48:17.671035] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10175: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:29.168 01:48:17 -- target/invalid.sh@45 -- # out='request: 00:12:29.168 { 00:12:29.168 "nqn": "nqn.2016-06.io.spdk:cnode10175", 00:12:29.168 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:29.168 "method": "nvmf_create_subsystem", 00:12:29.168 "req_id": 1 00:12:29.168 } 00:12:29.168 Got JSON-RPC error response 00:12:29.168 response: 00:12:29.168 { 00:12:29.168 "code": -32602, 00:12:29.168 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:29.168 }' 00:12:29.168 01:48:17 -- target/invalid.sh@46 -- # [[ request: 00:12:29.168 { 00:12:29.168 "nqn": "nqn.2016-06.io.spdk:cnode10175", 00:12:29.168 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:29.168 "method": "nvmf_create_subsystem", 00:12:29.168 "req_id": 1 00:12:29.168 } 00:12:29.168 Got JSON-RPC error response 00:12:29.168 response: 00:12:29.168 { 00:12:29.168 "code": -32602, 00:12:29.168 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:29.168 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:29.168 01:48:17 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:29.169 01:48:17 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode7289 00:12:29.426 [2024-11-19 01:48:17.915796] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7289: invalid model number 'SPDK_Controller' 00:12:29.426 01:48:17 -- target/invalid.sh@50 -- # out='request: 00:12:29.426 { 00:12:29.426 "nqn": "nqn.2016-06.io.spdk:cnode7289", 00:12:29.426 "model_number": "SPDK_Controller\u001f", 00:12:29.426 "method": "nvmf_create_subsystem", 00:12:29.426 "req_id": 1 00:12:29.426 } 00:12:29.427 Got JSON-RPC error response 00:12:29.427 response: 00:12:29.427 { 00:12:29.427 "code": -32602, 00:12:29.427 "message": "Invalid MN SPDK_Controller\u001f" 00:12:29.427 }' 00:12:29.427 01:48:17 -- target/invalid.sh@51 -- # [[ request: 00:12:29.427 { 00:12:29.427 "nqn": "nqn.2016-06.io.spdk:cnode7289", 00:12:29.427 "model_number": "SPDK_Controller\u001f", 00:12:29.427 "method": "nvmf_create_subsystem", 00:12:29.427 "req_id": 1 00:12:29.427 } 00:12:29.427 Got JSON-RPC error response 00:12:29.427 response: 00:12:29.427 { 00:12:29.427 "code": -32602, 00:12:29.427 "message": "Invalid MN SPDK_Controller\u001f" 00:12:29.427 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:29.427 01:48:17 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:29.427 01:48:17 -- target/invalid.sh@19 -- # local length=21 ll 00:12:29.427 01:48:17 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:29.427 01:48:17 -- target/invalid.sh@21 -- # local chars 00:12:29.427 01:48:17 -- target/invalid.sh@22 -- # local string 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 47 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=/ 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 48 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=0 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 126 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+='~' 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 68 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=D 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 81 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=Q 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 49 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=1 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 106 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=j 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 55 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=7 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 73 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # string+=I 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.427 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # printf %x 62 00:12:29.427 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+='>' 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 84 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=T 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 59 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=';' 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 52 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=4 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 46 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=. 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 37 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=% 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 109 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=m 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 92 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+='\' 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 68 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=D 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # printf %x 111 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:29.685 01:48:17 -- target/invalid.sh@25 -- # string+=o 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:18 -- target/invalid.sh@25 -- # printf %x 122 00:12:29.685 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:29.685 01:48:18 -- target/invalid.sh@25 -- # string+=z 00:12:29.685 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:18 -- target/invalid.sh@25 -- # printf %x 38 00:12:29.685 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:29.685 01:48:18 -- target/invalid.sh@25 -- # string+='&' 00:12:29.685 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.685 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.685 01:48:18 -- target/invalid.sh@28 -- # [[ / == \- ]] 00:12:29.685 01:48:18 -- target/invalid.sh@31 -- # echo '/0~DQ1j7I>T;4.%m\Doz&' 00:12:29.685 01:48:18 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '/0~DQ1j7I>T;4.%m\Doz&' nqn.2016-06.io.spdk:cnode32522 00:12:29.944 [2024-11-19 01:48:18.232850] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32522: invalid serial number '/0~DQ1j7I>T;4.%m\Doz&' 00:12:29.944 01:48:18 -- target/invalid.sh@54 -- # out='request: 00:12:29.944 { 00:12:29.944 "nqn": "nqn.2016-06.io.spdk:cnode32522", 00:12:29.944 "serial_number": "/0~DQ1j7I>T;4.%m\\Doz&", 00:12:29.944 "method": "nvmf_create_subsystem", 00:12:29.944 "req_id": 1 00:12:29.944 } 00:12:29.944 Got JSON-RPC error response 00:12:29.944 response: 00:12:29.944 { 00:12:29.944 "code": -32602, 00:12:29.944 "message": "Invalid SN /0~DQ1j7I>T;4.%m\\Doz&" 00:12:29.944 }' 00:12:29.944 01:48:18 -- target/invalid.sh@55 -- # [[ request: 00:12:29.944 { 00:12:29.944 "nqn": "nqn.2016-06.io.spdk:cnode32522", 00:12:29.944 "serial_number": "/0~DQ1j7I>T;4.%m\\Doz&", 00:12:29.944 "method": "nvmf_create_subsystem", 00:12:29.944 "req_id": 1 00:12:29.944 } 00:12:29.944 Got JSON-RPC error response 00:12:29.944 response: 00:12:29.944 { 00:12:29.944 "code": -32602, 00:12:29.944 "message": "Invalid SN /0~DQ1j7I>T;4.%m\\Doz&" 00:12:29.944 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:29.944 01:48:18 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:29.944 01:48:18 -- target/invalid.sh@19 -- # local length=41 ll 00:12:29.944 01:48:18 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:29.944 01:48:18 -- target/invalid.sh@21 -- # local chars 00:12:29.944 01:48:18 -- target/invalid.sh@22 -- # local string 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 97 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=a 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 81 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=Q 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 69 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=E 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 54 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=6 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 53 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=5 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 77 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=M 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 105 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=i 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 106 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=j 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 45 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=- 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 121 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=y 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 126 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+='~' 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 123 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+='{' 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 56 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=8 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 54 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=6 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 115 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=s 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 89 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=Y 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 70 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=F 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 116 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=t 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 34 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+='"' 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 88 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=X 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 81 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=Q 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 105 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=i 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 75 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=K 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 96 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+='`' 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 33 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+='!' 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # printf %x 108 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:29.944 01:48:18 -- target/invalid.sh@25 -- # string+=l 00:12:29.944 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 122 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=z 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 93 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=']' 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 112 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=p 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 33 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+='!' 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 86 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=V 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 99 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x63' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=c 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 100 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=d 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 32 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=' ' 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 83 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=S 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 79 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=O 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 115 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=s 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 77 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=M 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 96 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+='`' 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 84 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=T 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # printf %x 55 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:29.945 01:48:18 -- target/invalid.sh@25 -- # string+=7 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.945 01:48:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.945 01:48:18 -- target/invalid.sh@28 -- # [[ a == \- ]] 00:12:29.945 01:48:18 -- target/invalid.sh@31 -- # echo 'aQE65Mij-y~{86sYFt"XQiK`!lz]p!Vcd SOsM`T7' 00:12:29.945 01:48:18 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'aQE65Mij-y~{86sYFt"XQiK`!lz]p!Vcd SOsM`T7' nqn.2016-06.io.spdk:cnode28006 00:12:30.203 [2024-11-19 01:48:18.622163] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28006: invalid model number 'aQE65Mij-y~{86sYFt"XQiK`!lz]p!Vcd SOsM`T7' 00:12:30.203 01:48:18 -- target/invalid.sh@58 -- # out='request: 00:12:30.203 { 00:12:30.203 "nqn": "nqn.2016-06.io.spdk:cnode28006", 00:12:30.203 "model_number": "aQE65Mij-y~{86sYFt\"XQiK`!lz]p!Vcd SOsM`T7", 00:12:30.203 "method": "nvmf_create_subsystem", 00:12:30.203 "req_id": 1 00:12:30.203 } 00:12:30.203 Got JSON-RPC error response 00:12:30.203 response: 00:12:30.203 { 00:12:30.203 "code": -32602, 00:12:30.203 "message": "Invalid MN aQE65Mij-y~{86sYFt\"XQiK`!lz]p!Vcd SOsM`T7" 00:12:30.203 }' 00:12:30.203 01:48:18 -- target/invalid.sh@59 -- # [[ request: 00:12:30.203 { 00:12:30.203 "nqn": "nqn.2016-06.io.spdk:cnode28006", 00:12:30.203 "model_number": "aQE65Mij-y~{86sYFt\"XQiK`!lz]p!Vcd SOsM`T7", 00:12:30.203 "method": "nvmf_create_subsystem", 00:12:30.203 "req_id": 1 00:12:30.203 } 00:12:30.203 Got JSON-RPC error response 00:12:30.203 response: 00:12:30.203 { 00:12:30.203 "code": -32602, 00:12:30.203 "message": "Invalid MN aQE65Mij-y~{86sYFt\"XQiK`!lz]p!Vcd SOsM`T7" 00:12:30.203 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:30.203 01:48:18 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:30.460 [2024-11-19 01:48:18.879077] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:30.460 01:48:18 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:30.719 01:48:19 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:30.719 01:48:19 -- target/invalid.sh@67 -- # echo '' 00:12:30.719 01:48:19 -- target/invalid.sh@67 -- # head -n 1 00:12:30.719 01:48:19 -- target/invalid.sh@67 -- # IP= 00:12:30.719 01:48:19 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:30.976 [2024-11-19 01:48:19.400817] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:30.976 01:48:19 -- target/invalid.sh@69 -- # out='request: 00:12:30.976 { 00:12:30.976 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.976 "listen_address": { 00:12:30.976 "trtype": "tcp", 00:12:30.976 "traddr": "", 00:12:30.976 "trsvcid": "4421" 00:12:30.976 }, 00:12:30.976 "method": "nvmf_subsystem_remove_listener", 00:12:30.976 "req_id": 1 00:12:30.976 } 00:12:30.976 Got JSON-RPC error response 00:12:30.976 response: 00:12:30.976 { 00:12:30.976 "code": -32602, 00:12:30.976 "message": "Invalid parameters" 00:12:30.976 }' 00:12:30.976 01:48:19 -- target/invalid.sh@70 -- # [[ request: 00:12:30.976 { 00:12:30.976 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.976 "listen_address": { 00:12:30.976 "trtype": "tcp", 00:12:30.976 "traddr": "", 00:12:30.976 "trsvcid": "4421" 00:12:30.976 }, 00:12:30.976 "method": "nvmf_subsystem_remove_listener", 00:12:30.976 "req_id": 1 00:12:30.976 } 00:12:30.976 Got JSON-RPC error response 00:12:30.976 response: 00:12:30.976 { 00:12:30.976 "code": -32602, 00:12:30.976 "message": "Invalid parameters" 00:12:30.976 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:30.976 01:48:19 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27163 -i 0 00:12:31.233 [2024-11-19 01:48:19.661672] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27163: invalid cntlid range [0-65519] 00:12:31.233 01:48:19 -- target/invalid.sh@73 -- # out='request: 00:12:31.233 { 00:12:31.233 "nqn": "nqn.2016-06.io.spdk:cnode27163", 00:12:31.233 "min_cntlid": 0, 00:12:31.233 "method": "nvmf_create_subsystem", 00:12:31.233 "req_id": 1 00:12:31.233 } 00:12:31.233 Got JSON-RPC error response 00:12:31.233 response: 00:12:31.233 { 00:12:31.233 "code": -32602, 00:12:31.233 "message": "Invalid cntlid range [0-65519]" 00:12:31.233 }' 00:12:31.233 01:48:19 -- target/invalid.sh@74 -- # [[ request: 00:12:31.233 { 00:12:31.233 "nqn": "nqn.2016-06.io.spdk:cnode27163", 00:12:31.233 "min_cntlid": 0, 00:12:31.233 "method": "nvmf_create_subsystem", 00:12:31.233 "req_id": 1 00:12:31.233 } 00:12:31.233 Got JSON-RPC error response 00:12:31.233 response: 00:12:31.233 { 00:12:31.233 "code": -32602, 00:12:31.233 "message": "Invalid cntlid range [0-65519]" 00:12:31.233 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.233 01:48:19 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9927 -i 65520 00:12:31.492 [2024-11-19 01:48:19.906474] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9927: invalid cntlid range [65520-65519] 00:12:31.492 01:48:19 -- target/invalid.sh@75 -- # out='request: 00:12:31.492 { 00:12:31.492 "nqn": "nqn.2016-06.io.spdk:cnode9927", 00:12:31.492 "min_cntlid": 65520, 00:12:31.492 "method": "nvmf_create_subsystem", 00:12:31.492 "req_id": 1 00:12:31.492 } 00:12:31.492 Got JSON-RPC error response 00:12:31.492 response: 00:12:31.492 { 00:12:31.492 "code": -32602, 00:12:31.492 "message": "Invalid cntlid range [65520-65519]" 00:12:31.492 }' 00:12:31.492 01:48:19 -- target/invalid.sh@76 -- # [[ request: 00:12:31.492 { 00:12:31.492 "nqn": "nqn.2016-06.io.spdk:cnode9927", 00:12:31.492 "min_cntlid": 65520, 00:12:31.492 "method": "nvmf_create_subsystem", 00:12:31.492 "req_id": 1 00:12:31.492 } 00:12:31.492 Got JSON-RPC error response 00:12:31.492 response: 00:12:31.492 { 00:12:31.492 "code": -32602, 00:12:31.492 "message": "Invalid cntlid range [65520-65519]" 00:12:31.492 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.492 01:48:19 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode19009 -I 0 00:12:31.751 [2024-11-19 01:48:20.175469] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode19009: invalid cntlid range [1-0] 00:12:31.751 01:48:20 -- target/invalid.sh@77 -- # out='request: 00:12:31.751 { 00:12:31.751 "nqn": "nqn.2016-06.io.spdk:cnode19009", 00:12:31.751 "max_cntlid": 0, 00:12:31.751 "method": "nvmf_create_subsystem", 00:12:31.751 "req_id": 1 00:12:31.751 } 00:12:31.751 Got JSON-RPC error response 00:12:31.751 response: 00:12:31.751 { 00:12:31.751 "code": -32602, 00:12:31.751 "message": "Invalid cntlid range [1-0]" 00:12:31.751 }' 00:12:31.751 01:48:20 -- target/invalid.sh@78 -- # [[ request: 00:12:31.751 { 00:12:31.751 "nqn": "nqn.2016-06.io.spdk:cnode19009", 00:12:31.751 "max_cntlid": 0, 00:12:31.751 "method": "nvmf_create_subsystem", 00:12:31.751 "req_id": 1 00:12:31.751 } 00:12:31.751 Got JSON-RPC error response 00:12:31.751 response: 00:12:31.751 { 00:12:31.751 "code": -32602, 00:12:31.751 "message": "Invalid cntlid range [1-0]" 00:12:31.751 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.751 01:48:20 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode28018 -I 65520 00:12:32.009 [2024-11-19 01:48:20.432253] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28018: invalid cntlid range [1-65520] 00:12:32.009 01:48:20 -- target/invalid.sh@79 -- # out='request: 00:12:32.009 { 00:12:32.009 "nqn": "nqn.2016-06.io.spdk:cnode28018", 00:12:32.009 "max_cntlid": 65520, 00:12:32.009 "method": "nvmf_create_subsystem", 00:12:32.009 "req_id": 1 00:12:32.009 } 00:12:32.009 Got JSON-RPC error response 00:12:32.009 response: 00:12:32.009 { 00:12:32.009 "code": -32602, 00:12:32.009 "message": "Invalid cntlid range [1-65520]" 00:12:32.009 }' 00:12:32.009 01:48:20 -- target/invalid.sh@80 -- # [[ request: 00:12:32.009 { 00:12:32.009 "nqn": "nqn.2016-06.io.spdk:cnode28018", 00:12:32.009 "max_cntlid": 65520, 00:12:32.009 "method": "nvmf_create_subsystem", 00:12:32.009 "req_id": 1 00:12:32.009 } 00:12:32.009 Got JSON-RPC error response 00:12:32.009 response: 00:12:32.009 { 00:12:32.009 "code": -32602, 00:12:32.009 "message": "Invalid cntlid range [1-65520]" 00:12:32.009 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:32.009 01:48:20 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2061 -i 6 -I 5 00:12:32.267 [2024-11-19 01:48:20.685143] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2061: invalid cntlid range [6-5] 00:12:32.267 01:48:20 -- target/invalid.sh@83 -- # out='request: 00:12:32.267 { 00:12:32.267 "nqn": "nqn.2016-06.io.spdk:cnode2061", 00:12:32.267 "min_cntlid": 6, 00:12:32.267 "max_cntlid": 5, 00:12:32.268 "method": "nvmf_create_subsystem", 00:12:32.268 "req_id": 1 00:12:32.268 } 00:12:32.268 Got JSON-RPC error response 00:12:32.268 response: 00:12:32.268 { 00:12:32.268 "code": -32602, 00:12:32.268 "message": "Invalid cntlid range [6-5]" 00:12:32.268 }' 00:12:32.268 01:48:20 -- target/invalid.sh@84 -- # [[ request: 00:12:32.268 { 00:12:32.268 "nqn": "nqn.2016-06.io.spdk:cnode2061", 00:12:32.268 "min_cntlid": 6, 00:12:32.268 "max_cntlid": 5, 00:12:32.268 "method": "nvmf_create_subsystem", 00:12:32.268 "req_id": 1 00:12:32.268 } 00:12:32.268 Got JSON-RPC error response 00:12:32.268 response: 00:12:32.268 { 00:12:32.268 "code": -32602, 00:12:32.268 "message": "Invalid cntlid range [6-5]" 00:12:32.268 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:32.268 01:48:20 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:32.526 01:48:20 -- target/invalid.sh@87 -- # out='request: 00:12:32.526 { 00:12:32.526 "name": "foobar", 00:12:32.526 "method": "nvmf_delete_target", 00:12:32.526 "req_id": 1 00:12:32.526 } 00:12:32.526 Got JSON-RPC error response 00:12:32.526 response: 00:12:32.526 { 00:12:32.526 "code": -32602, 00:12:32.526 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:32.526 }' 00:12:32.526 01:48:20 -- target/invalid.sh@88 -- # [[ request: 00:12:32.526 { 00:12:32.526 "name": "foobar", 00:12:32.526 "method": "nvmf_delete_target", 00:12:32.526 "req_id": 1 00:12:32.526 } 00:12:32.526 Got JSON-RPC error response 00:12:32.526 response: 00:12:32.526 { 00:12:32.526 "code": -32602, 00:12:32.526 "message": "The specified target doesn't exist, cannot delete it." 00:12:32.526 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:32.526 01:48:20 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:32.526 01:48:20 -- target/invalid.sh@91 -- # nvmftestfini 00:12:32.526 01:48:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:32.526 01:48:20 -- nvmf/common.sh@116 -- # sync 00:12:32.526 01:48:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:32.526 01:48:20 -- nvmf/common.sh@119 -- # set +e 00:12:32.526 01:48:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:32.526 01:48:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:32.526 rmmod nvme_tcp 00:12:32.526 rmmod nvme_fabrics 00:12:32.526 rmmod nvme_keyring 00:12:32.526 01:48:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:32.526 01:48:20 -- nvmf/common.sh@123 -- # set -e 00:12:32.526 01:48:20 -- nvmf/common.sh@124 -- # return 0 00:12:32.526 01:48:20 -- nvmf/common.sh@477 -- # '[' -n 3395412 ']' 00:12:32.526 01:48:20 -- nvmf/common.sh@478 -- # killprocess 3395412 00:12:32.526 01:48:20 -- common/autotest_common.sh@936 -- # '[' -z 3395412 ']' 00:12:32.526 01:48:20 -- common/autotest_common.sh@940 -- # kill -0 3395412 00:12:32.526 01:48:20 -- common/autotest_common.sh@941 -- # uname 00:12:32.526 01:48:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:32.526 01:48:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3395412 00:12:32.526 01:48:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:32.526 01:48:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:32.526 01:48:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3395412' 00:12:32.526 killing process with pid 3395412 00:12:32.527 01:48:20 -- common/autotest_common.sh@955 -- # kill 3395412 00:12:32.527 01:48:20 -- common/autotest_common.sh@960 -- # wait 3395412 00:12:32.785 01:48:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:32.785 01:48:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:32.785 01:48:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:32.785 01:48:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:32.785 01:48:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:32.785 01:48:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:32.785 01:48:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:32.785 01:48:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:35.319 01:48:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:35.319 00:12:35.319 real 0m9.707s 00:12:35.319 user 0m23.611s 00:12:35.319 sys 0m2.592s 00:12:35.319 01:48:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:35.319 01:48:23 -- common/autotest_common.sh@10 -- # set +x 00:12:35.319 ************************************ 00:12:35.319 END TEST nvmf_invalid 00:12:35.319 ************************************ 00:12:35.319 01:48:23 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:35.319 01:48:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:35.319 01:48:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:35.319 01:48:23 -- common/autotest_common.sh@10 -- # set +x 00:12:35.319 ************************************ 00:12:35.319 START TEST nvmf_abort 00:12:35.319 ************************************ 00:12:35.319 01:48:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:35.319 * Looking for test storage... 00:12:35.319 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:35.319 01:48:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:35.319 01:48:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:35.319 01:48:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:35.319 01:48:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:35.319 01:48:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:35.319 01:48:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:35.319 01:48:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:35.319 01:48:23 -- scripts/common.sh@335 -- # IFS=.-: 00:12:35.319 01:48:23 -- scripts/common.sh@335 -- # read -ra ver1 00:12:35.319 01:48:23 -- scripts/common.sh@336 -- # IFS=.-: 00:12:35.319 01:48:23 -- scripts/common.sh@336 -- # read -ra ver2 00:12:35.319 01:48:23 -- scripts/common.sh@337 -- # local 'op=<' 00:12:35.319 01:48:23 -- scripts/common.sh@339 -- # ver1_l=2 00:12:35.319 01:48:23 -- scripts/common.sh@340 -- # ver2_l=1 00:12:35.319 01:48:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:35.319 01:48:23 -- scripts/common.sh@343 -- # case "$op" in 00:12:35.319 01:48:23 -- scripts/common.sh@344 -- # : 1 00:12:35.319 01:48:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:35.319 01:48:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:35.319 01:48:23 -- scripts/common.sh@364 -- # decimal 1 00:12:35.319 01:48:23 -- scripts/common.sh@352 -- # local d=1 00:12:35.319 01:48:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:35.319 01:48:23 -- scripts/common.sh@354 -- # echo 1 00:12:35.319 01:48:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:35.319 01:48:23 -- scripts/common.sh@365 -- # decimal 2 00:12:35.319 01:48:23 -- scripts/common.sh@352 -- # local d=2 00:12:35.319 01:48:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:35.319 01:48:23 -- scripts/common.sh@354 -- # echo 2 00:12:35.319 01:48:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:35.319 01:48:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:35.319 01:48:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:35.319 01:48:23 -- scripts/common.sh@367 -- # return 0 00:12:35.319 01:48:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:35.319 01:48:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:35.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.319 --rc genhtml_branch_coverage=1 00:12:35.319 --rc genhtml_function_coverage=1 00:12:35.319 --rc genhtml_legend=1 00:12:35.319 --rc geninfo_all_blocks=1 00:12:35.319 --rc geninfo_unexecuted_blocks=1 00:12:35.319 00:12:35.319 ' 00:12:35.319 01:48:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:35.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.320 --rc genhtml_branch_coverage=1 00:12:35.320 --rc genhtml_function_coverage=1 00:12:35.320 --rc genhtml_legend=1 00:12:35.320 --rc geninfo_all_blocks=1 00:12:35.320 --rc geninfo_unexecuted_blocks=1 00:12:35.320 00:12:35.320 ' 00:12:35.320 01:48:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:35.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.320 --rc genhtml_branch_coverage=1 00:12:35.320 --rc genhtml_function_coverage=1 00:12:35.320 --rc genhtml_legend=1 00:12:35.320 --rc geninfo_all_blocks=1 00:12:35.320 --rc geninfo_unexecuted_blocks=1 00:12:35.320 00:12:35.320 ' 00:12:35.320 01:48:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:35.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.320 --rc genhtml_branch_coverage=1 00:12:35.320 --rc genhtml_function_coverage=1 00:12:35.320 --rc genhtml_legend=1 00:12:35.320 --rc geninfo_all_blocks=1 00:12:35.320 --rc geninfo_unexecuted_blocks=1 00:12:35.320 00:12:35.320 ' 00:12:35.320 01:48:23 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:35.320 01:48:23 -- nvmf/common.sh@7 -- # uname -s 00:12:35.320 01:48:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:35.320 01:48:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:35.320 01:48:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:35.320 01:48:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:35.320 01:48:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:35.320 01:48:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:35.320 01:48:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:35.320 01:48:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:35.320 01:48:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:35.320 01:48:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:35.320 01:48:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:35.320 01:48:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:35.320 01:48:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:35.320 01:48:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:35.320 01:48:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:35.320 01:48:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:35.320 01:48:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:35.320 01:48:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:35.320 01:48:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:35.320 01:48:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.320 01:48:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.320 01:48:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.320 01:48:23 -- paths/export.sh@5 -- # export PATH 00:12:35.320 01:48:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.320 01:48:23 -- nvmf/common.sh@46 -- # : 0 00:12:35.320 01:48:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:35.320 01:48:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:35.320 01:48:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:35.320 01:48:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:35.320 01:48:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:35.320 01:48:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:35.320 01:48:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:35.320 01:48:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:35.320 01:48:23 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:35.320 01:48:23 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:35.320 01:48:23 -- target/abort.sh@14 -- # nvmftestinit 00:12:35.320 01:48:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:35.320 01:48:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:35.320 01:48:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:35.320 01:48:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:35.320 01:48:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:35.320 01:48:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:35.320 01:48:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:35.320 01:48:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:35.320 01:48:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:35.320 01:48:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:35.320 01:48:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:35.320 01:48:23 -- common/autotest_common.sh@10 -- # set +x 00:12:37.225 01:48:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:37.225 01:48:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:37.225 01:48:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:37.225 01:48:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:37.225 01:48:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:37.225 01:48:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:37.225 01:48:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:37.225 01:48:25 -- nvmf/common.sh@294 -- # net_devs=() 00:12:37.225 01:48:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:37.225 01:48:25 -- nvmf/common.sh@295 -- # e810=() 00:12:37.225 01:48:25 -- nvmf/common.sh@295 -- # local -ga e810 00:12:37.225 01:48:25 -- nvmf/common.sh@296 -- # x722=() 00:12:37.225 01:48:25 -- nvmf/common.sh@296 -- # local -ga x722 00:12:37.225 01:48:25 -- nvmf/common.sh@297 -- # mlx=() 00:12:37.225 01:48:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:37.225 01:48:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:37.225 01:48:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:37.225 01:48:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:37.225 01:48:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:37.225 01:48:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:37.225 01:48:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:37.225 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:37.225 01:48:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:37.225 01:48:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:37.225 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:37.225 01:48:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:37.225 01:48:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:37.225 01:48:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.225 01:48:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:37.225 01:48:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.225 01:48:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:37.225 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:37.225 01:48:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.225 01:48:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:37.225 01:48:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.225 01:48:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:37.225 01:48:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.225 01:48:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:37.225 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:37.225 01:48:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.225 01:48:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:37.225 01:48:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:37.225 01:48:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:37.225 01:48:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:37.225 01:48:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:37.225 01:48:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:37.225 01:48:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:37.225 01:48:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:37.225 01:48:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:37.225 01:48:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:37.225 01:48:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:37.225 01:48:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:37.225 01:48:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:37.225 01:48:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:37.225 01:48:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:37.225 01:48:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:37.225 01:48:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:37.225 01:48:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:37.225 01:48:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:37.225 01:48:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:37.225 01:48:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:37.225 01:48:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:37.225 01:48:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:37.225 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:37.225 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:12:37.225 00:12:37.225 --- 10.0.0.2 ping statistics --- 00:12:37.225 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.225 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:12:37.225 01:48:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:37.225 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:37.225 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:12:37.225 00:12:37.225 --- 10.0.0.1 ping statistics --- 00:12:37.225 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.225 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:12:37.225 01:48:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:37.225 01:48:25 -- nvmf/common.sh@410 -- # return 0 00:12:37.225 01:48:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:37.225 01:48:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:37.225 01:48:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:37.225 01:48:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:37.225 01:48:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:37.225 01:48:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:37.225 01:48:25 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:37.225 01:48:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:37.225 01:48:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:37.225 01:48:25 -- common/autotest_common.sh@10 -- # set +x 00:12:37.225 01:48:25 -- nvmf/common.sh@469 -- # nvmfpid=3398102 00:12:37.226 01:48:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:37.226 01:48:25 -- nvmf/common.sh@470 -- # waitforlisten 3398102 00:12:37.226 01:48:25 -- common/autotest_common.sh@829 -- # '[' -z 3398102 ']' 00:12:37.226 01:48:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:37.226 01:48:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:37.226 01:48:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:37.226 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:37.226 01:48:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:37.226 01:48:25 -- common/autotest_common.sh@10 -- # set +x 00:12:37.484 [2024-11-19 01:48:25.792328] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:37.484 [2024-11-19 01:48:25.792407] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:37.484 EAL: No free 2048 kB hugepages reported on node 1 00:12:37.484 [2024-11-19 01:48:25.869355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:37.485 [2024-11-19 01:48:25.988082] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:37.485 [2024-11-19 01:48:25.988254] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:37.485 [2024-11-19 01:48:25.988275] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:37.485 [2024-11-19 01:48:25.988297] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:37.485 [2024-11-19 01:48:25.988380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:37.485 [2024-11-19 01:48:25.988436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:37.485 [2024-11-19 01:48:25.988440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:38.449 01:48:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:38.449 01:48:26 -- common/autotest_common.sh@862 -- # return 0 00:12:38.449 01:48:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:38.449 01:48:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 01:48:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:38.449 01:48:26 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:38.449 01:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 [2024-11-19 01:48:26.839219] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:38.449 01:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.449 01:48:26 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:38.449 01:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 Malloc0 00:12:38.449 01:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.449 01:48:26 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:38.449 01:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 Delay0 00:12:38.449 01:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.449 01:48:26 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:38.449 01:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 01:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.449 01:48:26 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:38.449 01:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 01:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.449 01:48:26 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:38.449 01:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 [2024-11-19 01:48:26.910690] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:38.449 01:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.449 01:48:26 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:38.449 01:48:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.449 01:48:26 -- common/autotest_common.sh@10 -- # set +x 00:12:38.449 01:48:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.449 01:48:26 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:38.449 EAL: No free 2048 kB hugepages reported on node 1 00:12:38.732 [2024-11-19 01:48:27.015509] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:40.634 Initializing NVMe Controllers 00:12:40.634 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:40.634 controller IO queue size 128 less than required 00:12:40.634 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:40.634 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:40.634 Initialization complete. Launching workers. 00:12:40.634 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34281 00:12:40.634 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34342, failed to submit 62 00:12:40.634 success 34281, unsuccess 61, failed 0 00:12:40.634 01:48:29 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:40.634 01:48:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.634 01:48:29 -- common/autotest_common.sh@10 -- # set +x 00:12:40.891 01:48:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.891 01:48:29 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:40.891 01:48:29 -- target/abort.sh@38 -- # nvmftestfini 00:12:40.891 01:48:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:40.891 01:48:29 -- nvmf/common.sh@116 -- # sync 00:12:40.891 01:48:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:40.891 01:48:29 -- nvmf/common.sh@119 -- # set +e 00:12:40.891 01:48:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:40.891 01:48:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:40.891 rmmod nvme_tcp 00:12:40.891 rmmod nvme_fabrics 00:12:40.891 rmmod nvme_keyring 00:12:40.891 01:48:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:40.891 01:48:29 -- nvmf/common.sh@123 -- # set -e 00:12:40.891 01:48:29 -- nvmf/common.sh@124 -- # return 0 00:12:40.891 01:48:29 -- nvmf/common.sh@477 -- # '[' -n 3398102 ']' 00:12:40.891 01:48:29 -- nvmf/common.sh@478 -- # killprocess 3398102 00:12:40.891 01:48:29 -- common/autotest_common.sh@936 -- # '[' -z 3398102 ']' 00:12:40.891 01:48:29 -- common/autotest_common.sh@940 -- # kill -0 3398102 00:12:40.891 01:48:29 -- common/autotest_common.sh@941 -- # uname 00:12:40.891 01:48:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:40.891 01:48:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3398102 00:12:40.891 01:48:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:40.891 01:48:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:40.891 01:48:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3398102' 00:12:40.891 killing process with pid 3398102 00:12:40.891 01:48:29 -- common/autotest_common.sh@955 -- # kill 3398102 00:12:40.891 01:48:29 -- common/autotest_common.sh@960 -- # wait 3398102 00:12:41.149 01:48:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:41.149 01:48:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:41.149 01:48:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:41.149 01:48:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:41.149 01:48:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:41.149 01:48:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:41.149 01:48:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:41.149 01:48:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:43.682 01:48:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:43.682 00:12:43.682 real 0m8.342s 00:12:43.682 user 0m13.460s 00:12:43.682 sys 0m2.619s 00:12:43.682 01:48:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:43.682 01:48:31 -- common/autotest_common.sh@10 -- # set +x 00:12:43.682 ************************************ 00:12:43.682 END TEST nvmf_abort 00:12:43.682 ************************************ 00:12:43.682 01:48:31 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:43.682 01:48:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:43.683 01:48:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:43.683 01:48:31 -- common/autotest_common.sh@10 -- # set +x 00:12:43.683 ************************************ 00:12:43.683 START TEST nvmf_ns_hotplug_stress 00:12:43.683 ************************************ 00:12:43.683 01:48:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:43.683 * Looking for test storage... 00:12:43.683 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:43.683 01:48:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:43.683 01:48:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:43.683 01:48:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:43.683 01:48:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:43.683 01:48:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:43.683 01:48:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:43.683 01:48:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:43.683 01:48:31 -- scripts/common.sh@335 -- # IFS=.-: 00:12:43.683 01:48:31 -- scripts/common.sh@335 -- # read -ra ver1 00:12:43.683 01:48:31 -- scripts/common.sh@336 -- # IFS=.-: 00:12:43.683 01:48:31 -- scripts/common.sh@336 -- # read -ra ver2 00:12:43.683 01:48:31 -- scripts/common.sh@337 -- # local 'op=<' 00:12:43.683 01:48:31 -- scripts/common.sh@339 -- # ver1_l=2 00:12:43.683 01:48:31 -- scripts/common.sh@340 -- # ver2_l=1 00:12:43.683 01:48:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:43.683 01:48:31 -- scripts/common.sh@343 -- # case "$op" in 00:12:43.683 01:48:31 -- scripts/common.sh@344 -- # : 1 00:12:43.683 01:48:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:43.683 01:48:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:43.683 01:48:31 -- scripts/common.sh@364 -- # decimal 1 00:12:43.683 01:48:31 -- scripts/common.sh@352 -- # local d=1 00:12:43.683 01:48:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:43.683 01:48:31 -- scripts/common.sh@354 -- # echo 1 00:12:43.683 01:48:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:43.683 01:48:31 -- scripts/common.sh@365 -- # decimal 2 00:12:43.683 01:48:31 -- scripts/common.sh@352 -- # local d=2 00:12:43.683 01:48:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:43.683 01:48:31 -- scripts/common.sh@354 -- # echo 2 00:12:43.683 01:48:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:43.683 01:48:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:43.683 01:48:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:43.683 01:48:31 -- scripts/common.sh@367 -- # return 0 00:12:43.683 01:48:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:43.683 01:48:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.683 --rc genhtml_branch_coverage=1 00:12:43.683 --rc genhtml_function_coverage=1 00:12:43.683 --rc genhtml_legend=1 00:12:43.683 --rc geninfo_all_blocks=1 00:12:43.683 --rc geninfo_unexecuted_blocks=1 00:12:43.683 00:12:43.683 ' 00:12:43.683 01:48:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.683 --rc genhtml_branch_coverage=1 00:12:43.683 --rc genhtml_function_coverage=1 00:12:43.683 --rc genhtml_legend=1 00:12:43.683 --rc geninfo_all_blocks=1 00:12:43.683 --rc geninfo_unexecuted_blocks=1 00:12:43.683 00:12:43.683 ' 00:12:43.683 01:48:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.683 --rc genhtml_branch_coverage=1 00:12:43.683 --rc genhtml_function_coverage=1 00:12:43.683 --rc genhtml_legend=1 00:12:43.683 --rc geninfo_all_blocks=1 00:12:43.683 --rc geninfo_unexecuted_blocks=1 00:12:43.683 00:12:43.683 ' 00:12:43.683 01:48:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:43.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:43.683 --rc genhtml_branch_coverage=1 00:12:43.683 --rc genhtml_function_coverage=1 00:12:43.683 --rc genhtml_legend=1 00:12:43.683 --rc geninfo_all_blocks=1 00:12:43.683 --rc geninfo_unexecuted_blocks=1 00:12:43.683 00:12:43.683 ' 00:12:43.683 01:48:31 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:43.683 01:48:31 -- nvmf/common.sh@7 -- # uname -s 00:12:43.683 01:48:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:43.683 01:48:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:43.683 01:48:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:43.683 01:48:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:43.683 01:48:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:43.683 01:48:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:43.683 01:48:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:43.683 01:48:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:43.683 01:48:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:43.683 01:48:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:43.683 01:48:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:43.683 01:48:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:43.683 01:48:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:43.683 01:48:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:43.683 01:48:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:43.683 01:48:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:43.683 01:48:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:43.683 01:48:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:43.683 01:48:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:43.683 01:48:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.683 01:48:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.683 01:48:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.683 01:48:31 -- paths/export.sh@5 -- # export PATH 00:12:43.683 01:48:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:43.683 01:48:31 -- nvmf/common.sh@46 -- # : 0 00:12:43.683 01:48:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:43.683 01:48:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:43.683 01:48:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:43.683 01:48:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:43.683 01:48:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:43.683 01:48:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:43.683 01:48:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:43.683 01:48:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:43.683 01:48:31 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:43.683 01:48:31 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:43.683 01:48:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:43.683 01:48:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:43.683 01:48:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:43.683 01:48:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:43.683 01:48:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:43.683 01:48:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:43.683 01:48:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:43.683 01:48:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:43.683 01:48:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:43.683 01:48:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:43.683 01:48:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:43.683 01:48:31 -- common/autotest_common.sh@10 -- # set +x 00:12:45.587 01:48:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:45.587 01:48:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:45.587 01:48:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:45.587 01:48:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:45.587 01:48:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:45.587 01:48:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:45.587 01:48:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:45.587 01:48:33 -- nvmf/common.sh@294 -- # net_devs=() 00:12:45.587 01:48:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:45.587 01:48:33 -- nvmf/common.sh@295 -- # e810=() 00:12:45.587 01:48:33 -- nvmf/common.sh@295 -- # local -ga e810 00:12:45.587 01:48:33 -- nvmf/common.sh@296 -- # x722=() 00:12:45.587 01:48:33 -- nvmf/common.sh@296 -- # local -ga x722 00:12:45.587 01:48:33 -- nvmf/common.sh@297 -- # mlx=() 00:12:45.587 01:48:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:45.587 01:48:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:45.587 01:48:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:45.587 01:48:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:45.587 01:48:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:45.587 01:48:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:45.587 01:48:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:45.587 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:45.587 01:48:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:45.587 01:48:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:45.587 01:48:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:45.588 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:45.588 01:48:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:45.588 01:48:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:45.588 01:48:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:45.588 01:48:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:45.588 01:48:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:45.588 01:48:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:45.588 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:45.588 01:48:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:45.588 01:48:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:45.588 01:48:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:45.588 01:48:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:45.588 01:48:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:45.588 01:48:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:45.588 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:45.588 01:48:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:45.588 01:48:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:45.588 01:48:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:45.588 01:48:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:45.588 01:48:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:45.588 01:48:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:45.588 01:48:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:45.588 01:48:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:45.588 01:48:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:45.588 01:48:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:45.588 01:48:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:45.588 01:48:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:45.588 01:48:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:45.588 01:48:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:45.588 01:48:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:45.588 01:48:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:45.588 01:48:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:45.588 01:48:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:45.588 01:48:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:45.588 01:48:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:45.588 01:48:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:45.588 01:48:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:45.588 01:48:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:45.588 01:48:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:45.588 01:48:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:45.588 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:45.588 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:12:45.588 00:12:45.588 --- 10.0.0.2 ping statistics --- 00:12:45.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:45.588 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:12:45.588 01:48:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:45.588 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:45.588 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:12:45.588 00:12:45.588 --- 10.0.0.1 ping statistics --- 00:12:45.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:45.588 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:12:45.588 01:48:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:45.588 01:48:34 -- nvmf/common.sh@410 -- # return 0 00:12:45.588 01:48:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:45.588 01:48:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:45.588 01:48:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:45.588 01:48:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:45.588 01:48:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:45.588 01:48:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:45.588 01:48:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:45.588 01:48:34 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:45.588 01:48:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:45.588 01:48:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:45.588 01:48:34 -- common/autotest_common.sh@10 -- # set +x 00:12:45.588 01:48:34 -- nvmf/common.sh@469 -- # nvmfpid=3400599 00:12:45.588 01:48:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:45.588 01:48:34 -- nvmf/common.sh@470 -- # waitforlisten 3400599 00:12:45.588 01:48:34 -- common/autotest_common.sh@829 -- # '[' -z 3400599 ']' 00:12:45.588 01:48:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:45.588 01:48:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:45.588 01:48:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:45.588 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:45.588 01:48:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:45.588 01:48:34 -- common/autotest_common.sh@10 -- # set +x 00:12:45.846 [2024-11-19 01:48:34.146685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:45.846 [2024-11-19 01:48:34.146760] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:45.846 EAL: No free 2048 kB hugepages reported on node 1 00:12:45.846 [2024-11-19 01:48:34.219338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:45.846 [2024-11-19 01:48:34.345683] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:45.846 [2024-11-19 01:48:34.345894] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:45.846 [2024-11-19 01:48:34.345929] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:45.846 [2024-11-19 01:48:34.345955] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:45.846 [2024-11-19 01:48:34.346049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:45.846 [2024-11-19 01:48:34.346103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:45.846 [2024-11-19 01:48:34.346109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:46.781 01:48:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:46.781 01:48:35 -- common/autotest_common.sh@862 -- # return 0 00:12:46.781 01:48:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:46.781 01:48:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:46.781 01:48:35 -- common/autotest_common.sh@10 -- # set +x 00:12:46.781 01:48:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:46.781 01:48:35 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:46.781 01:48:35 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:47.038 [2024-11-19 01:48:35.456671] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:47.038 01:48:35 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:47.296 01:48:35 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:47.553 [2024-11-19 01:48:35.979598] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:47.553 01:48:35 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:47.811 01:48:36 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:48.069 Malloc0 00:12:48.069 01:48:36 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:48.326 Delay0 00:12:48.326 01:48:36 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.585 01:48:37 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:48.842 NULL1 00:12:48.842 01:48:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:49.100 01:48:37 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3401038 00:12:49.101 01:48:37 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:49.101 01:48:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:49.101 01:48:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.101 EAL: No free 2048 kB hugepages reported on node 1 00:12:50.475 Read completed with error (sct=0, sc=11) 00:12:50.475 01:48:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.475 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.475 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.475 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.475 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.475 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.475 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.475 01:48:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:50.475 01:48:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:50.738 true 00:12:50.738 01:48:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:50.738 01:48:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.672 01:48:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.672 01:48:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:51.672 01:48:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:51.929 true 00:12:51.929 01:48:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:51.929 01:48:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.187 01:48:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.445 01:48:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:52.445 01:48:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:52.702 true 00:12:52.702 01:48:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:52.702 01:48:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.961 01:48:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.219 01:48:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:53.219 01:48:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:53.477 true 00:12:53.477 01:48:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:53.477 01:48:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.850 01:48:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.850 01:48:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:54.850 01:48:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:55.108 true 00:12:55.108 01:48:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:55.108 01:48:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.366 01:48:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.623 01:48:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:55.623 01:48:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:55.881 true 00:12:55.881 01:48:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:55.881 01:48:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.815 01:48:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.073 01:48:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:57.074 01:48:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:57.074 true 00:12:57.074 01:48:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:57.074 01:48:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.332 01:48:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.589 01:48:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:57.590 01:48:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:57.848 true 00:12:57.848 01:48:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:57.848 01:48:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.781 01:48:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.346 01:48:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:59.346 01:48:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:59.604 true 00:12:59.604 01:48:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:12:59.604 01:48:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.861 01:48:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.119 01:48:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:00.119 01:48:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:00.377 true 00:13:00.377 01:48:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:00.377 01:48:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.635 01:48:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.635 01:48:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:00.635 01:48:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:00.892 true 00:13:00.892 01:48:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:00.892 01:48:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 01:48:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.265 01:48:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:02.265 01:48:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:02.522 true 00:13:02.522 01:48:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:02.522 01:48:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.455 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:03.455 01:48:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.455 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:03.713 01:48:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:03.713 01:48:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:03.970 true 00:13:03.971 01:48:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:03.971 01:48:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.228 01:48:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.487 01:48:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:04.487 01:48:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:04.745 true 00:13:04.745 01:48:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:04.745 01:48:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.755 01:48:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.755 01:48:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:05.755 01:48:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:06.013 true 00:13:06.013 01:48:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:06.013 01:48:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.270 01:48:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.528 01:48:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:06.529 01:48:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:06.786 true 00:13:06.786 01:48:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:06.786 01:48:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.719 01:48:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.719 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.977 01:48:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:07.977 01:48:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:07.977 true 00:13:08.235 01:48:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:08.235 01:48:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.235 01:48:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.491 01:48:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:08.491 01:48:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:08.747 true 00:13:08.747 01:48:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:08.747 01:48:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.679 01:48:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.937 01:48:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:09.937 01:48:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:10.194 true 00:13:10.194 01:48:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:10.194 01:48:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.452 01:48:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.709 01:48:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:10.709 01:48:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:10.967 true 00:13:10.967 01:48:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:10.967 01:48:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.900 01:49:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.900 01:49:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:11.900 01:49:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:12.158 true 00:13:12.158 01:49:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:12.158 01:49:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.417 01:49:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.674 01:49:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:12.674 01:49:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:12.932 true 00:13:12.932 01:49:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:12.932 01:49:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.190 01:49:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:13.447 01:49:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:13.447 01:49:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:13.705 true 00:13:13.705 01:49:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:13.705 01:49:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.077 01:49:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.077 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.077 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.077 01:49:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:15.077 01:49:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:15.335 true 00:13:15.335 01:49:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:15.335 01:49:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.593 01:49:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.850 01:49:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:15.850 01:49:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:16.108 true 00:13:16.108 01:49:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:16.108 01:49:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.040 01:49:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.040 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.040 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.040 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.298 01:49:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:17.298 01:49:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:17.555 true 00:13:17.555 01:49:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:17.555 01:49:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.813 01:49:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.070 01:49:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:18.070 01:49:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:18.328 true 00:13:18.328 01:49:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:18.328 01:49:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.261 01:49:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.261 Initializing NVMe Controllers 00:13:19.261 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:19.261 Controller IO queue size 128, less than required. 00:13:19.261 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:19.261 Controller IO queue size 128, less than required. 00:13:19.261 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:19.261 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:19.261 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:19.261 Initialization complete. Launching workers. 00:13:19.261 ======================================================== 00:13:19.261 Latency(us) 00:13:19.261 Device Information : IOPS MiB/s Average min max 00:13:19.261 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 993.94 0.49 67900.59 3003.73 1027438.52 00:13:19.261 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 12090.48 5.90 10587.84 1612.63 532514.71 00:13:19.261 ======================================================== 00:13:19.261 Total : 13084.42 6.39 14941.51 1612.63 1027438.52 00:13:19.261 00:13:19.519 01:49:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:19.519 01:49:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:19.777 true 00:13:19.777 01:49:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3401038 00:13:19.777 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3401038) - No such process 00:13:19.777 01:49:08 -- target/ns_hotplug_stress.sh@53 -- # wait 3401038 00:13:19.777 01:49:08 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.035 01:49:08 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.292 01:49:08 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:20.293 01:49:08 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:20.293 01:49:08 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:20.293 01:49:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.293 01:49:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:20.550 null0 00:13:20.550 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.550 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.550 01:49:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:20.808 null1 00:13:20.808 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.808 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.808 01:49:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:21.065 null2 00:13:21.065 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.065 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.065 01:49:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:21.323 null3 00:13:21.323 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.323 01:49:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.323 01:49:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:21.581 null4 00:13:21.581 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.581 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.581 01:49:10 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:21.840 null5 00:13:21.840 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.840 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.840 01:49:10 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:22.098 null6 00:13:22.098 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:22.098 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:22.098 01:49:10 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:22.357 null7 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@66 -- # wait 3405193 3405194 3405196 3405198 3405200 3405202 3405204 3405206 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.357 01:49:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.616 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.874 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.132 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.390 01:49:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.648 01:49:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.906 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.165 01:49:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.423 01:49:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.681 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.682 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.682 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.682 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.682 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.682 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.682 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.682 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.940 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.199 01:49:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.457 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.457 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.457 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.457 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.457 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.458 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.458 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.458 01:49:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.716 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.974 01:49:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:26.231 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.489 01:49:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.747 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.005 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:27.263 01:49:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.521 01:49:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:27.779 01:49:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.037 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.038 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.038 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.038 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.038 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.038 01:49:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.038 01:49:16 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:28.038 01:49:16 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:28.038 01:49:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:28.038 01:49:16 -- nvmf/common.sh@116 -- # sync 00:13:28.038 01:49:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:28.038 01:49:16 -- nvmf/common.sh@119 -- # set +e 00:13:28.038 01:49:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:28.038 01:49:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:28.038 rmmod nvme_tcp 00:13:28.038 rmmod nvme_fabrics 00:13:28.038 rmmod nvme_keyring 00:13:28.038 01:49:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:28.038 01:49:16 -- nvmf/common.sh@123 -- # set -e 00:13:28.038 01:49:16 -- nvmf/common.sh@124 -- # return 0 00:13:28.038 01:49:16 -- nvmf/common.sh@477 -- # '[' -n 3400599 ']' 00:13:28.038 01:49:16 -- nvmf/common.sh@478 -- # killprocess 3400599 00:13:28.038 01:49:16 -- common/autotest_common.sh@936 -- # '[' -z 3400599 ']' 00:13:28.038 01:49:16 -- common/autotest_common.sh@940 -- # kill -0 3400599 00:13:28.038 01:49:16 -- common/autotest_common.sh@941 -- # uname 00:13:28.038 01:49:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:28.038 01:49:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3400599 00:13:28.296 01:49:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:28.296 01:49:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:28.296 01:49:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3400599' 00:13:28.296 killing process with pid 3400599 00:13:28.296 01:49:16 -- common/autotest_common.sh@955 -- # kill 3400599 00:13:28.296 01:49:16 -- common/autotest_common.sh@960 -- # wait 3400599 00:13:28.553 01:49:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:28.553 01:49:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:28.553 01:49:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:28.553 01:49:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:28.553 01:49:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:28.553 01:49:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.553 01:49:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.553 01:49:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.508 01:49:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:30.508 00:13:30.508 real 0m47.256s 00:13:30.508 user 3m34.030s 00:13:30.508 sys 0m15.666s 00:13:30.508 01:49:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:30.508 01:49:18 -- common/autotest_common.sh@10 -- # set +x 00:13:30.508 ************************************ 00:13:30.508 END TEST nvmf_ns_hotplug_stress 00:13:30.508 ************************************ 00:13:30.508 01:49:18 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:30.508 01:49:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:30.508 01:49:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:30.508 01:49:18 -- common/autotest_common.sh@10 -- # set +x 00:13:30.508 ************************************ 00:13:30.508 START TEST nvmf_connect_stress 00:13:30.508 ************************************ 00:13:30.508 01:49:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:30.508 * Looking for test storage... 00:13:30.508 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:30.508 01:49:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:30.508 01:49:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:30.508 01:49:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:30.766 01:49:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:30.766 01:49:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:30.766 01:49:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:30.766 01:49:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:30.766 01:49:19 -- scripts/common.sh@335 -- # IFS=.-: 00:13:30.766 01:49:19 -- scripts/common.sh@335 -- # read -ra ver1 00:13:30.766 01:49:19 -- scripts/common.sh@336 -- # IFS=.-: 00:13:30.766 01:49:19 -- scripts/common.sh@336 -- # read -ra ver2 00:13:30.766 01:49:19 -- scripts/common.sh@337 -- # local 'op=<' 00:13:30.766 01:49:19 -- scripts/common.sh@339 -- # ver1_l=2 00:13:30.766 01:49:19 -- scripts/common.sh@340 -- # ver2_l=1 00:13:30.766 01:49:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:30.766 01:49:19 -- scripts/common.sh@343 -- # case "$op" in 00:13:30.766 01:49:19 -- scripts/common.sh@344 -- # : 1 00:13:30.766 01:49:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:30.766 01:49:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:30.766 01:49:19 -- scripts/common.sh@364 -- # decimal 1 00:13:30.766 01:49:19 -- scripts/common.sh@352 -- # local d=1 00:13:30.766 01:49:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:30.766 01:49:19 -- scripts/common.sh@354 -- # echo 1 00:13:30.766 01:49:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:30.766 01:49:19 -- scripts/common.sh@365 -- # decimal 2 00:13:30.766 01:49:19 -- scripts/common.sh@352 -- # local d=2 00:13:30.766 01:49:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:30.766 01:49:19 -- scripts/common.sh@354 -- # echo 2 00:13:30.766 01:49:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:30.766 01:49:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:30.766 01:49:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:30.767 01:49:19 -- scripts/common.sh@367 -- # return 0 00:13:30.767 01:49:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:30.767 01:49:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:30.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.767 --rc genhtml_branch_coverage=1 00:13:30.767 --rc genhtml_function_coverage=1 00:13:30.767 --rc genhtml_legend=1 00:13:30.767 --rc geninfo_all_blocks=1 00:13:30.767 --rc geninfo_unexecuted_blocks=1 00:13:30.767 00:13:30.767 ' 00:13:30.767 01:49:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:30.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.767 --rc genhtml_branch_coverage=1 00:13:30.767 --rc genhtml_function_coverage=1 00:13:30.767 --rc genhtml_legend=1 00:13:30.767 --rc geninfo_all_blocks=1 00:13:30.767 --rc geninfo_unexecuted_blocks=1 00:13:30.767 00:13:30.767 ' 00:13:30.767 01:49:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:30.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.767 --rc genhtml_branch_coverage=1 00:13:30.767 --rc genhtml_function_coverage=1 00:13:30.767 --rc genhtml_legend=1 00:13:30.767 --rc geninfo_all_blocks=1 00:13:30.767 --rc geninfo_unexecuted_blocks=1 00:13:30.767 00:13:30.767 ' 00:13:30.767 01:49:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:30.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.767 --rc genhtml_branch_coverage=1 00:13:30.767 --rc genhtml_function_coverage=1 00:13:30.767 --rc genhtml_legend=1 00:13:30.767 --rc geninfo_all_blocks=1 00:13:30.767 --rc geninfo_unexecuted_blocks=1 00:13:30.767 00:13:30.767 ' 00:13:30.767 01:49:19 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:30.767 01:49:19 -- nvmf/common.sh@7 -- # uname -s 00:13:30.767 01:49:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:30.767 01:49:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:30.767 01:49:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:30.767 01:49:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:30.767 01:49:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:30.767 01:49:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:30.767 01:49:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:30.767 01:49:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:30.767 01:49:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:30.767 01:49:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:30.767 01:49:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.767 01:49:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.767 01:49:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:30.767 01:49:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:30.767 01:49:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:30.767 01:49:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:30.767 01:49:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:30.767 01:49:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:30.767 01:49:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:30.767 01:49:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.767 01:49:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.767 01:49:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.767 01:49:19 -- paths/export.sh@5 -- # export PATH 00:13:30.767 01:49:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.767 01:49:19 -- nvmf/common.sh@46 -- # : 0 00:13:30.767 01:49:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:30.767 01:49:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:30.767 01:49:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:30.767 01:49:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:30.767 01:49:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:30.767 01:49:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:30.767 01:49:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:30.767 01:49:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:30.767 01:49:19 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:30.767 01:49:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:30.767 01:49:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:30.767 01:49:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:30.767 01:49:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:30.767 01:49:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:30.767 01:49:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.767 01:49:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.767 01:49:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.767 01:49:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:30.767 01:49:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:30.767 01:49:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:30.767 01:49:19 -- common/autotest_common.sh@10 -- # set +x 00:13:32.665 01:49:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:32.665 01:49:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:32.665 01:49:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:32.665 01:49:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:32.665 01:49:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:32.665 01:49:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:32.665 01:49:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:32.665 01:49:21 -- nvmf/common.sh@294 -- # net_devs=() 00:13:32.665 01:49:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:32.665 01:49:21 -- nvmf/common.sh@295 -- # e810=() 00:13:32.665 01:49:21 -- nvmf/common.sh@295 -- # local -ga e810 00:13:32.665 01:49:21 -- nvmf/common.sh@296 -- # x722=() 00:13:32.665 01:49:21 -- nvmf/common.sh@296 -- # local -ga x722 00:13:32.665 01:49:21 -- nvmf/common.sh@297 -- # mlx=() 00:13:32.665 01:49:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:32.665 01:49:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:32.665 01:49:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:32.665 01:49:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:32.665 01:49:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:32.665 01:49:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.665 01:49:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:32.665 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:32.665 01:49:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.665 01:49:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:32.665 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:32.665 01:49:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:32.665 01:49:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.665 01:49:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.665 01:49:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.665 01:49:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.665 01:49:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:32.665 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:32.665 01:49:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.665 01:49:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.665 01:49:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.665 01:49:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.665 01:49:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.665 01:49:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:32.665 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:32.665 01:49:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.665 01:49:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:32.665 01:49:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:32.665 01:49:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:32.665 01:49:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:32.665 01:49:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:32.665 01:49:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:32.665 01:49:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:32.665 01:49:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:32.666 01:49:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:32.666 01:49:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:32.666 01:49:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:32.666 01:49:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:32.666 01:49:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:32.666 01:49:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:32.666 01:49:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:32.666 01:49:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:32.666 01:49:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:32.924 01:49:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:32.924 01:49:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:32.924 01:49:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:32.924 01:49:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:32.924 01:49:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:32.924 01:49:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:32.924 01:49:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:32.924 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:32.924 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.192 ms 00:13:32.924 00:13:32.924 --- 10.0.0.2 ping statistics --- 00:13:32.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.924 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:13:32.924 01:49:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:32.924 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:32.924 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:13:32.924 00:13:32.924 --- 10.0.0.1 ping statistics --- 00:13:32.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.924 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:13:32.924 01:49:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:32.924 01:49:21 -- nvmf/common.sh@410 -- # return 0 00:13:32.924 01:49:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:32.924 01:49:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:32.924 01:49:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:32.924 01:49:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:32.924 01:49:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:32.924 01:49:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:32.924 01:49:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:32.924 01:49:21 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:32.924 01:49:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:32.924 01:49:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:32.924 01:49:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.924 01:49:21 -- nvmf/common.sh@469 -- # nvmfpid=3408004 00:13:32.924 01:49:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:32.924 01:49:21 -- nvmf/common.sh@470 -- # waitforlisten 3408004 00:13:32.924 01:49:21 -- common/autotest_common.sh@829 -- # '[' -z 3408004 ']' 00:13:32.924 01:49:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:32.924 01:49:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:32.924 01:49:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:32.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:32.924 01:49:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:32.924 01:49:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.924 [2024-11-19 01:49:21.385082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:32.924 [2024-11-19 01:49:21.385161] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:32.924 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.924 [2024-11-19 01:49:21.448042] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:33.183 [2024-11-19 01:49:21.553777] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:33.183 [2024-11-19 01:49:21.553941] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:33.183 [2024-11-19 01:49:21.553958] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:33.183 [2024-11-19 01:49:21.553972] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:33.183 [2024-11-19 01:49:21.554065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:33.183 [2024-11-19 01:49:21.554123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:33.183 [2024-11-19 01:49:21.554127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:34.116 01:49:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:34.116 01:49:22 -- common/autotest_common.sh@862 -- # return 0 00:13:34.116 01:49:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:34.116 01:49:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:34.116 01:49:22 -- common/autotest_common.sh@10 -- # set +x 00:13:34.116 01:49:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:34.116 01:49:22 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:34.116 01:49:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.116 01:49:22 -- common/autotest_common.sh@10 -- # set +x 00:13:34.116 [2024-11-19 01:49:22.367555] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:34.116 01:49:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.116 01:49:22 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:34.116 01:49:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.116 01:49:22 -- common/autotest_common.sh@10 -- # set +x 00:13:34.116 01:49:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.116 01:49:22 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.116 01:49:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.116 01:49:22 -- common/autotest_common.sh@10 -- # set +x 00:13:34.116 [2024-11-19 01:49:22.399799] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.116 01:49:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.116 01:49:22 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:34.116 01:49:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.116 01:49:22 -- common/autotest_common.sh@10 -- # set +x 00:13:34.116 NULL1 00:13:34.116 01:49:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.116 01:49:22 -- target/connect_stress.sh@21 -- # PERF_PID=3408157 00:13:34.116 01:49:22 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:34.117 01:49:22 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:34.117 01:49:22 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 EAL: No free 2048 kB hugepages reported on node 1 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:34.117 01:49:22 -- target/connect_stress.sh@28 -- # cat 00:13:34.117 01:49:22 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:34.117 01:49:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.117 01:49:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.117 01:49:22 -- common/autotest_common.sh@10 -- # set +x 00:13:34.375 01:49:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.375 01:49:22 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:34.375 01:49:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.375 01:49:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.375 01:49:22 -- common/autotest_common.sh@10 -- # set +x 00:13:34.632 01:49:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.632 01:49:23 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:34.632 01:49:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.632 01:49:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.632 01:49:23 -- common/autotest_common.sh@10 -- # set +x 00:13:34.890 01:49:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.890 01:49:23 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:34.890 01:49:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.890 01:49:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.890 01:49:23 -- common/autotest_common.sh@10 -- # set +x 00:13:35.456 01:49:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.456 01:49:23 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:35.456 01:49:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.456 01:49:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.456 01:49:23 -- common/autotest_common.sh@10 -- # set +x 00:13:35.714 01:49:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.714 01:49:24 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:35.714 01:49:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.714 01:49:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.714 01:49:24 -- common/autotest_common.sh@10 -- # set +x 00:13:35.971 01:49:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.971 01:49:24 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:35.971 01:49:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.971 01:49:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.971 01:49:24 -- common/autotest_common.sh@10 -- # set +x 00:13:36.229 01:49:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.229 01:49:24 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:36.229 01:49:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.229 01:49:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.229 01:49:24 -- common/autotest_common.sh@10 -- # set +x 00:13:36.487 01:49:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.487 01:49:25 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:36.487 01:49:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.487 01:49:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.487 01:49:25 -- common/autotest_common.sh@10 -- # set +x 00:13:37.052 01:49:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.052 01:49:25 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:37.052 01:49:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.052 01:49:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.052 01:49:25 -- common/autotest_common.sh@10 -- # set +x 00:13:37.310 01:49:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.310 01:49:25 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:37.310 01:49:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.310 01:49:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.310 01:49:25 -- common/autotest_common.sh@10 -- # set +x 00:13:37.567 01:49:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.567 01:49:25 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:37.567 01:49:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.567 01:49:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.567 01:49:25 -- common/autotest_common.sh@10 -- # set +x 00:13:37.825 01:49:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.825 01:49:26 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:37.825 01:49:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.825 01:49:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.825 01:49:26 -- common/autotest_common.sh@10 -- # set +x 00:13:38.391 01:49:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.391 01:49:26 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:38.391 01:49:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.391 01:49:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.391 01:49:26 -- common/autotest_common.sh@10 -- # set +x 00:13:38.649 01:49:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.649 01:49:26 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:38.649 01:49:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.649 01:49:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.649 01:49:26 -- common/autotest_common.sh@10 -- # set +x 00:13:38.907 01:49:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.907 01:49:27 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:38.907 01:49:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.907 01:49:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.907 01:49:27 -- common/autotest_common.sh@10 -- # set +x 00:13:39.165 01:49:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.165 01:49:27 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:39.165 01:49:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.165 01:49:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.165 01:49:27 -- common/autotest_common.sh@10 -- # set +x 00:13:39.422 01:49:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.423 01:49:27 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:39.423 01:49:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.423 01:49:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.423 01:49:27 -- common/autotest_common.sh@10 -- # set +x 00:13:39.988 01:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.988 01:49:28 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:39.988 01:49:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.988 01:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.988 01:49:28 -- common/autotest_common.sh@10 -- # set +x 00:13:40.246 01:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.246 01:49:28 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:40.246 01:49:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.246 01:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.246 01:49:28 -- common/autotest_common.sh@10 -- # set +x 00:13:40.503 01:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.503 01:49:28 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:40.503 01:49:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.503 01:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.503 01:49:28 -- common/autotest_common.sh@10 -- # set +x 00:13:40.767 01:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.767 01:49:29 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:40.767 01:49:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.767 01:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.767 01:49:29 -- common/autotest_common.sh@10 -- # set +x 00:13:41.025 01:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.025 01:49:29 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:41.025 01:49:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.025 01:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.025 01:49:29 -- common/autotest_common.sh@10 -- # set +x 00:13:41.590 01:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.590 01:49:29 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:41.590 01:49:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.590 01:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.590 01:49:29 -- common/autotest_common.sh@10 -- # set +x 00:13:41.848 01:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.848 01:49:30 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:41.848 01:49:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.848 01:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.848 01:49:30 -- common/autotest_common.sh@10 -- # set +x 00:13:42.106 01:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.106 01:49:30 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:42.106 01:49:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.106 01:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.106 01:49:30 -- common/autotest_common.sh@10 -- # set +x 00:13:42.363 01:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.363 01:49:30 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:42.363 01:49:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.363 01:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.363 01:49:30 -- common/autotest_common.sh@10 -- # set +x 00:13:42.621 01:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.621 01:49:31 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:42.621 01:49:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.621 01:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.621 01:49:31 -- common/autotest_common.sh@10 -- # set +x 00:13:43.186 01:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.186 01:49:31 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:43.186 01:49:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.186 01:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.186 01:49:31 -- common/autotest_common.sh@10 -- # set +x 00:13:43.445 01:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.445 01:49:31 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:43.445 01:49:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.445 01:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.445 01:49:31 -- common/autotest_common.sh@10 -- # set +x 00:13:43.702 01:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.702 01:49:32 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:43.702 01:49:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.702 01:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.702 01:49:32 -- common/autotest_common.sh@10 -- # set +x 00:13:43.960 01:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.960 01:49:32 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:43.960 01:49:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.960 01:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.960 01:49:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.218 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:44.218 01:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.218 01:49:32 -- target/connect_stress.sh@34 -- # kill -0 3408157 00:13:44.218 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3408157) - No such process 00:13:44.218 01:49:32 -- target/connect_stress.sh@38 -- # wait 3408157 00:13:44.218 01:49:32 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:44.218 01:49:32 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:44.218 01:49:32 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:44.218 01:49:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.218 01:49:32 -- nvmf/common.sh@116 -- # sync 00:13:44.218 01:49:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.218 01:49:32 -- nvmf/common.sh@119 -- # set +e 00:13:44.218 01:49:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.218 01:49:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.218 rmmod nvme_tcp 00:13:44.218 rmmod nvme_fabrics 00:13:44.475 rmmod nvme_keyring 00:13:44.475 01:49:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.475 01:49:32 -- nvmf/common.sh@123 -- # set -e 00:13:44.475 01:49:32 -- nvmf/common.sh@124 -- # return 0 00:13:44.475 01:49:32 -- nvmf/common.sh@477 -- # '[' -n 3408004 ']' 00:13:44.475 01:49:32 -- nvmf/common.sh@478 -- # killprocess 3408004 00:13:44.475 01:49:32 -- common/autotest_common.sh@936 -- # '[' -z 3408004 ']' 00:13:44.475 01:49:32 -- common/autotest_common.sh@940 -- # kill -0 3408004 00:13:44.475 01:49:32 -- common/autotest_common.sh@941 -- # uname 00:13:44.475 01:49:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:44.475 01:49:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3408004 00:13:44.475 01:49:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:44.475 01:49:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:44.475 01:49:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3408004' 00:13:44.475 killing process with pid 3408004 00:13:44.475 01:49:32 -- common/autotest_common.sh@955 -- # kill 3408004 00:13:44.475 01:49:32 -- common/autotest_common.sh@960 -- # wait 3408004 00:13:44.733 01:49:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.733 01:49:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.733 01:49:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.733 01:49:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.733 01:49:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.733 01:49:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.733 01:49:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.733 01:49:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.634 01:49:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:46.634 00:13:46.634 real 0m16.212s 00:13:46.634 user 0m41.012s 00:13:46.634 sys 0m5.794s 00:13:46.634 01:49:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:46.634 01:49:35 -- common/autotest_common.sh@10 -- # set +x 00:13:46.634 ************************************ 00:13:46.634 END TEST nvmf_connect_stress 00:13:46.634 ************************************ 00:13:46.634 01:49:35 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:46.634 01:49:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:46.634 01:49:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:46.634 01:49:35 -- common/autotest_common.sh@10 -- # set +x 00:13:46.634 ************************************ 00:13:46.634 START TEST nvmf_fused_ordering 00:13:46.634 ************************************ 00:13:46.634 01:49:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:46.893 * Looking for test storage... 00:13:46.893 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:46.893 01:49:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:46.893 01:49:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:46.893 01:49:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:46.893 01:49:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:46.893 01:49:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:46.893 01:49:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:46.893 01:49:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:46.893 01:49:35 -- scripts/common.sh@335 -- # IFS=.-: 00:13:46.893 01:49:35 -- scripts/common.sh@335 -- # read -ra ver1 00:13:46.893 01:49:35 -- scripts/common.sh@336 -- # IFS=.-: 00:13:46.893 01:49:35 -- scripts/common.sh@336 -- # read -ra ver2 00:13:46.893 01:49:35 -- scripts/common.sh@337 -- # local 'op=<' 00:13:46.893 01:49:35 -- scripts/common.sh@339 -- # ver1_l=2 00:13:46.893 01:49:35 -- scripts/common.sh@340 -- # ver2_l=1 00:13:46.893 01:49:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:46.893 01:49:35 -- scripts/common.sh@343 -- # case "$op" in 00:13:46.893 01:49:35 -- scripts/common.sh@344 -- # : 1 00:13:46.893 01:49:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:46.893 01:49:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:46.893 01:49:35 -- scripts/common.sh@364 -- # decimal 1 00:13:46.893 01:49:35 -- scripts/common.sh@352 -- # local d=1 00:13:46.893 01:49:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:46.893 01:49:35 -- scripts/common.sh@354 -- # echo 1 00:13:46.893 01:49:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:46.893 01:49:35 -- scripts/common.sh@365 -- # decimal 2 00:13:46.893 01:49:35 -- scripts/common.sh@352 -- # local d=2 00:13:46.893 01:49:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:46.893 01:49:35 -- scripts/common.sh@354 -- # echo 2 00:13:46.893 01:49:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:46.893 01:49:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:46.893 01:49:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:46.893 01:49:35 -- scripts/common.sh@367 -- # return 0 00:13:46.893 01:49:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:46.893 01:49:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:46.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.893 --rc genhtml_branch_coverage=1 00:13:46.893 --rc genhtml_function_coverage=1 00:13:46.893 --rc genhtml_legend=1 00:13:46.893 --rc geninfo_all_blocks=1 00:13:46.893 --rc geninfo_unexecuted_blocks=1 00:13:46.893 00:13:46.893 ' 00:13:46.893 01:49:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:46.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.893 --rc genhtml_branch_coverage=1 00:13:46.893 --rc genhtml_function_coverage=1 00:13:46.893 --rc genhtml_legend=1 00:13:46.893 --rc geninfo_all_blocks=1 00:13:46.893 --rc geninfo_unexecuted_blocks=1 00:13:46.893 00:13:46.893 ' 00:13:46.893 01:49:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:46.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.893 --rc genhtml_branch_coverage=1 00:13:46.893 --rc genhtml_function_coverage=1 00:13:46.893 --rc genhtml_legend=1 00:13:46.893 --rc geninfo_all_blocks=1 00:13:46.893 --rc geninfo_unexecuted_blocks=1 00:13:46.893 00:13:46.893 ' 00:13:46.893 01:49:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:46.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.893 --rc genhtml_branch_coverage=1 00:13:46.893 --rc genhtml_function_coverage=1 00:13:46.893 --rc genhtml_legend=1 00:13:46.893 --rc geninfo_all_blocks=1 00:13:46.893 --rc geninfo_unexecuted_blocks=1 00:13:46.893 00:13:46.893 ' 00:13:46.893 01:49:35 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:46.893 01:49:35 -- nvmf/common.sh@7 -- # uname -s 00:13:46.893 01:49:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:46.893 01:49:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:46.893 01:49:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:46.893 01:49:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:46.893 01:49:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:46.893 01:49:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:46.893 01:49:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:46.893 01:49:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:46.893 01:49:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:46.893 01:49:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:46.893 01:49:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.893 01:49:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.893 01:49:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:46.893 01:49:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:46.893 01:49:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:46.893 01:49:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:46.893 01:49:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:46.893 01:49:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:46.893 01:49:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:46.893 01:49:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.893 01:49:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.893 01:49:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.893 01:49:35 -- paths/export.sh@5 -- # export PATH 00:13:46.893 01:49:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.893 01:49:35 -- nvmf/common.sh@46 -- # : 0 00:13:46.893 01:49:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:46.893 01:49:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:46.893 01:49:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:46.893 01:49:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:46.893 01:49:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:46.893 01:49:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:46.894 01:49:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:46.894 01:49:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:46.894 01:49:35 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:46.894 01:49:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:46.894 01:49:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:46.894 01:49:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:46.894 01:49:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:46.894 01:49:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:46.894 01:49:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.894 01:49:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.894 01:49:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.894 01:49:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:46.894 01:49:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:46.894 01:49:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:46.894 01:49:35 -- common/autotest_common.sh@10 -- # set +x 00:13:48.795 01:49:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:48.795 01:49:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:48.795 01:49:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:48.795 01:49:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:48.795 01:49:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:48.795 01:49:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:48.795 01:49:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:48.795 01:49:37 -- nvmf/common.sh@294 -- # net_devs=() 00:13:48.795 01:49:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:48.795 01:49:37 -- nvmf/common.sh@295 -- # e810=() 00:13:48.795 01:49:37 -- nvmf/common.sh@295 -- # local -ga e810 00:13:48.795 01:49:37 -- nvmf/common.sh@296 -- # x722=() 00:13:48.795 01:49:37 -- nvmf/common.sh@296 -- # local -ga x722 00:13:48.795 01:49:37 -- nvmf/common.sh@297 -- # mlx=() 00:13:48.795 01:49:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:48.795 01:49:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:48.795 01:49:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:48.795 01:49:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:48.795 01:49:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:48.795 01:49:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.795 01:49:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:48.795 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:48.795 01:49:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.795 01:49:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:48.795 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:48.795 01:49:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:48.795 01:49:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.795 01:49:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.795 01:49:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.795 01:49:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.795 01:49:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:48.795 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:48.795 01:49:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.795 01:49:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.795 01:49:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.795 01:49:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.795 01:49:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.795 01:49:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:48.795 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:48.795 01:49:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.795 01:49:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:48.795 01:49:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:48.795 01:49:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:48.795 01:49:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:48.795 01:49:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.795 01:49:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:48.795 01:49:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:48.795 01:49:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:48.795 01:49:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:48.795 01:49:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:48.795 01:49:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:48.795 01:49:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:48.795 01:49:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.795 01:49:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:48.795 01:49:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:48.795 01:49:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:48.795 01:49:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:48.795 01:49:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:48.795 01:49:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:49.054 01:49:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:49.054 01:49:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:49.054 01:49:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:49.054 01:49:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:49.054 01:49:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:49.054 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:49.054 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:13:49.054 00:13:49.054 --- 10.0.0.2 ping statistics --- 00:13:49.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.054 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:13:49.054 01:49:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:49.054 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:49.054 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:13:49.054 00:13:49.054 --- 10.0.0.1 ping statistics --- 00:13:49.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.054 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:13:49.054 01:49:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:49.054 01:49:37 -- nvmf/common.sh@410 -- # return 0 00:13:49.054 01:49:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:49.054 01:49:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:49.054 01:49:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:49.054 01:49:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:49.054 01:49:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:49.054 01:49:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:49.054 01:49:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:49.054 01:49:37 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:49.054 01:49:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:49.054 01:49:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:49.054 01:49:37 -- common/autotest_common.sh@10 -- # set +x 00:13:49.054 01:49:37 -- nvmf/common.sh@469 -- # nvmfpid=3411353 00:13:49.054 01:49:37 -- nvmf/common.sh@470 -- # waitforlisten 3411353 00:13:49.054 01:49:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:49.054 01:49:37 -- common/autotest_common.sh@829 -- # '[' -z 3411353 ']' 00:13:49.054 01:49:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:49.054 01:49:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:49.054 01:49:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:49.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:49.054 01:49:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:49.054 01:49:37 -- common/autotest_common.sh@10 -- # set +x 00:13:49.054 [2024-11-19 01:49:37.462725] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:49.054 [2024-11-19 01:49:37.462810] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:49.054 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.054 [2024-11-19 01:49:37.530536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:49.312 [2024-11-19 01:49:37.643779] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:49.312 [2024-11-19 01:49:37.643940] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:49.312 [2024-11-19 01:49:37.643959] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:49.312 [2024-11-19 01:49:37.643973] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:49.312 [2024-11-19 01:49:37.644005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.878 01:49:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:49.878 01:49:38 -- common/autotest_common.sh@862 -- # return 0 00:13:49.878 01:49:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:49.878 01:49:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:49.878 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.136 01:49:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.136 01:49:38 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:50.136 01:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.136 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.136 [2024-11-19 01:49:38.441962] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:50.136 01:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.136 01:49:38 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:50.136 01:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.136 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.136 01:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.136 01:49:38 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:50.136 01:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.136 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.136 [2024-11-19 01:49:38.458169] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:50.136 01:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.136 01:49:38 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:50.136 01:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.136 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.136 NULL1 00:13:50.136 01:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.136 01:49:38 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:50.136 01:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.136 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.136 01:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.136 01:49:38 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:50.136 01:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.136 01:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.136 01:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.136 01:49:38 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:50.136 [2024-11-19 01:49:38.502812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:50.136 [2024-11-19 01:49:38.502849] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3411516 ] 00:13:50.136 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.394 Attached to nqn.2016-06.io.spdk:cnode1 00:13:50.394 Namespace ID: 1 size: 1GB 00:13:50.394 fused_ordering(0) 00:13:50.394 fused_ordering(1) 00:13:50.394 fused_ordering(2) 00:13:50.394 fused_ordering(3) 00:13:50.394 fused_ordering(4) 00:13:50.394 fused_ordering(5) 00:13:50.394 fused_ordering(6) 00:13:50.394 fused_ordering(7) 00:13:50.394 fused_ordering(8) 00:13:50.394 fused_ordering(9) 00:13:50.394 fused_ordering(10) 00:13:50.394 fused_ordering(11) 00:13:50.394 fused_ordering(12) 00:13:50.394 fused_ordering(13) 00:13:50.394 fused_ordering(14) 00:13:50.394 fused_ordering(15) 00:13:50.394 fused_ordering(16) 00:13:50.394 fused_ordering(17) 00:13:50.394 fused_ordering(18) 00:13:50.394 fused_ordering(19) 00:13:50.394 fused_ordering(20) 00:13:50.394 fused_ordering(21) 00:13:50.394 fused_ordering(22) 00:13:50.394 fused_ordering(23) 00:13:50.394 fused_ordering(24) 00:13:50.394 fused_ordering(25) 00:13:50.394 fused_ordering(26) 00:13:50.394 fused_ordering(27) 00:13:50.394 fused_ordering(28) 00:13:50.394 fused_ordering(29) 00:13:50.394 fused_ordering(30) 00:13:50.394 fused_ordering(31) 00:13:50.394 fused_ordering(32) 00:13:50.394 fused_ordering(33) 00:13:50.394 fused_ordering(34) 00:13:50.394 fused_ordering(35) 00:13:50.394 fused_ordering(36) 00:13:50.394 fused_ordering(37) 00:13:50.394 fused_ordering(38) 00:13:50.394 fused_ordering(39) 00:13:50.394 fused_ordering(40) 00:13:50.394 fused_ordering(41) 00:13:50.394 fused_ordering(42) 00:13:50.394 fused_ordering(43) 00:13:50.394 fused_ordering(44) 00:13:50.394 fused_ordering(45) 00:13:50.394 fused_ordering(46) 00:13:50.394 fused_ordering(47) 00:13:50.394 fused_ordering(48) 00:13:50.394 fused_ordering(49) 00:13:50.394 fused_ordering(50) 00:13:50.394 fused_ordering(51) 00:13:50.394 fused_ordering(52) 00:13:50.394 fused_ordering(53) 00:13:50.394 fused_ordering(54) 00:13:50.394 fused_ordering(55) 00:13:50.394 fused_ordering(56) 00:13:50.394 fused_ordering(57) 00:13:50.394 fused_ordering(58) 00:13:50.394 fused_ordering(59) 00:13:50.394 fused_ordering(60) 00:13:50.394 fused_ordering(61) 00:13:50.394 fused_ordering(62) 00:13:50.394 fused_ordering(63) 00:13:50.394 fused_ordering(64) 00:13:50.394 fused_ordering(65) 00:13:50.394 fused_ordering(66) 00:13:50.394 fused_ordering(67) 00:13:50.394 fused_ordering(68) 00:13:50.394 fused_ordering(69) 00:13:50.394 fused_ordering(70) 00:13:50.394 fused_ordering(71) 00:13:50.394 fused_ordering(72) 00:13:50.394 fused_ordering(73) 00:13:50.394 fused_ordering(74) 00:13:50.394 fused_ordering(75) 00:13:50.394 fused_ordering(76) 00:13:50.394 fused_ordering(77) 00:13:50.394 fused_ordering(78) 00:13:50.394 fused_ordering(79) 00:13:50.394 fused_ordering(80) 00:13:50.394 fused_ordering(81) 00:13:50.394 fused_ordering(82) 00:13:50.394 fused_ordering(83) 00:13:50.394 fused_ordering(84) 00:13:50.394 fused_ordering(85) 00:13:50.394 fused_ordering(86) 00:13:50.394 fused_ordering(87) 00:13:50.394 fused_ordering(88) 00:13:50.394 fused_ordering(89) 00:13:50.394 fused_ordering(90) 00:13:50.394 fused_ordering(91) 00:13:50.394 fused_ordering(92) 00:13:50.394 fused_ordering(93) 00:13:50.394 fused_ordering(94) 00:13:50.394 fused_ordering(95) 00:13:50.394 fused_ordering(96) 00:13:50.394 fused_ordering(97) 00:13:50.394 fused_ordering(98) 00:13:50.394 fused_ordering(99) 00:13:50.394 fused_ordering(100) 00:13:50.394 fused_ordering(101) 00:13:50.394 fused_ordering(102) 00:13:50.394 fused_ordering(103) 00:13:50.394 fused_ordering(104) 00:13:50.394 fused_ordering(105) 00:13:50.394 fused_ordering(106) 00:13:50.394 fused_ordering(107) 00:13:50.394 fused_ordering(108) 00:13:50.394 fused_ordering(109) 00:13:50.394 fused_ordering(110) 00:13:50.394 fused_ordering(111) 00:13:50.394 fused_ordering(112) 00:13:50.394 fused_ordering(113) 00:13:50.394 fused_ordering(114) 00:13:50.394 fused_ordering(115) 00:13:50.394 fused_ordering(116) 00:13:50.394 fused_ordering(117) 00:13:50.394 fused_ordering(118) 00:13:50.394 fused_ordering(119) 00:13:50.394 fused_ordering(120) 00:13:50.395 fused_ordering(121) 00:13:50.395 fused_ordering(122) 00:13:50.395 fused_ordering(123) 00:13:50.395 fused_ordering(124) 00:13:50.395 fused_ordering(125) 00:13:50.395 fused_ordering(126) 00:13:50.395 fused_ordering(127) 00:13:50.395 fused_ordering(128) 00:13:50.395 fused_ordering(129) 00:13:50.395 fused_ordering(130) 00:13:50.395 fused_ordering(131) 00:13:50.395 fused_ordering(132) 00:13:50.395 fused_ordering(133) 00:13:50.395 fused_ordering(134) 00:13:50.395 fused_ordering(135) 00:13:50.395 fused_ordering(136) 00:13:50.395 fused_ordering(137) 00:13:50.395 fused_ordering(138) 00:13:50.395 fused_ordering(139) 00:13:50.395 fused_ordering(140) 00:13:50.395 fused_ordering(141) 00:13:50.395 fused_ordering(142) 00:13:50.395 fused_ordering(143) 00:13:50.395 fused_ordering(144) 00:13:50.395 fused_ordering(145) 00:13:50.395 fused_ordering(146) 00:13:50.395 fused_ordering(147) 00:13:50.395 fused_ordering(148) 00:13:50.395 fused_ordering(149) 00:13:50.395 fused_ordering(150) 00:13:50.395 fused_ordering(151) 00:13:50.395 fused_ordering(152) 00:13:50.395 fused_ordering(153) 00:13:50.395 fused_ordering(154) 00:13:50.395 fused_ordering(155) 00:13:50.395 fused_ordering(156) 00:13:50.395 fused_ordering(157) 00:13:50.395 fused_ordering(158) 00:13:50.395 fused_ordering(159) 00:13:50.395 fused_ordering(160) 00:13:50.395 fused_ordering(161) 00:13:50.395 fused_ordering(162) 00:13:50.395 fused_ordering(163) 00:13:50.395 fused_ordering(164) 00:13:50.395 fused_ordering(165) 00:13:50.395 fused_ordering(166) 00:13:50.395 fused_ordering(167) 00:13:50.395 fused_ordering(168) 00:13:50.395 fused_ordering(169) 00:13:50.395 fused_ordering(170) 00:13:50.395 fused_ordering(171) 00:13:50.395 fused_ordering(172) 00:13:50.395 fused_ordering(173) 00:13:50.395 fused_ordering(174) 00:13:50.395 fused_ordering(175) 00:13:50.395 fused_ordering(176) 00:13:50.395 fused_ordering(177) 00:13:50.395 fused_ordering(178) 00:13:50.395 fused_ordering(179) 00:13:50.395 fused_ordering(180) 00:13:50.395 fused_ordering(181) 00:13:50.395 fused_ordering(182) 00:13:50.395 fused_ordering(183) 00:13:50.395 fused_ordering(184) 00:13:50.395 fused_ordering(185) 00:13:50.395 fused_ordering(186) 00:13:50.395 fused_ordering(187) 00:13:50.395 fused_ordering(188) 00:13:50.395 fused_ordering(189) 00:13:50.395 fused_ordering(190) 00:13:50.395 fused_ordering(191) 00:13:50.395 fused_ordering(192) 00:13:50.395 fused_ordering(193) 00:13:50.395 fused_ordering(194) 00:13:50.395 fused_ordering(195) 00:13:50.395 fused_ordering(196) 00:13:50.395 fused_ordering(197) 00:13:50.395 fused_ordering(198) 00:13:50.395 fused_ordering(199) 00:13:50.395 fused_ordering(200) 00:13:50.395 fused_ordering(201) 00:13:50.395 fused_ordering(202) 00:13:50.395 fused_ordering(203) 00:13:50.395 fused_ordering(204) 00:13:50.395 fused_ordering(205) 00:13:50.960 fused_ordering(206) 00:13:50.960 fused_ordering(207) 00:13:50.960 fused_ordering(208) 00:13:50.960 fused_ordering(209) 00:13:50.960 fused_ordering(210) 00:13:50.960 fused_ordering(211) 00:13:50.960 fused_ordering(212) 00:13:50.960 fused_ordering(213) 00:13:50.960 fused_ordering(214) 00:13:50.960 fused_ordering(215) 00:13:50.960 fused_ordering(216) 00:13:50.960 fused_ordering(217) 00:13:50.960 fused_ordering(218) 00:13:50.960 fused_ordering(219) 00:13:50.960 fused_ordering(220) 00:13:50.960 fused_ordering(221) 00:13:50.960 fused_ordering(222) 00:13:50.960 fused_ordering(223) 00:13:50.960 fused_ordering(224) 00:13:50.960 fused_ordering(225) 00:13:50.960 fused_ordering(226) 00:13:50.960 fused_ordering(227) 00:13:50.960 fused_ordering(228) 00:13:50.960 fused_ordering(229) 00:13:50.960 fused_ordering(230) 00:13:50.960 fused_ordering(231) 00:13:50.960 fused_ordering(232) 00:13:50.960 fused_ordering(233) 00:13:50.960 fused_ordering(234) 00:13:50.960 fused_ordering(235) 00:13:50.960 fused_ordering(236) 00:13:50.960 fused_ordering(237) 00:13:50.960 fused_ordering(238) 00:13:50.960 fused_ordering(239) 00:13:50.960 fused_ordering(240) 00:13:50.960 fused_ordering(241) 00:13:50.960 fused_ordering(242) 00:13:50.960 fused_ordering(243) 00:13:50.960 fused_ordering(244) 00:13:50.960 fused_ordering(245) 00:13:50.960 fused_ordering(246) 00:13:50.960 fused_ordering(247) 00:13:50.960 fused_ordering(248) 00:13:50.960 fused_ordering(249) 00:13:50.960 fused_ordering(250) 00:13:50.960 fused_ordering(251) 00:13:50.960 fused_ordering(252) 00:13:50.960 fused_ordering(253) 00:13:50.960 fused_ordering(254) 00:13:50.960 fused_ordering(255) 00:13:50.960 fused_ordering(256) 00:13:50.960 fused_ordering(257) 00:13:50.960 fused_ordering(258) 00:13:50.960 fused_ordering(259) 00:13:50.960 fused_ordering(260) 00:13:50.960 fused_ordering(261) 00:13:50.960 fused_ordering(262) 00:13:50.960 fused_ordering(263) 00:13:50.960 fused_ordering(264) 00:13:50.960 fused_ordering(265) 00:13:50.960 fused_ordering(266) 00:13:50.960 fused_ordering(267) 00:13:50.960 fused_ordering(268) 00:13:50.960 fused_ordering(269) 00:13:50.960 fused_ordering(270) 00:13:50.960 fused_ordering(271) 00:13:50.960 fused_ordering(272) 00:13:50.960 fused_ordering(273) 00:13:50.960 fused_ordering(274) 00:13:50.960 fused_ordering(275) 00:13:50.960 fused_ordering(276) 00:13:50.961 fused_ordering(277) 00:13:50.961 fused_ordering(278) 00:13:50.961 fused_ordering(279) 00:13:50.961 fused_ordering(280) 00:13:50.961 fused_ordering(281) 00:13:50.961 fused_ordering(282) 00:13:50.961 fused_ordering(283) 00:13:50.961 fused_ordering(284) 00:13:50.961 fused_ordering(285) 00:13:50.961 fused_ordering(286) 00:13:50.961 fused_ordering(287) 00:13:50.961 fused_ordering(288) 00:13:50.961 fused_ordering(289) 00:13:50.961 fused_ordering(290) 00:13:50.961 fused_ordering(291) 00:13:50.961 fused_ordering(292) 00:13:50.961 fused_ordering(293) 00:13:50.961 fused_ordering(294) 00:13:50.961 fused_ordering(295) 00:13:50.961 fused_ordering(296) 00:13:50.961 fused_ordering(297) 00:13:50.961 fused_ordering(298) 00:13:50.961 fused_ordering(299) 00:13:50.961 fused_ordering(300) 00:13:50.961 fused_ordering(301) 00:13:50.961 fused_ordering(302) 00:13:50.961 fused_ordering(303) 00:13:50.961 fused_ordering(304) 00:13:50.961 fused_ordering(305) 00:13:50.961 fused_ordering(306) 00:13:50.961 fused_ordering(307) 00:13:50.961 fused_ordering(308) 00:13:50.961 fused_ordering(309) 00:13:50.961 fused_ordering(310) 00:13:50.961 fused_ordering(311) 00:13:50.961 fused_ordering(312) 00:13:50.961 fused_ordering(313) 00:13:50.961 fused_ordering(314) 00:13:50.961 fused_ordering(315) 00:13:50.961 fused_ordering(316) 00:13:50.961 fused_ordering(317) 00:13:50.961 fused_ordering(318) 00:13:50.961 fused_ordering(319) 00:13:50.961 fused_ordering(320) 00:13:50.961 fused_ordering(321) 00:13:50.961 fused_ordering(322) 00:13:50.961 fused_ordering(323) 00:13:50.961 fused_ordering(324) 00:13:50.961 fused_ordering(325) 00:13:50.961 fused_ordering(326) 00:13:50.961 fused_ordering(327) 00:13:50.961 fused_ordering(328) 00:13:50.961 fused_ordering(329) 00:13:50.961 fused_ordering(330) 00:13:50.961 fused_ordering(331) 00:13:50.961 fused_ordering(332) 00:13:50.961 fused_ordering(333) 00:13:50.961 fused_ordering(334) 00:13:50.961 fused_ordering(335) 00:13:50.961 fused_ordering(336) 00:13:50.961 fused_ordering(337) 00:13:50.961 fused_ordering(338) 00:13:50.961 fused_ordering(339) 00:13:50.961 fused_ordering(340) 00:13:50.961 fused_ordering(341) 00:13:50.961 fused_ordering(342) 00:13:50.961 fused_ordering(343) 00:13:50.961 fused_ordering(344) 00:13:50.961 fused_ordering(345) 00:13:50.961 fused_ordering(346) 00:13:50.961 fused_ordering(347) 00:13:50.961 fused_ordering(348) 00:13:50.961 fused_ordering(349) 00:13:50.961 fused_ordering(350) 00:13:50.961 fused_ordering(351) 00:13:50.961 fused_ordering(352) 00:13:50.961 fused_ordering(353) 00:13:50.961 fused_ordering(354) 00:13:50.961 fused_ordering(355) 00:13:50.961 fused_ordering(356) 00:13:50.961 fused_ordering(357) 00:13:50.961 fused_ordering(358) 00:13:50.961 fused_ordering(359) 00:13:50.961 fused_ordering(360) 00:13:50.961 fused_ordering(361) 00:13:50.961 fused_ordering(362) 00:13:50.961 fused_ordering(363) 00:13:50.961 fused_ordering(364) 00:13:50.961 fused_ordering(365) 00:13:50.961 fused_ordering(366) 00:13:50.961 fused_ordering(367) 00:13:50.961 fused_ordering(368) 00:13:50.961 fused_ordering(369) 00:13:50.961 fused_ordering(370) 00:13:50.961 fused_ordering(371) 00:13:50.961 fused_ordering(372) 00:13:50.961 fused_ordering(373) 00:13:50.961 fused_ordering(374) 00:13:50.961 fused_ordering(375) 00:13:50.961 fused_ordering(376) 00:13:50.961 fused_ordering(377) 00:13:50.961 fused_ordering(378) 00:13:50.961 fused_ordering(379) 00:13:50.961 fused_ordering(380) 00:13:50.961 fused_ordering(381) 00:13:50.961 fused_ordering(382) 00:13:50.961 fused_ordering(383) 00:13:50.961 fused_ordering(384) 00:13:50.961 fused_ordering(385) 00:13:50.961 fused_ordering(386) 00:13:50.961 fused_ordering(387) 00:13:50.961 fused_ordering(388) 00:13:50.961 fused_ordering(389) 00:13:50.961 fused_ordering(390) 00:13:50.961 fused_ordering(391) 00:13:50.961 fused_ordering(392) 00:13:50.961 fused_ordering(393) 00:13:50.961 fused_ordering(394) 00:13:50.961 fused_ordering(395) 00:13:50.961 fused_ordering(396) 00:13:50.961 fused_ordering(397) 00:13:50.961 fused_ordering(398) 00:13:50.961 fused_ordering(399) 00:13:50.961 fused_ordering(400) 00:13:50.961 fused_ordering(401) 00:13:50.961 fused_ordering(402) 00:13:50.961 fused_ordering(403) 00:13:50.961 fused_ordering(404) 00:13:50.961 fused_ordering(405) 00:13:50.961 fused_ordering(406) 00:13:50.961 fused_ordering(407) 00:13:50.961 fused_ordering(408) 00:13:50.961 fused_ordering(409) 00:13:50.961 fused_ordering(410) 00:13:51.219 fused_ordering(411) 00:13:51.219 fused_ordering(412) 00:13:51.219 fused_ordering(413) 00:13:51.219 fused_ordering(414) 00:13:51.219 fused_ordering(415) 00:13:51.219 fused_ordering(416) 00:13:51.219 fused_ordering(417) 00:13:51.219 fused_ordering(418) 00:13:51.219 fused_ordering(419) 00:13:51.219 fused_ordering(420) 00:13:51.219 fused_ordering(421) 00:13:51.219 fused_ordering(422) 00:13:51.219 fused_ordering(423) 00:13:51.219 fused_ordering(424) 00:13:51.219 fused_ordering(425) 00:13:51.219 fused_ordering(426) 00:13:51.219 fused_ordering(427) 00:13:51.219 fused_ordering(428) 00:13:51.219 fused_ordering(429) 00:13:51.219 fused_ordering(430) 00:13:51.219 fused_ordering(431) 00:13:51.219 fused_ordering(432) 00:13:51.219 fused_ordering(433) 00:13:51.219 fused_ordering(434) 00:13:51.219 fused_ordering(435) 00:13:51.219 fused_ordering(436) 00:13:51.219 fused_ordering(437) 00:13:51.219 fused_ordering(438) 00:13:51.219 fused_ordering(439) 00:13:51.219 fused_ordering(440) 00:13:51.219 fused_ordering(441) 00:13:51.219 fused_ordering(442) 00:13:51.219 fused_ordering(443) 00:13:51.219 fused_ordering(444) 00:13:51.219 fused_ordering(445) 00:13:51.219 fused_ordering(446) 00:13:51.219 fused_ordering(447) 00:13:51.219 fused_ordering(448) 00:13:51.219 fused_ordering(449) 00:13:51.219 fused_ordering(450) 00:13:51.219 fused_ordering(451) 00:13:51.219 fused_ordering(452) 00:13:51.219 fused_ordering(453) 00:13:51.219 fused_ordering(454) 00:13:51.219 fused_ordering(455) 00:13:51.219 fused_ordering(456) 00:13:51.219 fused_ordering(457) 00:13:51.219 fused_ordering(458) 00:13:51.219 fused_ordering(459) 00:13:51.219 fused_ordering(460) 00:13:51.219 fused_ordering(461) 00:13:51.219 fused_ordering(462) 00:13:51.219 fused_ordering(463) 00:13:51.219 fused_ordering(464) 00:13:51.219 fused_ordering(465) 00:13:51.219 fused_ordering(466) 00:13:51.219 fused_ordering(467) 00:13:51.219 fused_ordering(468) 00:13:51.219 fused_ordering(469) 00:13:51.219 fused_ordering(470) 00:13:51.219 fused_ordering(471) 00:13:51.219 fused_ordering(472) 00:13:51.219 fused_ordering(473) 00:13:51.219 fused_ordering(474) 00:13:51.219 fused_ordering(475) 00:13:51.219 fused_ordering(476) 00:13:51.219 fused_ordering(477) 00:13:51.219 fused_ordering(478) 00:13:51.219 fused_ordering(479) 00:13:51.219 fused_ordering(480) 00:13:51.219 fused_ordering(481) 00:13:51.219 fused_ordering(482) 00:13:51.219 fused_ordering(483) 00:13:51.219 fused_ordering(484) 00:13:51.219 fused_ordering(485) 00:13:51.219 fused_ordering(486) 00:13:51.219 fused_ordering(487) 00:13:51.219 fused_ordering(488) 00:13:51.219 fused_ordering(489) 00:13:51.219 fused_ordering(490) 00:13:51.219 fused_ordering(491) 00:13:51.219 fused_ordering(492) 00:13:51.219 fused_ordering(493) 00:13:51.219 fused_ordering(494) 00:13:51.219 fused_ordering(495) 00:13:51.219 fused_ordering(496) 00:13:51.219 fused_ordering(497) 00:13:51.219 fused_ordering(498) 00:13:51.219 fused_ordering(499) 00:13:51.219 fused_ordering(500) 00:13:51.219 fused_ordering(501) 00:13:51.219 fused_ordering(502) 00:13:51.219 fused_ordering(503) 00:13:51.219 fused_ordering(504) 00:13:51.219 fused_ordering(505) 00:13:51.219 fused_ordering(506) 00:13:51.219 fused_ordering(507) 00:13:51.219 fused_ordering(508) 00:13:51.219 fused_ordering(509) 00:13:51.219 fused_ordering(510) 00:13:51.219 fused_ordering(511) 00:13:51.219 fused_ordering(512) 00:13:51.219 fused_ordering(513) 00:13:51.219 fused_ordering(514) 00:13:51.219 fused_ordering(515) 00:13:51.219 fused_ordering(516) 00:13:51.219 fused_ordering(517) 00:13:51.219 fused_ordering(518) 00:13:51.219 fused_ordering(519) 00:13:51.219 fused_ordering(520) 00:13:51.219 fused_ordering(521) 00:13:51.219 fused_ordering(522) 00:13:51.219 fused_ordering(523) 00:13:51.219 fused_ordering(524) 00:13:51.219 fused_ordering(525) 00:13:51.219 fused_ordering(526) 00:13:51.219 fused_ordering(527) 00:13:51.219 fused_ordering(528) 00:13:51.219 fused_ordering(529) 00:13:51.220 fused_ordering(530) 00:13:51.220 fused_ordering(531) 00:13:51.220 fused_ordering(532) 00:13:51.220 fused_ordering(533) 00:13:51.220 fused_ordering(534) 00:13:51.220 fused_ordering(535) 00:13:51.220 fused_ordering(536) 00:13:51.220 fused_ordering(537) 00:13:51.220 fused_ordering(538) 00:13:51.220 fused_ordering(539) 00:13:51.220 fused_ordering(540) 00:13:51.220 fused_ordering(541) 00:13:51.220 fused_ordering(542) 00:13:51.220 fused_ordering(543) 00:13:51.220 fused_ordering(544) 00:13:51.220 fused_ordering(545) 00:13:51.220 fused_ordering(546) 00:13:51.220 fused_ordering(547) 00:13:51.220 fused_ordering(548) 00:13:51.220 fused_ordering(549) 00:13:51.220 fused_ordering(550) 00:13:51.220 fused_ordering(551) 00:13:51.220 fused_ordering(552) 00:13:51.220 fused_ordering(553) 00:13:51.220 fused_ordering(554) 00:13:51.220 fused_ordering(555) 00:13:51.220 fused_ordering(556) 00:13:51.220 fused_ordering(557) 00:13:51.220 fused_ordering(558) 00:13:51.220 fused_ordering(559) 00:13:51.220 fused_ordering(560) 00:13:51.220 fused_ordering(561) 00:13:51.220 fused_ordering(562) 00:13:51.220 fused_ordering(563) 00:13:51.220 fused_ordering(564) 00:13:51.220 fused_ordering(565) 00:13:51.220 fused_ordering(566) 00:13:51.220 fused_ordering(567) 00:13:51.220 fused_ordering(568) 00:13:51.220 fused_ordering(569) 00:13:51.220 fused_ordering(570) 00:13:51.220 fused_ordering(571) 00:13:51.220 fused_ordering(572) 00:13:51.220 fused_ordering(573) 00:13:51.220 fused_ordering(574) 00:13:51.220 fused_ordering(575) 00:13:51.220 fused_ordering(576) 00:13:51.220 fused_ordering(577) 00:13:51.220 fused_ordering(578) 00:13:51.220 fused_ordering(579) 00:13:51.220 fused_ordering(580) 00:13:51.220 fused_ordering(581) 00:13:51.220 fused_ordering(582) 00:13:51.220 fused_ordering(583) 00:13:51.220 fused_ordering(584) 00:13:51.220 fused_ordering(585) 00:13:51.220 fused_ordering(586) 00:13:51.220 fused_ordering(587) 00:13:51.220 fused_ordering(588) 00:13:51.220 fused_ordering(589) 00:13:51.220 fused_ordering(590) 00:13:51.220 fused_ordering(591) 00:13:51.220 fused_ordering(592) 00:13:51.220 fused_ordering(593) 00:13:51.220 fused_ordering(594) 00:13:51.220 fused_ordering(595) 00:13:51.220 fused_ordering(596) 00:13:51.220 fused_ordering(597) 00:13:51.220 fused_ordering(598) 00:13:51.220 fused_ordering(599) 00:13:51.220 fused_ordering(600) 00:13:51.220 fused_ordering(601) 00:13:51.220 fused_ordering(602) 00:13:51.220 fused_ordering(603) 00:13:51.220 fused_ordering(604) 00:13:51.220 fused_ordering(605) 00:13:51.220 fused_ordering(606) 00:13:51.220 fused_ordering(607) 00:13:51.220 fused_ordering(608) 00:13:51.220 fused_ordering(609) 00:13:51.220 fused_ordering(610) 00:13:51.220 fused_ordering(611) 00:13:51.220 fused_ordering(612) 00:13:51.220 fused_ordering(613) 00:13:51.220 fused_ordering(614) 00:13:51.220 fused_ordering(615) 00:13:51.786 fused_ordering(616) 00:13:51.786 fused_ordering(617) 00:13:51.786 fused_ordering(618) 00:13:51.786 fused_ordering(619) 00:13:51.786 fused_ordering(620) 00:13:51.786 fused_ordering(621) 00:13:51.786 fused_ordering(622) 00:13:51.786 fused_ordering(623) 00:13:51.786 fused_ordering(624) 00:13:51.786 fused_ordering(625) 00:13:51.786 fused_ordering(626) 00:13:51.786 fused_ordering(627) 00:13:51.786 fused_ordering(628) 00:13:51.786 fused_ordering(629) 00:13:51.786 fused_ordering(630) 00:13:51.786 fused_ordering(631) 00:13:51.786 fused_ordering(632) 00:13:51.786 fused_ordering(633) 00:13:51.786 fused_ordering(634) 00:13:51.786 fused_ordering(635) 00:13:51.786 fused_ordering(636) 00:13:51.786 fused_ordering(637) 00:13:51.786 fused_ordering(638) 00:13:51.786 fused_ordering(639) 00:13:51.786 fused_ordering(640) 00:13:51.786 fused_ordering(641) 00:13:51.786 fused_ordering(642) 00:13:51.786 fused_ordering(643) 00:13:51.786 fused_ordering(644) 00:13:51.786 fused_ordering(645) 00:13:51.786 fused_ordering(646) 00:13:51.786 fused_ordering(647) 00:13:51.786 fused_ordering(648) 00:13:51.786 fused_ordering(649) 00:13:51.786 fused_ordering(650) 00:13:51.786 fused_ordering(651) 00:13:51.786 fused_ordering(652) 00:13:51.786 fused_ordering(653) 00:13:51.786 fused_ordering(654) 00:13:51.786 fused_ordering(655) 00:13:51.786 fused_ordering(656) 00:13:51.786 fused_ordering(657) 00:13:51.786 fused_ordering(658) 00:13:51.786 fused_ordering(659) 00:13:51.786 fused_ordering(660) 00:13:51.786 fused_ordering(661) 00:13:51.786 fused_ordering(662) 00:13:51.786 fused_ordering(663) 00:13:51.787 fused_ordering(664) 00:13:51.787 fused_ordering(665) 00:13:51.787 fused_ordering(666) 00:13:51.787 fused_ordering(667) 00:13:51.787 fused_ordering(668) 00:13:51.787 fused_ordering(669) 00:13:51.787 fused_ordering(670) 00:13:51.787 fused_ordering(671) 00:13:51.787 fused_ordering(672) 00:13:51.787 fused_ordering(673) 00:13:51.787 fused_ordering(674) 00:13:51.787 fused_ordering(675) 00:13:51.787 fused_ordering(676) 00:13:51.787 fused_ordering(677) 00:13:51.787 fused_ordering(678) 00:13:51.787 fused_ordering(679) 00:13:51.787 fused_ordering(680) 00:13:51.787 fused_ordering(681) 00:13:51.787 fused_ordering(682) 00:13:51.787 fused_ordering(683) 00:13:51.787 fused_ordering(684) 00:13:51.787 fused_ordering(685) 00:13:51.787 fused_ordering(686) 00:13:51.787 fused_ordering(687) 00:13:51.787 fused_ordering(688) 00:13:51.787 fused_ordering(689) 00:13:51.787 fused_ordering(690) 00:13:51.787 fused_ordering(691) 00:13:51.787 fused_ordering(692) 00:13:51.787 fused_ordering(693) 00:13:51.787 fused_ordering(694) 00:13:51.787 fused_ordering(695) 00:13:51.787 fused_ordering(696) 00:13:51.787 fused_ordering(697) 00:13:51.787 fused_ordering(698) 00:13:51.787 fused_ordering(699) 00:13:51.787 fused_ordering(700) 00:13:51.787 fused_ordering(701) 00:13:51.787 fused_ordering(702) 00:13:51.787 fused_ordering(703) 00:13:51.787 fused_ordering(704) 00:13:51.787 fused_ordering(705) 00:13:51.787 fused_ordering(706) 00:13:51.787 fused_ordering(707) 00:13:51.787 fused_ordering(708) 00:13:51.787 fused_ordering(709) 00:13:51.787 fused_ordering(710) 00:13:51.787 fused_ordering(711) 00:13:51.787 fused_ordering(712) 00:13:51.787 fused_ordering(713) 00:13:51.787 fused_ordering(714) 00:13:51.787 fused_ordering(715) 00:13:51.787 fused_ordering(716) 00:13:51.787 fused_ordering(717) 00:13:51.787 fused_ordering(718) 00:13:51.787 fused_ordering(719) 00:13:51.787 fused_ordering(720) 00:13:51.787 fused_ordering(721) 00:13:51.787 fused_ordering(722) 00:13:51.787 fused_ordering(723) 00:13:51.787 fused_ordering(724) 00:13:51.787 fused_ordering(725) 00:13:51.787 fused_ordering(726) 00:13:51.787 fused_ordering(727) 00:13:51.787 fused_ordering(728) 00:13:51.787 fused_ordering(729) 00:13:51.787 fused_ordering(730) 00:13:51.787 fused_ordering(731) 00:13:51.787 fused_ordering(732) 00:13:51.787 fused_ordering(733) 00:13:51.787 fused_ordering(734) 00:13:51.787 fused_ordering(735) 00:13:51.787 fused_ordering(736) 00:13:51.787 fused_ordering(737) 00:13:51.787 fused_ordering(738) 00:13:51.787 fused_ordering(739) 00:13:51.787 fused_ordering(740) 00:13:51.787 fused_ordering(741) 00:13:51.787 fused_ordering(742) 00:13:51.787 fused_ordering(743) 00:13:51.787 fused_ordering(744) 00:13:51.787 fused_ordering(745) 00:13:51.787 fused_ordering(746) 00:13:51.787 fused_ordering(747) 00:13:51.787 fused_ordering(748) 00:13:51.787 fused_ordering(749) 00:13:51.787 fused_ordering(750) 00:13:51.787 fused_ordering(751) 00:13:51.787 fused_ordering(752) 00:13:51.787 fused_ordering(753) 00:13:51.787 fused_ordering(754) 00:13:51.787 fused_ordering(755) 00:13:51.787 fused_ordering(756) 00:13:51.787 fused_ordering(757) 00:13:51.787 fused_ordering(758) 00:13:51.787 fused_ordering(759) 00:13:51.787 fused_ordering(760) 00:13:51.787 fused_ordering(761) 00:13:51.787 fused_ordering(762) 00:13:51.787 fused_ordering(763) 00:13:51.787 fused_ordering(764) 00:13:51.787 fused_ordering(765) 00:13:51.787 fused_ordering(766) 00:13:51.787 fused_ordering(767) 00:13:51.787 fused_ordering(768) 00:13:51.787 fused_ordering(769) 00:13:51.787 fused_ordering(770) 00:13:51.787 fused_ordering(771) 00:13:51.787 fused_ordering(772) 00:13:51.787 fused_ordering(773) 00:13:51.787 fused_ordering(774) 00:13:51.787 fused_ordering(775) 00:13:51.787 fused_ordering(776) 00:13:51.787 fused_ordering(777) 00:13:51.787 fused_ordering(778) 00:13:51.787 fused_ordering(779) 00:13:51.787 fused_ordering(780) 00:13:51.787 fused_ordering(781) 00:13:51.787 fused_ordering(782) 00:13:51.787 fused_ordering(783) 00:13:51.787 fused_ordering(784) 00:13:51.787 fused_ordering(785) 00:13:51.787 fused_ordering(786) 00:13:51.787 fused_ordering(787) 00:13:51.787 fused_ordering(788) 00:13:51.787 fused_ordering(789) 00:13:51.787 fused_ordering(790) 00:13:51.787 fused_ordering(791) 00:13:51.787 fused_ordering(792) 00:13:51.787 fused_ordering(793) 00:13:51.787 fused_ordering(794) 00:13:51.787 fused_ordering(795) 00:13:51.787 fused_ordering(796) 00:13:51.787 fused_ordering(797) 00:13:51.787 fused_ordering(798) 00:13:51.787 fused_ordering(799) 00:13:51.787 fused_ordering(800) 00:13:51.787 fused_ordering(801) 00:13:51.787 fused_ordering(802) 00:13:51.787 fused_ordering(803) 00:13:51.787 fused_ordering(804) 00:13:51.787 fused_ordering(805) 00:13:51.787 fused_ordering(806) 00:13:51.787 fused_ordering(807) 00:13:51.787 fused_ordering(808) 00:13:51.787 fused_ordering(809) 00:13:51.787 fused_ordering(810) 00:13:51.787 fused_ordering(811) 00:13:51.787 fused_ordering(812) 00:13:51.787 fused_ordering(813) 00:13:51.787 fused_ordering(814) 00:13:51.787 fused_ordering(815) 00:13:51.787 fused_ordering(816) 00:13:51.787 fused_ordering(817) 00:13:51.787 fused_ordering(818) 00:13:51.787 fused_ordering(819) 00:13:51.787 fused_ordering(820) 00:13:52.720 fused_ordering(821) 00:13:52.720 fused_ordering(822) 00:13:52.720 fused_ordering(823) 00:13:52.720 fused_ordering(824) 00:13:52.720 fused_ordering(825) 00:13:52.720 fused_ordering(826) 00:13:52.720 fused_ordering(827) 00:13:52.720 fused_ordering(828) 00:13:52.720 fused_ordering(829) 00:13:52.720 fused_ordering(830) 00:13:52.720 fused_ordering(831) 00:13:52.720 fused_ordering(832) 00:13:52.720 fused_ordering(833) 00:13:52.720 fused_ordering(834) 00:13:52.720 fused_ordering(835) 00:13:52.720 fused_ordering(836) 00:13:52.720 fused_ordering(837) 00:13:52.720 fused_ordering(838) 00:13:52.720 fused_ordering(839) 00:13:52.720 fused_ordering(840) 00:13:52.720 fused_ordering(841) 00:13:52.720 fused_ordering(842) 00:13:52.720 fused_ordering(843) 00:13:52.720 fused_ordering(844) 00:13:52.720 fused_ordering(845) 00:13:52.720 fused_ordering(846) 00:13:52.720 fused_ordering(847) 00:13:52.720 fused_ordering(848) 00:13:52.720 fused_ordering(849) 00:13:52.720 fused_ordering(850) 00:13:52.720 fused_ordering(851) 00:13:52.720 fused_ordering(852) 00:13:52.720 fused_ordering(853) 00:13:52.720 fused_ordering(854) 00:13:52.720 fused_ordering(855) 00:13:52.720 fused_ordering(856) 00:13:52.720 fused_ordering(857) 00:13:52.720 fused_ordering(858) 00:13:52.720 fused_ordering(859) 00:13:52.720 fused_ordering(860) 00:13:52.720 fused_ordering(861) 00:13:52.720 fused_ordering(862) 00:13:52.720 fused_ordering(863) 00:13:52.720 fused_ordering(864) 00:13:52.720 fused_ordering(865) 00:13:52.720 fused_ordering(866) 00:13:52.720 fused_ordering(867) 00:13:52.720 fused_ordering(868) 00:13:52.720 fused_ordering(869) 00:13:52.720 fused_ordering(870) 00:13:52.720 fused_ordering(871) 00:13:52.720 fused_ordering(872) 00:13:52.720 fused_ordering(873) 00:13:52.720 fused_ordering(874) 00:13:52.720 fused_ordering(875) 00:13:52.720 fused_ordering(876) 00:13:52.720 fused_ordering(877) 00:13:52.720 fused_ordering(878) 00:13:52.720 fused_ordering(879) 00:13:52.720 fused_ordering(880) 00:13:52.720 fused_ordering(881) 00:13:52.720 fused_ordering(882) 00:13:52.720 fused_ordering(883) 00:13:52.720 fused_ordering(884) 00:13:52.720 fused_ordering(885) 00:13:52.720 fused_ordering(886) 00:13:52.720 fused_ordering(887) 00:13:52.720 fused_ordering(888) 00:13:52.720 fused_ordering(889) 00:13:52.720 fused_ordering(890) 00:13:52.720 fused_ordering(891) 00:13:52.720 fused_ordering(892) 00:13:52.720 fused_ordering(893) 00:13:52.720 fused_ordering(894) 00:13:52.720 fused_ordering(895) 00:13:52.720 fused_ordering(896) 00:13:52.720 fused_ordering(897) 00:13:52.720 fused_ordering(898) 00:13:52.720 fused_ordering(899) 00:13:52.720 fused_ordering(900) 00:13:52.720 fused_ordering(901) 00:13:52.720 fused_ordering(902) 00:13:52.720 fused_ordering(903) 00:13:52.720 fused_ordering(904) 00:13:52.720 fused_ordering(905) 00:13:52.720 fused_ordering(906) 00:13:52.720 fused_ordering(907) 00:13:52.720 fused_ordering(908) 00:13:52.720 fused_ordering(909) 00:13:52.720 fused_ordering(910) 00:13:52.720 fused_ordering(911) 00:13:52.720 fused_ordering(912) 00:13:52.720 fused_ordering(913) 00:13:52.720 fused_ordering(914) 00:13:52.720 fused_ordering(915) 00:13:52.720 fused_ordering(916) 00:13:52.720 fused_ordering(917) 00:13:52.720 fused_ordering(918) 00:13:52.720 fused_ordering(919) 00:13:52.720 fused_ordering(920) 00:13:52.720 fused_ordering(921) 00:13:52.720 fused_ordering(922) 00:13:52.720 fused_ordering(923) 00:13:52.720 fused_ordering(924) 00:13:52.720 fused_ordering(925) 00:13:52.720 fused_ordering(926) 00:13:52.720 fused_ordering(927) 00:13:52.721 fused_ordering(928) 00:13:52.721 fused_ordering(929) 00:13:52.721 fused_ordering(930) 00:13:52.721 fused_ordering(931) 00:13:52.721 fused_ordering(932) 00:13:52.721 fused_ordering(933) 00:13:52.721 fused_ordering(934) 00:13:52.721 fused_ordering(935) 00:13:52.721 fused_ordering(936) 00:13:52.721 fused_ordering(937) 00:13:52.721 fused_ordering(938) 00:13:52.721 fused_ordering(939) 00:13:52.721 fused_ordering(940) 00:13:52.721 fused_ordering(941) 00:13:52.721 fused_ordering(942) 00:13:52.721 fused_ordering(943) 00:13:52.721 fused_ordering(944) 00:13:52.721 fused_ordering(945) 00:13:52.721 fused_ordering(946) 00:13:52.721 fused_ordering(947) 00:13:52.721 fused_ordering(948) 00:13:52.721 fused_ordering(949) 00:13:52.721 fused_ordering(950) 00:13:52.721 fused_ordering(951) 00:13:52.721 fused_ordering(952) 00:13:52.721 fused_ordering(953) 00:13:52.721 fused_ordering(954) 00:13:52.721 fused_ordering(955) 00:13:52.721 fused_ordering(956) 00:13:52.721 fused_ordering(957) 00:13:52.721 fused_ordering(958) 00:13:52.721 fused_ordering(959) 00:13:52.721 fused_ordering(960) 00:13:52.721 fused_ordering(961) 00:13:52.721 fused_ordering(962) 00:13:52.721 fused_ordering(963) 00:13:52.721 fused_ordering(964) 00:13:52.721 fused_ordering(965) 00:13:52.721 fused_ordering(966) 00:13:52.721 fused_ordering(967) 00:13:52.721 fused_ordering(968) 00:13:52.721 fused_ordering(969) 00:13:52.721 fused_ordering(970) 00:13:52.721 fused_ordering(971) 00:13:52.721 fused_ordering(972) 00:13:52.721 fused_ordering(973) 00:13:52.721 fused_ordering(974) 00:13:52.721 fused_ordering(975) 00:13:52.721 fused_ordering(976) 00:13:52.721 fused_ordering(977) 00:13:52.721 fused_ordering(978) 00:13:52.721 fused_ordering(979) 00:13:52.721 fused_ordering(980) 00:13:52.721 fused_ordering(981) 00:13:52.721 fused_ordering(982) 00:13:52.721 fused_ordering(983) 00:13:52.721 fused_ordering(984) 00:13:52.721 fused_ordering(985) 00:13:52.721 fused_ordering(986) 00:13:52.721 fused_ordering(987) 00:13:52.721 fused_ordering(988) 00:13:52.721 fused_ordering(989) 00:13:52.721 fused_ordering(990) 00:13:52.721 fused_ordering(991) 00:13:52.721 fused_ordering(992) 00:13:52.721 fused_ordering(993) 00:13:52.721 fused_ordering(994) 00:13:52.721 fused_ordering(995) 00:13:52.721 fused_ordering(996) 00:13:52.721 fused_ordering(997) 00:13:52.721 fused_ordering(998) 00:13:52.721 fused_ordering(999) 00:13:52.721 fused_ordering(1000) 00:13:52.721 fused_ordering(1001) 00:13:52.721 fused_ordering(1002) 00:13:52.721 fused_ordering(1003) 00:13:52.721 fused_ordering(1004) 00:13:52.721 fused_ordering(1005) 00:13:52.721 fused_ordering(1006) 00:13:52.721 fused_ordering(1007) 00:13:52.721 fused_ordering(1008) 00:13:52.721 fused_ordering(1009) 00:13:52.721 fused_ordering(1010) 00:13:52.721 fused_ordering(1011) 00:13:52.721 fused_ordering(1012) 00:13:52.721 fused_ordering(1013) 00:13:52.721 fused_ordering(1014) 00:13:52.721 fused_ordering(1015) 00:13:52.721 fused_ordering(1016) 00:13:52.721 fused_ordering(1017) 00:13:52.721 fused_ordering(1018) 00:13:52.721 fused_ordering(1019) 00:13:52.721 fused_ordering(1020) 00:13:52.721 fused_ordering(1021) 00:13:52.721 fused_ordering(1022) 00:13:52.721 fused_ordering(1023) 00:13:52.721 01:49:40 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:52.721 01:49:40 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:52.721 01:49:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:52.721 01:49:40 -- nvmf/common.sh@116 -- # sync 00:13:52.721 01:49:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:52.721 01:49:40 -- nvmf/common.sh@119 -- # set +e 00:13:52.721 01:49:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:52.721 01:49:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:52.721 rmmod nvme_tcp 00:13:52.721 rmmod nvme_fabrics 00:13:52.721 rmmod nvme_keyring 00:13:52.721 01:49:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:52.721 01:49:40 -- nvmf/common.sh@123 -- # set -e 00:13:52.721 01:49:40 -- nvmf/common.sh@124 -- # return 0 00:13:52.721 01:49:40 -- nvmf/common.sh@477 -- # '[' -n 3411353 ']' 00:13:52.721 01:49:40 -- nvmf/common.sh@478 -- # killprocess 3411353 00:13:52.721 01:49:40 -- common/autotest_common.sh@936 -- # '[' -z 3411353 ']' 00:13:52.721 01:49:40 -- common/autotest_common.sh@940 -- # kill -0 3411353 00:13:52.721 01:49:40 -- common/autotest_common.sh@941 -- # uname 00:13:52.721 01:49:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:52.721 01:49:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3411353 00:13:52.721 01:49:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:52.721 01:49:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:52.721 01:49:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3411353' 00:13:52.721 killing process with pid 3411353 00:13:52.721 01:49:41 -- common/autotest_common.sh@955 -- # kill 3411353 00:13:52.721 01:49:41 -- common/autotest_common.sh@960 -- # wait 3411353 00:13:52.980 01:49:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:52.980 01:49:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:52.980 01:49:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:52.980 01:49:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:52.980 01:49:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:52.980 01:49:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.980 01:49:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.980 01:49:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:54.881 01:49:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:54.881 00:13:54.881 real 0m8.161s 00:13:54.881 user 0m6.003s 00:13:54.881 sys 0m3.154s 00:13:54.881 01:49:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:54.881 01:49:43 -- common/autotest_common.sh@10 -- # set +x 00:13:54.881 ************************************ 00:13:54.881 END TEST nvmf_fused_ordering 00:13:54.881 ************************************ 00:13:54.881 01:49:43 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:54.881 01:49:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:54.881 01:49:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:54.881 01:49:43 -- common/autotest_common.sh@10 -- # set +x 00:13:54.881 ************************************ 00:13:54.881 START TEST nvmf_delete_subsystem 00:13:54.881 ************************************ 00:13:54.881 01:49:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:54.881 * Looking for test storage... 00:13:54.881 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:55.139 01:49:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:55.139 01:49:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:55.139 01:49:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:55.139 01:49:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:55.139 01:49:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:55.139 01:49:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:55.139 01:49:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:55.139 01:49:43 -- scripts/common.sh@335 -- # IFS=.-: 00:13:55.139 01:49:43 -- scripts/common.sh@335 -- # read -ra ver1 00:13:55.139 01:49:43 -- scripts/common.sh@336 -- # IFS=.-: 00:13:55.139 01:49:43 -- scripts/common.sh@336 -- # read -ra ver2 00:13:55.139 01:49:43 -- scripts/common.sh@337 -- # local 'op=<' 00:13:55.139 01:49:43 -- scripts/common.sh@339 -- # ver1_l=2 00:13:55.139 01:49:43 -- scripts/common.sh@340 -- # ver2_l=1 00:13:55.139 01:49:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:55.139 01:49:43 -- scripts/common.sh@343 -- # case "$op" in 00:13:55.139 01:49:43 -- scripts/common.sh@344 -- # : 1 00:13:55.139 01:49:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:55.139 01:49:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:55.139 01:49:43 -- scripts/common.sh@364 -- # decimal 1 00:13:55.139 01:49:43 -- scripts/common.sh@352 -- # local d=1 00:13:55.139 01:49:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:55.139 01:49:43 -- scripts/common.sh@354 -- # echo 1 00:13:55.139 01:49:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:55.139 01:49:43 -- scripts/common.sh@365 -- # decimal 2 00:13:55.139 01:49:43 -- scripts/common.sh@352 -- # local d=2 00:13:55.139 01:49:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:55.139 01:49:43 -- scripts/common.sh@354 -- # echo 2 00:13:55.139 01:49:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:55.139 01:49:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:55.139 01:49:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:55.139 01:49:43 -- scripts/common.sh@367 -- # return 0 00:13:55.139 01:49:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:55.139 01:49:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:55.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.139 --rc genhtml_branch_coverage=1 00:13:55.139 --rc genhtml_function_coverage=1 00:13:55.139 --rc genhtml_legend=1 00:13:55.139 --rc geninfo_all_blocks=1 00:13:55.139 --rc geninfo_unexecuted_blocks=1 00:13:55.139 00:13:55.139 ' 00:13:55.139 01:49:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:55.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.139 --rc genhtml_branch_coverage=1 00:13:55.139 --rc genhtml_function_coverage=1 00:13:55.139 --rc genhtml_legend=1 00:13:55.139 --rc geninfo_all_blocks=1 00:13:55.139 --rc geninfo_unexecuted_blocks=1 00:13:55.139 00:13:55.139 ' 00:13:55.139 01:49:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:55.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.139 --rc genhtml_branch_coverage=1 00:13:55.139 --rc genhtml_function_coverage=1 00:13:55.139 --rc genhtml_legend=1 00:13:55.139 --rc geninfo_all_blocks=1 00:13:55.139 --rc geninfo_unexecuted_blocks=1 00:13:55.139 00:13:55.139 ' 00:13:55.139 01:49:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:55.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.139 --rc genhtml_branch_coverage=1 00:13:55.139 --rc genhtml_function_coverage=1 00:13:55.139 --rc genhtml_legend=1 00:13:55.139 --rc geninfo_all_blocks=1 00:13:55.139 --rc geninfo_unexecuted_blocks=1 00:13:55.139 00:13:55.139 ' 00:13:55.139 01:49:43 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:55.139 01:49:43 -- nvmf/common.sh@7 -- # uname -s 00:13:55.139 01:49:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:55.139 01:49:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:55.139 01:49:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:55.139 01:49:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:55.139 01:49:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:55.139 01:49:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:55.139 01:49:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:55.139 01:49:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:55.139 01:49:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:55.139 01:49:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:55.139 01:49:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.139 01:49:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.139 01:49:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:55.139 01:49:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:55.139 01:49:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:55.139 01:49:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:55.139 01:49:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:55.139 01:49:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:55.139 01:49:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:55.140 01:49:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.140 01:49:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.140 01:49:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.140 01:49:43 -- paths/export.sh@5 -- # export PATH 00:13:55.140 01:49:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.140 01:49:43 -- nvmf/common.sh@46 -- # : 0 00:13:55.140 01:49:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:55.140 01:49:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:55.140 01:49:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:55.140 01:49:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:55.140 01:49:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:55.140 01:49:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:55.140 01:49:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:55.140 01:49:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:55.140 01:49:43 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:55.140 01:49:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:55.140 01:49:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:55.140 01:49:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:55.140 01:49:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:55.140 01:49:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:55.140 01:49:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:55.140 01:49:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:55.140 01:49:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.140 01:49:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:55.140 01:49:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:55.140 01:49:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:55.140 01:49:43 -- common/autotest_common.sh@10 -- # set +x 00:13:57.059 01:49:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:57.059 01:49:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:57.059 01:49:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:57.059 01:49:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:57.059 01:49:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:57.059 01:49:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:57.059 01:49:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:57.059 01:49:45 -- nvmf/common.sh@294 -- # net_devs=() 00:13:57.059 01:49:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:57.059 01:49:45 -- nvmf/common.sh@295 -- # e810=() 00:13:57.059 01:49:45 -- nvmf/common.sh@295 -- # local -ga e810 00:13:57.059 01:49:45 -- nvmf/common.sh@296 -- # x722=() 00:13:57.059 01:49:45 -- nvmf/common.sh@296 -- # local -ga x722 00:13:57.059 01:49:45 -- nvmf/common.sh@297 -- # mlx=() 00:13:57.059 01:49:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:57.059 01:49:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:57.059 01:49:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:57.059 01:49:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:57.059 01:49:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:57.059 01:49:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:57.059 01:49:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:57.059 01:49:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:57.059 01:49:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.059 01:49:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:57.059 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:57.059 01:49:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.059 01:49:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.059 01:49:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.059 01:49:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.060 01:49:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:57.060 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:57.060 01:49:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:57.060 01:49:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.060 01:49:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.060 01:49:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.060 01:49:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.060 01:49:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:57.060 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:57.060 01:49:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.060 01:49:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.060 01:49:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.060 01:49:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.060 01:49:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.060 01:49:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:57.060 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:57.060 01:49:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.060 01:49:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:57.060 01:49:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:57.060 01:49:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:57.060 01:49:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:57.060 01:49:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:57.060 01:49:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:57.060 01:49:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:57.060 01:49:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:57.060 01:49:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:57.060 01:49:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:57.060 01:49:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:57.060 01:49:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:57.060 01:49:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:57.060 01:49:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:57.060 01:49:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:57.318 01:49:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:57.318 01:49:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:57.318 01:49:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:57.318 01:49:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:57.318 01:49:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:57.318 01:49:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:57.318 01:49:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:57.318 01:49:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:57.318 01:49:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:57.318 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:57.318 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:13:57.318 00:13:57.318 --- 10.0.0.2 ping statistics --- 00:13:57.318 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.318 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:13:57.318 01:49:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:57.318 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:57.318 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:13:57.318 00:13:57.318 --- 10.0.0.1 ping statistics --- 00:13:57.318 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.318 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:13:57.318 01:49:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:57.318 01:49:45 -- nvmf/common.sh@410 -- # return 0 00:13:57.318 01:49:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:57.318 01:49:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:57.318 01:49:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:57.318 01:49:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:57.318 01:49:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:57.318 01:49:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:57.318 01:49:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:57.318 01:49:45 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:57.318 01:49:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:57.318 01:49:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:57.318 01:49:45 -- common/autotest_common.sh@10 -- # set +x 00:13:57.318 01:49:45 -- nvmf/common.sh@469 -- # nvmfpid=3413858 00:13:57.318 01:49:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:57.318 01:49:45 -- nvmf/common.sh@470 -- # waitforlisten 3413858 00:13:57.318 01:49:45 -- common/autotest_common.sh@829 -- # '[' -z 3413858 ']' 00:13:57.318 01:49:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:57.318 01:49:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:57.319 01:49:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:57.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:57.319 01:49:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:57.319 01:49:45 -- common/autotest_common.sh@10 -- # set +x 00:13:57.319 [2024-11-19 01:49:45.811164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:57.319 [2024-11-19 01:49:45.811253] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:57.319 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.577 [2024-11-19 01:49:45.876583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:57.577 [2024-11-19 01:49:45.985799] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:57.577 [2024-11-19 01:49:45.985939] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:57.577 [2024-11-19 01:49:45.985955] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:57.577 [2024-11-19 01:49:45.985967] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:57.577 [2024-11-19 01:49:45.986018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:57.577 [2024-11-19 01:49:45.986023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:58.511 01:49:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:58.511 01:49:46 -- common/autotest_common.sh@862 -- # return 0 00:13:58.511 01:49:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:58.511 01:49:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:58.511 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:13:58.511 01:49:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:58.511 01:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.511 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:13:58.511 [2024-11-19 01:49:46.802263] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:58.511 01:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:58.511 01:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.511 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:13:58.511 01:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:58.511 01:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.511 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:13:58.511 [2024-11-19 01:49:46.818513] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.511 01:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:58.511 01:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.511 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:13:58.511 NULL1 00:13:58.511 01:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:58.511 01:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.511 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:13:58.511 Delay0 00:13:58.511 01:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.511 01:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.511 01:49:46 -- common/autotest_common.sh@10 -- # set +x 00:13:58.511 01:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@28 -- # perf_pid=3414007 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:58.511 01:49:46 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:58.511 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.511 [2024-11-19 01:49:46.893157] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:00.411 01:49:48 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:00.411 01:49:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.411 01:49:48 -- common/autotest_common.sh@10 -- # set +x 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 starting I/O failed: -6 00:14:00.669 [2024-11-19 01:49:48.973110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f773400c480 is same with the state(5) to be set 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Write completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.669 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 [2024-11-19 01:49:48.974700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7734000c00 is same with the state(5) to be set 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 [2024-11-19 01:49:48.975011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f773400bf20 is same with the state(5) to be set 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 Write completed with error (sct=0, sc=8) 00:14:00.670 starting I/O failed: -6 00:14:00.670 Read completed with error (sct=0, sc=8) 00:14:00.670 [2024-11-19 01:49:48.975552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ab770 is same with the state(5) to be set 00:14:01.603 [2024-11-19 01:49:49.948566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6c4960 is same with the state(5) to be set 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Write completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.603 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 [2024-11-19 01:49:49.975720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ab4c0 is same with the state(5) to be set 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 [2024-11-19 01:49:49.975889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cb3d0 is same with the state(5) to be set 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 [2024-11-19 01:49:49.976100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6aba20 is same with the state(5) to be set 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Write completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 Read completed with error (sct=0, sc=8) 00:14:01.604 [2024-11-19 01:49:49.976879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f773400c1d0 is same with the state(5) to be set 00:14:01.604 [2024-11-19 01:49:49.977382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6c4960 (9): Bad file descriptor 00:14:01.604 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:01.604 01:49:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.604 01:49:49 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:01.604 01:49:49 -- target/delete_subsystem.sh@35 -- # kill -0 3414007 00:14:01.604 01:49:49 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:01.604 Initializing NVMe Controllers 00:14:01.604 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:01.604 Controller IO queue size 128, less than required. 00:14:01.604 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:01.604 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:01.604 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:01.604 Initialization complete. Launching workers. 00:14:01.604 ======================================================== 00:14:01.604 Latency(us) 00:14:01.604 Device Information : IOPS MiB/s Average min max 00:14:01.604 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 167.20 0.08 1046848.65 2947.04 2002884.88 00:14:01.604 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 146.36 0.07 979140.03 1619.51 2004314.52 00:14:01.604 ======================================================== 00:14:01.604 Total : 313.56 0.15 1015244.15 1619.51 2004314.52 00:14:01.604 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@35 -- # kill -0 3414007 00:14:02.170 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3414007) - No such process 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@45 -- # NOT wait 3414007 00:14:02.170 01:49:50 -- common/autotest_common.sh@650 -- # local es=0 00:14:02.170 01:49:50 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3414007 00:14:02.170 01:49:50 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:02.170 01:49:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:02.170 01:49:50 -- common/autotest_common.sh@642 -- # type -t wait 00:14:02.170 01:49:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:02.170 01:49:50 -- common/autotest_common.sh@653 -- # wait 3414007 00:14:02.170 01:49:50 -- common/autotest_common.sh@653 -- # es=1 00:14:02.170 01:49:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:02.170 01:49:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:02.170 01:49:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:02.170 01:49:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.170 01:49:50 -- common/autotest_common.sh@10 -- # set +x 00:14:02.170 01:49:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:02.170 01:49:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.170 01:49:50 -- common/autotest_common.sh@10 -- # set +x 00:14:02.170 [2024-11-19 01:49:50.499233] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:02.170 01:49:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.170 01:49:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.170 01:49:50 -- common/autotest_common.sh@10 -- # set +x 00:14:02.170 01:49:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@54 -- # perf_pid=3414426 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.170 01:49:50 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:02.170 EAL: No free 2048 kB hugepages reported on node 1 00:14:02.170 [2024-11-19 01:49:50.565498] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:02.737 01:49:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.737 01:49:51 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:02.737 01:49:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.994 01:49:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.995 01:49:51 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:02.995 01:49:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:03.560 01:49:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:03.560 01:49:52 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:03.560 01:49:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.124 01:49:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.124 01:49:52 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:04.124 01:49:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.690 01:49:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.690 01:49:53 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:04.690 01:49:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:05.255 01:49:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:05.255 01:49:53 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:05.255 01:49:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:05.513 Initializing NVMe Controllers 00:14:05.513 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:05.513 Controller IO queue size 128, less than required. 00:14:05.513 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:05.513 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:05.513 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:05.513 Initialization complete. Launching workers. 00:14:05.513 ======================================================== 00:14:05.513 Latency(us) 00:14:05.513 Device Information : IOPS MiB/s Average min max 00:14:05.513 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004669.47 1000157.04 1042033.47 00:14:05.513 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1003742.71 1000150.87 1043329.95 00:14:05.513 ======================================================== 00:14:05.513 Total : 256.00 0.12 1004206.09 1000150.87 1043329.95 00:14:05.513 00:14:05.513 01:49:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:05.513 01:49:54 -- target/delete_subsystem.sh@57 -- # kill -0 3414426 00:14:05.513 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3414426) - No such process 00:14:05.513 01:49:54 -- target/delete_subsystem.sh@67 -- # wait 3414426 00:14:05.513 01:49:54 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:05.513 01:49:54 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:05.513 01:49:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:05.513 01:49:54 -- nvmf/common.sh@116 -- # sync 00:14:05.513 01:49:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:05.513 01:49:54 -- nvmf/common.sh@119 -- # set +e 00:14:05.513 01:49:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:05.513 01:49:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:05.513 rmmod nvme_tcp 00:14:05.771 rmmod nvme_fabrics 00:14:05.771 rmmod nvme_keyring 00:14:05.771 01:49:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:05.771 01:49:54 -- nvmf/common.sh@123 -- # set -e 00:14:05.771 01:49:54 -- nvmf/common.sh@124 -- # return 0 00:14:05.771 01:49:54 -- nvmf/common.sh@477 -- # '[' -n 3413858 ']' 00:14:05.771 01:49:54 -- nvmf/common.sh@478 -- # killprocess 3413858 00:14:05.771 01:49:54 -- common/autotest_common.sh@936 -- # '[' -z 3413858 ']' 00:14:05.771 01:49:54 -- common/autotest_common.sh@940 -- # kill -0 3413858 00:14:05.771 01:49:54 -- common/autotest_common.sh@941 -- # uname 00:14:05.771 01:49:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:05.771 01:49:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3413858 00:14:05.771 01:49:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:05.771 01:49:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:05.771 01:49:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3413858' 00:14:05.771 killing process with pid 3413858 00:14:05.771 01:49:54 -- common/autotest_common.sh@955 -- # kill 3413858 00:14:05.771 01:49:54 -- common/autotest_common.sh@960 -- # wait 3413858 00:14:06.030 01:49:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:06.030 01:49:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:06.030 01:49:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:06.030 01:49:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:06.030 01:49:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:06.030 01:49:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:06.030 01:49:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:06.030 01:49:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.934 01:49:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:07.935 00:14:07.935 real 0m13.102s 00:14:07.935 user 0m29.466s 00:14:07.935 sys 0m3.057s 00:14:07.935 01:49:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:07.935 01:49:56 -- common/autotest_common.sh@10 -- # set +x 00:14:07.935 ************************************ 00:14:07.935 END TEST nvmf_delete_subsystem 00:14:07.935 ************************************ 00:14:08.223 01:49:56 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:08.223 01:49:56 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:08.223 01:49:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:08.223 01:49:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:08.223 01:49:56 -- common/autotest_common.sh@10 -- # set +x 00:14:08.223 ************************************ 00:14:08.223 START TEST nvmf_nvme_cli 00:14:08.223 ************************************ 00:14:08.223 01:49:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:08.223 * Looking for test storage... 00:14:08.223 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:08.223 01:49:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:08.223 01:49:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:08.223 01:49:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:08.223 01:49:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:08.223 01:49:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:08.223 01:49:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:08.223 01:49:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:08.223 01:49:56 -- scripts/common.sh@335 -- # IFS=.-: 00:14:08.223 01:49:56 -- scripts/common.sh@335 -- # read -ra ver1 00:14:08.223 01:49:56 -- scripts/common.sh@336 -- # IFS=.-: 00:14:08.223 01:49:56 -- scripts/common.sh@336 -- # read -ra ver2 00:14:08.223 01:49:56 -- scripts/common.sh@337 -- # local 'op=<' 00:14:08.223 01:49:56 -- scripts/common.sh@339 -- # ver1_l=2 00:14:08.223 01:49:56 -- scripts/common.sh@340 -- # ver2_l=1 00:14:08.223 01:49:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:08.223 01:49:56 -- scripts/common.sh@343 -- # case "$op" in 00:14:08.223 01:49:56 -- scripts/common.sh@344 -- # : 1 00:14:08.223 01:49:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:08.223 01:49:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:08.223 01:49:56 -- scripts/common.sh@364 -- # decimal 1 00:14:08.223 01:49:56 -- scripts/common.sh@352 -- # local d=1 00:14:08.223 01:49:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:08.223 01:49:56 -- scripts/common.sh@354 -- # echo 1 00:14:08.223 01:49:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:08.223 01:49:56 -- scripts/common.sh@365 -- # decimal 2 00:14:08.223 01:49:56 -- scripts/common.sh@352 -- # local d=2 00:14:08.223 01:49:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:08.223 01:49:56 -- scripts/common.sh@354 -- # echo 2 00:14:08.223 01:49:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:08.223 01:49:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:08.223 01:49:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:08.223 01:49:56 -- scripts/common.sh@367 -- # return 0 00:14:08.223 01:49:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:08.223 01:49:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:08.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.223 --rc genhtml_branch_coverage=1 00:14:08.223 --rc genhtml_function_coverage=1 00:14:08.223 --rc genhtml_legend=1 00:14:08.223 --rc geninfo_all_blocks=1 00:14:08.223 --rc geninfo_unexecuted_blocks=1 00:14:08.223 00:14:08.223 ' 00:14:08.223 01:49:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:08.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.223 --rc genhtml_branch_coverage=1 00:14:08.223 --rc genhtml_function_coverage=1 00:14:08.223 --rc genhtml_legend=1 00:14:08.223 --rc geninfo_all_blocks=1 00:14:08.223 --rc geninfo_unexecuted_blocks=1 00:14:08.223 00:14:08.223 ' 00:14:08.223 01:49:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:08.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.223 --rc genhtml_branch_coverage=1 00:14:08.223 --rc genhtml_function_coverage=1 00:14:08.223 --rc genhtml_legend=1 00:14:08.223 --rc geninfo_all_blocks=1 00:14:08.223 --rc geninfo_unexecuted_blocks=1 00:14:08.223 00:14:08.223 ' 00:14:08.223 01:49:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:08.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.223 --rc genhtml_branch_coverage=1 00:14:08.223 --rc genhtml_function_coverage=1 00:14:08.223 --rc genhtml_legend=1 00:14:08.223 --rc geninfo_all_blocks=1 00:14:08.223 --rc geninfo_unexecuted_blocks=1 00:14:08.223 00:14:08.223 ' 00:14:08.223 01:49:56 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:08.223 01:49:56 -- nvmf/common.sh@7 -- # uname -s 00:14:08.223 01:49:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:08.223 01:49:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:08.223 01:49:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:08.223 01:49:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:08.223 01:49:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:08.223 01:49:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:08.223 01:49:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:08.223 01:49:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:08.223 01:49:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:08.223 01:49:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:08.223 01:49:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.223 01:49:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.223 01:49:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:08.223 01:49:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:08.223 01:49:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:08.223 01:49:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:08.223 01:49:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:08.223 01:49:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:08.223 01:49:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:08.223 01:49:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.224 01:49:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.224 01:49:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.224 01:49:56 -- paths/export.sh@5 -- # export PATH 00:14:08.224 01:49:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.224 01:49:56 -- nvmf/common.sh@46 -- # : 0 00:14:08.224 01:49:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:08.224 01:49:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:08.224 01:49:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:08.224 01:49:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:08.224 01:49:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:08.224 01:49:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:08.224 01:49:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:08.224 01:49:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:08.224 01:49:56 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:08.224 01:49:56 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:08.224 01:49:56 -- target/nvme_cli.sh@14 -- # devs=() 00:14:08.224 01:49:56 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:08.224 01:49:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:08.224 01:49:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:08.224 01:49:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:08.224 01:49:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:08.224 01:49:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:08.224 01:49:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.224 01:49:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.224 01:49:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.224 01:49:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:08.224 01:49:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:08.224 01:49:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:08.224 01:49:56 -- common/autotest_common.sh@10 -- # set +x 00:14:10.134 01:49:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:10.134 01:49:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:10.134 01:49:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:10.134 01:49:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:10.134 01:49:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:10.134 01:49:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:10.134 01:49:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:10.134 01:49:58 -- nvmf/common.sh@294 -- # net_devs=() 00:14:10.134 01:49:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:10.134 01:49:58 -- nvmf/common.sh@295 -- # e810=() 00:14:10.134 01:49:58 -- nvmf/common.sh@295 -- # local -ga e810 00:14:10.134 01:49:58 -- nvmf/common.sh@296 -- # x722=() 00:14:10.134 01:49:58 -- nvmf/common.sh@296 -- # local -ga x722 00:14:10.134 01:49:58 -- nvmf/common.sh@297 -- # mlx=() 00:14:10.134 01:49:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:10.134 01:49:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:10.134 01:49:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:10.134 01:49:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:10.134 01:49:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:10.134 01:49:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:10.134 01:49:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:10.134 01:49:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:10.134 01:49:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:10.134 01:49:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:10.135 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:10.135 01:49:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:10.135 01:49:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:10.135 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:10.135 01:49:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:10.135 01:49:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:10.135 01:49:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:10.135 01:49:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:10.135 01:49:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:10.135 01:49:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:10.135 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:10.135 01:49:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:10.135 01:49:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:10.135 01:49:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:10.135 01:49:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:10.135 01:49:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:10.135 01:49:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:10.135 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:10.135 01:49:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:10.135 01:49:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:10.135 01:49:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:10.135 01:49:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:10.135 01:49:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:10.135 01:49:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:10.135 01:49:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:10.135 01:49:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:10.135 01:49:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:10.135 01:49:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:10.135 01:49:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:10.135 01:49:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:10.135 01:49:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:10.135 01:49:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:10.135 01:49:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:10.135 01:49:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:10.135 01:49:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:10.135 01:49:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:10.393 01:49:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:10.393 01:49:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:10.393 01:49:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:10.393 01:49:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:10.393 01:49:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:10.393 01:49:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:10.393 01:49:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:10.393 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:10.393 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:14:10.393 00:14:10.393 --- 10.0.0.2 ping statistics --- 00:14:10.393 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.393 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:14:10.393 01:49:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:10.393 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:10.393 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:14:10.393 00:14:10.393 --- 10.0.0.1 ping statistics --- 00:14:10.393 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.393 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:14:10.393 01:49:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:10.393 01:49:58 -- nvmf/common.sh@410 -- # return 0 00:14:10.393 01:49:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:10.393 01:49:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:10.393 01:49:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:10.393 01:49:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:10.393 01:49:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:10.393 01:49:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:10.393 01:49:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:10.393 01:49:58 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:10.393 01:49:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:10.393 01:49:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:10.393 01:49:58 -- common/autotest_common.sh@10 -- # set +x 00:14:10.393 01:49:58 -- nvmf/common.sh@469 -- # nvmfpid=3416800 00:14:10.393 01:49:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:10.393 01:49:58 -- nvmf/common.sh@470 -- # waitforlisten 3416800 00:14:10.393 01:49:58 -- common/autotest_common.sh@829 -- # '[' -z 3416800 ']' 00:14:10.393 01:49:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:10.393 01:49:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:10.393 01:49:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:10.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:10.393 01:49:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:10.393 01:49:58 -- common/autotest_common.sh@10 -- # set +x 00:14:10.393 [2024-11-19 01:49:58.836735] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:10.393 [2024-11-19 01:49:58.836810] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:10.393 EAL: No free 2048 kB hugepages reported on node 1 00:14:10.393 [2024-11-19 01:49:58.905467] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:10.651 [2024-11-19 01:49:59.023406] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:10.651 [2024-11-19 01:49:59.023574] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:10.651 [2024-11-19 01:49:59.023593] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:10.651 [2024-11-19 01:49:59.023607] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:10.651 [2024-11-19 01:49:59.023762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:10.651 [2024-11-19 01:49:59.023789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:10.651 [2024-11-19 01:49:59.023841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:10.651 [2024-11-19 01:49:59.023843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:11.583 01:49:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:11.583 01:49:59 -- common/autotest_common.sh@862 -- # return 0 00:14:11.583 01:49:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:11.583 01:49:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 01:49:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:11.583 01:49:59 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 [2024-11-19 01:49:59.822095] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 Malloc0 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 Malloc1 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 [2024-11-19 01:49:59.908177] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:11.583 01:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.583 01:49:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.583 01:49:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.583 01:49:59 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:11.583 00:14:11.583 Discovery Log Number of Records 2, Generation counter 2 00:14:11.583 =====Discovery Log Entry 0====== 00:14:11.583 trtype: tcp 00:14:11.583 adrfam: ipv4 00:14:11.583 subtype: current discovery subsystem 00:14:11.583 treq: not required 00:14:11.583 portid: 0 00:14:11.583 trsvcid: 4420 00:14:11.583 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:11.583 traddr: 10.0.0.2 00:14:11.583 eflags: explicit discovery connections, duplicate discovery information 00:14:11.583 sectype: none 00:14:11.583 =====Discovery Log Entry 1====== 00:14:11.583 trtype: tcp 00:14:11.583 adrfam: ipv4 00:14:11.583 subtype: nvme subsystem 00:14:11.583 treq: not required 00:14:11.583 portid: 0 00:14:11.583 trsvcid: 4420 00:14:11.583 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:11.583 traddr: 10.0.0.2 00:14:11.583 eflags: none 00:14:11.583 sectype: none 00:14:11.583 01:50:00 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:11.583 01:50:00 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:11.583 01:50:00 -- nvmf/common.sh@510 -- # local dev _ 00:14:11.583 01:50:00 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.583 01:50:00 -- nvmf/common.sh@509 -- # nvme list 00:14:11.583 01:50:00 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:11.583 01:50:00 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.583 01:50:00 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:11.583 01:50:00 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.583 01:50:00 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:11.583 01:50:00 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:12.516 01:50:00 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:12.516 01:50:00 -- common/autotest_common.sh@1187 -- # local i=0 00:14:12.516 01:50:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:12.516 01:50:00 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:12.516 01:50:00 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:12.516 01:50:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:14.418 01:50:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:14.418 01:50:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:14.418 01:50:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:14.418 01:50:02 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:14.418 01:50:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:14.418 01:50:02 -- common/autotest_common.sh@1197 -- # return 0 00:14:14.418 01:50:02 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:14.418 01:50:02 -- nvmf/common.sh@510 -- # local dev _ 00:14:14.418 01:50:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.418 01:50:02 -- nvmf/common.sh@509 -- # nvme list 00:14:14.418 01:50:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:14.418 01:50:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.418 01:50:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:14.418 01:50:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.418 01:50:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:14.418 01:50:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:14.418 01:50:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.418 01:50:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:14.418 01:50:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:14.418 01:50:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.418 01:50:02 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:14.418 /dev/nvme0n2 ]] 00:14:14.418 01:50:02 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:14.418 01:50:02 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:14.418 01:50:02 -- nvmf/common.sh@510 -- # local dev _ 00:14:14.418 01:50:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.418 01:50:02 -- nvmf/common.sh@509 -- # nvme list 00:14:14.676 01:50:03 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:14.676 01:50:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.676 01:50:03 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:14.676 01:50:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.676 01:50:03 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:14.676 01:50:03 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:14.676 01:50:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.676 01:50:03 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:14.676 01:50:03 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:14.676 01:50:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.676 01:50:03 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:14.676 01:50:03 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:14.934 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:14.934 01:50:03 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:14.934 01:50:03 -- common/autotest_common.sh@1208 -- # local i=0 00:14:14.934 01:50:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:14.934 01:50:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.934 01:50:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:14.934 01:50:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.934 01:50:03 -- common/autotest_common.sh@1220 -- # return 0 00:14:14.934 01:50:03 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:14.934 01:50:03 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:14.934 01:50:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.934 01:50:03 -- common/autotest_common.sh@10 -- # set +x 00:14:14.934 01:50:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.934 01:50:03 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:14.934 01:50:03 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:14.934 01:50:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:14.934 01:50:03 -- nvmf/common.sh@116 -- # sync 00:14:14.934 01:50:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:14.934 01:50:03 -- nvmf/common.sh@119 -- # set +e 00:14:14.934 01:50:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:14.934 01:50:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:14.934 rmmod nvme_tcp 00:14:14.934 rmmod nvme_fabrics 00:14:14.934 rmmod nvme_keyring 00:14:14.934 01:50:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:14.934 01:50:03 -- nvmf/common.sh@123 -- # set -e 00:14:14.934 01:50:03 -- nvmf/common.sh@124 -- # return 0 00:14:14.934 01:50:03 -- nvmf/common.sh@477 -- # '[' -n 3416800 ']' 00:14:14.934 01:50:03 -- nvmf/common.sh@478 -- # killprocess 3416800 00:14:14.934 01:50:03 -- common/autotest_common.sh@936 -- # '[' -z 3416800 ']' 00:14:14.934 01:50:03 -- common/autotest_common.sh@940 -- # kill -0 3416800 00:14:14.934 01:50:03 -- common/autotest_common.sh@941 -- # uname 00:14:14.934 01:50:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:14.934 01:50:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3416800 00:14:14.934 01:50:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:14.934 01:50:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:14.934 01:50:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3416800' 00:14:14.934 killing process with pid 3416800 00:14:15.193 01:50:03 -- common/autotest_common.sh@955 -- # kill 3416800 00:14:15.193 01:50:03 -- common/autotest_common.sh@960 -- # wait 3416800 00:14:15.452 01:50:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:15.452 01:50:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:15.452 01:50:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:15.452 01:50:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:15.452 01:50:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:15.452 01:50:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:15.452 01:50:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:15.452 01:50:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:17.354 01:50:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:17.354 00:14:17.354 real 0m9.329s 00:14:17.354 user 0m19.592s 00:14:17.354 sys 0m2.284s 00:14:17.354 01:50:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:17.354 01:50:05 -- common/autotest_common.sh@10 -- # set +x 00:14:17.354 ************************************ 00:14:17.354 END TEST nvmf_nvme_cli 00:14:17.354 ************************************ 00:14:17.354 01:50:05 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:17.354 01:50:05 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:17.354 01:50:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:17.354 01:50:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:17.354 01:50:05 -- common/autotest_common.sh@10 -- # set +x 00:14:17.354 ************************************ 00:14:17.354 START TEST nvmf_host_management 00:14:17.354 ************************************ 00:14:17.354 01:50:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:17.612 * Looking for test storage... 00:14:17.612 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:17.612 01:50:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:17.612 01:50:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:17.612 01:50:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:17.612 01:50:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:17.612 01:50:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:17.612 01:50:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:17.612 01:50:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:17.612 01:50:05 -- scripts/common.sh@335 -- # IFS=.-: 00:14:17.612 01:50:05 -- scripts/common.sh@335 -- # read -ra ver1 00:14:17.612 01:50:05 -- scripts/common.sh@336 -- # IFS=.-: 00:14:17.612 01:50:05 -- scripts/common.sh@336 -- # read -ra ver2 00:14:17.612 01:50:05 -- scripts/common.sh@337 -- # local 'op=<' 00:14:17.612 01:50:05 -- scripts/common.sh@339 -- # ver1_l=2 00:14:17.612 01:50:05 -- scripts/common.sh@340 -- # ver2_l=1 00:14:17.612 01:50:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:17.612 01:50:05 -- scripts/common.sh@343 -- # case "$op" in 00:14:17.612 01:50:05 -- scripts/common.sh@344 -- # : 1 00:14:17.612 01:50:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:17.612 01:50:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:17.612 01:50:05 -- scripts/common.sh@364 -- # decimal 1 00:14:17.612 01:50:05 -- scripts/common.sh@352 -- # local d=1 00:14:17.612 01:50:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:17.612 01:50:05 -- scripts/common.sh@354 -- # echo 1 00:14:17.612 01:50:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:17.612 01:50:05 -- scripts/common.sh@365 -- # decimal 2 00:14:17.612 01:50:05 -- scripts/common.sh@352 -- # local d=2 00:14:17.612 01:50:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:17.612 01:50:06 -- scripts/common.sh@354 -- # echo 2 00:14:17.612 01:50:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:17.612 01:50:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:17.612 01:50:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:17.612 01:50:06 -- scripts/common.sh@367 -- # return 0 00:14:17.612 01:50:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:17.612 01:50:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.612 --rc genhtml_branch_coverage=1 00:14:17.612 --rc genhtml_function_coverage=1 00:14:17.612 --rc genhtml_legend=1 00:14:17.612 --rc geninfo_all_blocks=1 00:14:17.612 --rc geninfo_unexecuted_blocks=1 00:14:17.612 00:14:17.612 ' 00:14:17.612 01:50:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.612 --rc genhtml_branch_coverage=1 00:14:17.612 --rc genhtml_function_coverage=1 00:14:17.612 --rc genhtml_legend=1 00:14:17.612 --rc geninfo_all_blocks=1 00:14:17.612 --rc geninfo_unexecuted_blocks=1 00:14:17.612 00:14:17.612 ' 00:14:17.612 01:50:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.612 --rc genhtml_branch_coverage=1 00:14:17.612 --rc genhtml_function_coverage=1 00:14:17.612 --rc genhtml_legend=1 00:14:17.612 --rc geninfo_all_blocks=1 00:14:17.612 --rc geninfo_unexecuted_blocks=1 00:14:17.612 00:14:17.612 ' 00:14:17.612 01:50:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:17.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.612 --rc genhtml_branch_coverage=1 00:14:17.612 --rc genhtml_function_coverage=1 00:14:17.612 --rc genhtml_legend=1 00:14:17.612 --rc geninfo_all_blocks=1 00:14:17.612 --rc geninfo_unexecuted_blocks=1 00:14:17.612 00:14:17.612 ' 00:14:17.612 01:50:06 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:17.612 01:50:06 -- nvmf/common.sh@7 -- # uname -s 00:14:17.612 01:50:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:17.612 01:50:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:17.612 01:50:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:17.612 01:50:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:17.612 01:50:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:17.613 01:50:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:17.613 01:50:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:17.613 01:50:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:17.613 01:50:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:17.613 01:50:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:17.613 01:50:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:17.613 01:50:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:17.613 01:50:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:17.613 01:50:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:17.613 01:50:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:17.613 01:50:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:17.613 01:50:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:17.613 01:50:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:17.613 01:50:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:17.613 01:50:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.613 01:50:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.613 01:50:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.613 01:50:06 -- paths/export.sh@5 -- # export PATH 00:14:17.613 01:50:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.613 01:50:06 -- nvmf/common.sh@46 -- # : 0 00:14:17.613 01:50:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:17.613 01:50:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:17.613 01:50:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:17.613 01:50:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:17.613 01:50:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:17.613 01:50:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:17.613 01:50:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:17.613 01:50:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:17.613 01:50:06 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:17.613 01:50:06 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:17.613 01:50:06 -- target/host_management.sh@104 -- # nvmftestinit 00:14:17.613 01:50:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:17.613 01:50:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:17.613 01:50:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:17.613 01:50:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:17.613 01:50:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:17.613 01:50:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.613 01:50:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.613 01:50:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:17.613 01:50:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:17.613 01:50:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:17.613 01:50:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:17.613 01:50:06 -- common/autotest_common.sh@10 -- # set +x 00:14:20.143 01:50:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:20.143 01:50:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:20.143 01:50:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:20.143 01:50:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:20.143 01:50:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:20.143 01:50:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:20.143 01:50:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:20.143 01:50:08 -- nvmf/common.sh@294 -- # net_devs=() 00:14:20.143 01:50:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:20.143 01:50:08 -- nvmf/common.sh@295 -- # e810=() 00:14:20.143 01:50:08 -- nvmf/common.sh@295 -- # local -ga e810 00:14:20.143 01:50:08 -- nvmf/common.sh@296 -- # x722=() 00:14:20.143 01:50:08 -- nvmf/common.sh@296 -- # local -ga x722 00:14:20.143 01:50:08 -- nvmf/common.sh@297 -- # mlx=() 00:14:20.143 01:50:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:20.143 01:50:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:20.143 01:50:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:20.143 01:50:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:20.143 01:50:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:20.143 01:50:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:20.143 01:50:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:20.143 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:20.143 01:50:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:20.143 01:50:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:20.143 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:20.143 01:50:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:20.143 01:50:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:20.143 01:50:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:20.143 01:50:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:20.143 01:50:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:20.143 01:50:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:20.143 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:20.143 01:50:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:20.143 01:50:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:20.143 01:50:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:20.143 01:50:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:20.143 01:50:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:20.143 01:50:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:20.143 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:20.143 01:50:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:20.143 01:50:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:20.143 01:50:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:20.143 01:50:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:20.143 01:50:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:20.143 01:50:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:20.143 01:50:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:20.143 01:50:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:20.143 01:50:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:20.143 01:50:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:20.143 01:50:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:20.143 01:50:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:20.143 01:50:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:20.143 01:50:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:20.143 01:50:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:20.143 01:50:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:20.143 01:50:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:20.143 01:50:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:20.143 01:50:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:20.143 01:50:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:20.143 01:50:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:20.143 01:50:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:20.143 01:50:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:20.143 01:50:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:20.143 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:20.143 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.305 ms 00:14:20.143 00:14:20.143 --- 10.0.0.2 ping statistics --- 00:14:20.143 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:20.143 rtt min/avg/max/mdev = 0.305/0.305/0.305/0.000 ms 00:14:20.143 01:50:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:20.143 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:20.143 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:14:20.143 00:14:20.143 --- 10.0.0.1 ping statistics --- 00:14:20.143 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:20.143 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:14:20.143 01:50:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:20.143 01:50:08 -- nvmf/common.sh@410 -- # return 0 00:14:20.143 01:50:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:20.143 01:50:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:20.143 01:50:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:20.143 01:50:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:20.143 01:50:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:20.143 01:50:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:20.143 01:50:08 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:20.143 01:50:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:20.143 01:50:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:20.143 01:50:08 -- common/autotest_common.sh@10 -- # set +x 00:14:20.143 ************************************ 00:14:20.143 START TEST nvmf_host_management 00:14:20.143 ************************************ 00:14:20.143 01:50:08 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:20.143 01:50:08 -- target/host_management.sh@69 -- # starttarget 00:14:20.143 01:50:08 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:20.143 01:50:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:20.143 01:50:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:20.143 01:50:08 -- common/autotest_common.sh@10 -- # set +x 00:14:20.143 01:50:08 -- nvmf/common.sh@469 -- # nvmfpid=3419370 00:14:20.143 01:50:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:20.143 01:50:08 -- nvmf/common.sh@470 -- # waitforlisten 3419370 00:14:20.143 01:50:08 -- common/autotest_common.sh@829 -- # '[' -z 3419370 ']' 00:14:20.143 01:50:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:20.143 01:50:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:20.143 01:50:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:20.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:20.143 01:50:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:20.144 01:50:08 -- common/autotest_common.sh@10 -- # set +x 00:14:20.144 [2024-11-19 01:50:08.360447] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:20.144 [2024-11-19 01:50:08.360531] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:20.144 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.144 [2024-11-19 01:50:08.427118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:20.144 [2024-11-19 01:50:08.534956] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:20.144 [2024-11-19 01:50:08.535119] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:20.144 [2024-11-19 01:50:08.535151] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:20.144 [2024-11-19 01:50:08.535165] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:20.144 [2024-11-19 01:50:08.535255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:20.144 [2024-11-19 01:50:08.535304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:20.144 [2024-11-19 01:50:08.535337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:20.144 [2024-11-19 01:50:08.535340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:21.076 01:50:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:21.076 01:50:09 -- common/autotest_common.sh@862 -- # return 0 00:14:21.076 01:50:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:21.076 01:50:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:21.076 01:50:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.076 01:50:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:21.076 01:50:09 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:21.076 01:50:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.076 01:50:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.076 [2024-11-19 01:50:09.409427] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:21.076 01:50:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.076 01:50:09 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:21.076 01:50:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:21.076 01:50:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.076 01:50:09 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:21.076 01:50:09 -- target/host_management.sh@23 -- # cat 00:14:21.076 01:50:09 -- target/host_management.sh@30 -- # rpc_cmd 00:14:21.076 01:50:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.076 01:50:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.076 Malloc0 00:14:21.076 [2024-11-19 01:50:09.468537] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:21.076 01:50:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.076 01:50:09 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:21.076 01:50:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:21.076 01:50:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.076 01:50:09 -- target/host_management.sh@73 -- # perfpid=3419548 00:14:21.076 01:50:09 -- target/host_management.sh@74 -- # waitforlisten 3419548 /var/tmp/bdevperf.sock 00:14:21.076 01:50:09 -- common/autotest_common.sh@829 -- # '[' -z 3419548 ']' 00:14:21.076 01:50:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:21.077 01:50:09 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:21.077 01:50:09 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:21.077 01:50:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:21.077 01:50:09 -- nvmf/common.sh@520 -- # config=() 00:14:21.077 01:50:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:21.077 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:21.077 01:50:09 -- nvmf/common.sh@520 -- # local subsystem config 00:14:21.077 01:50:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:21.077 01:50:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:21.077 01:50:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.077 01:50:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:21.077 { 00:14:21.077 "params": { 00:14:21.077 "name": "Nvme$subsystem", 00:14:21.077 "trtype": "$TEST_TRANSPORT", 00:14:21.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:21.077 "adrfam": "ipv4", 00:14:21.077 "trsvcid": "$NVMF_PORT", 00:14:21.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:21.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:21.077 "hdgst": ${hdgst:-false}, 00:14:21.077 "ddgst": ${ddgst:-false} 00:14:21.077 }, 00:14:21.077 "method": "bdev_nvme_attach_controller" 00:14:21.077 } 00:14:21.077 EOF 00:14:21.077 )") 00:14:21.077 01:50:09 -- nvmf/common.sh@542 -- # cat 00:14:21.077 01:50:09 -- nvmf/common.sh@544 -- # jq . 00:14:21.077 01:50:09 -- nvmf/common.sh@545 -- # IFS=, 00:14:21.077 01:50:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:21.077 "params": { 00:14:21.077 "name": "Nvme0", 00:14:21.077 "trtype": "tcp", 00:14:21.077 "traddr": "10.0.0.2", 00:14:21.077 "adrfam": "ipv4", 00:14:21.077 "trsvcid": "4420", 00:14:21.077 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:21.077 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:21.077 "hdgst": false, 00:14:21.077 "ddgst": false 00:14:21.077 }, 00:14:21.077 "method": "bdev_nvme_attach_controller" 00:14:21.077 }' 00:14:21.077 [2024-11-19 01:50:09.536148] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:21.077 [2024-11-19 01:50:09.536220] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3419548 ] 00:14:21.077 EAL: No free 2048 kB hugepages reported on node 1 00:14:21.077 [2024-11-19 01:50:09.600106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:21.335 [2024-11-19 01:50:09.710605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:21.593 Running I/O for 10 seconds... 00:14:22.161 01:50:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:22.161 01:50:10 -- common/autotest_common.sh@862 -- # return 0 00:14:22.161 01:50:10 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:22.161 01:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.161 01:50:10 -- common/autotest_common.sh@10 -- # set +x 00:14:22.161 01:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.161 01:50:10 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:22.161 01:50:10 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:22.161 01:50:10 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:22.161 01:50:10 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:22.161 01:50:10 -- target/host_management.sh@52 -- # local ret=1 00:14:22.161 01:50:10 -- target/host_management.sh@53 -- # local i 00:14:22.161 01:50:10 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:22.161 01:50:10 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:22.161 01:50:10 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:22.161 01:50:10 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:22.161 01:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.161 01:50:10 -- common/autotest_common.sh@10 -- # set +x 00:14:22.161 01:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.161 01:50:10 -- target/host_management.sh@55 -- # read_io_count=2189 00:14:22.161 01:50:10 -- target/host_management.sh@58 -- # '[' 2189 -ge 100 ']' 00:14:22.161 01:50:10 -- target/host_management.sh@59 -- # ret=0 00:14:22.162 01:50:10 -- target/host_management.sh@60 -- # break 00:14:22.162 01:50:10 -- target/host_management.sh@64 -- # return 0 00:14:22.162 01:50:10 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:22.162 01:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.162 01:50:10 -- common/autotest_common.sh@10 -- # set +x 00:14:22.162 [2024-11-19 01:50:10.600545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.600995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.601197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdd8e60 is same with the state(5) to be set 00:14:22.162 [2024-11-19 01:50:10.602420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.162 [2024-11-19 01:50:10.602926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.162 [2024-11-19 01:50:10.602941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.602957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.602970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.602985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.602998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:46080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:46208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:46336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:46464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:46592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:46720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.603977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:46848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.603990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.604009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:46976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.604022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.604037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:47104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.163 [2024-11-19 01:50:10.604051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.163 [2024-11-19 01:50:10.604066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:47232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:47360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:47488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:47616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:47744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:47872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:48000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:22.164 [2024-11-19 01:50:10.604340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:22.164 [2024-11-19 01:50:10.604436] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x86c030 was disconnected and freed. reset controller. 00:14:22.164 01:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.164 01:50:10 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:22.164 01:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.164 01:50:10 -- common/autotest_common.sh@10 -- # set +x 00:14:22.164 [2024-11-19 01:50:10.605652] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:22.164 task offset: 42112 on job bdev=Nvme0n1 fails 00:14:22.164 00:14:22.164 Latency(us) 00:14:22.164 [2024-11-19T00:50:10.707Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:22.164 [2024-11-19T00:50:10.707Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:22.164 [2024-11-19T00:50:10.707Z] Job: Nvme0n1 ended in about 0.59 seconds with error 00:14:22.164 Verification LBA range: start 0x0 length 0x400 00:14:22.164 Nvme0n1 : 0.59 4003.47 250.22 108.57 0.00 15315.54 2402.99 23010.42 00:14:22.164 [2024-11-19T00:50:10.707Z] =================================================================================================================== 00:14:22.164 [2024-11-19T00:50:10.707Z] Total : 4003.47 250.22 108.57 0.00 15315.54 2402.99 23010.42 00:14:22.164 [2024-11-19 01:50:10.607569] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:22.164 [2024-11-19 01:50:10.607614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x86e160 (9): Bad file descriptor 00:14:22.164 01:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.164 01:50:10 -- target/host_management.sh@87 -- # sleep 1 00:14:22.164 [2024-11-19 01:50:10.654843] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:23.098 01:50:11 -- target/host_management.sh@91 -- # kill -9 3419548 00:14:23.098 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3419548) - No such process 00:14:23.098 01:50:11 -- target/host_management.sh@91 -- # true 00:14:23.098 01:50:11 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:23.098 01:50:11 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:23.098 01:50:11 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:23.098 01:50:11 -- nvmf/common.sh@520 -- # config=() 00:14:23.098 01:50:11 -- nvmf/common.sh@520 -- # local subsystem config 00:14:23.098 01:50:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:23.098 01:50:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:23.098 { 00:14:23.098 "params": { 00:14:23.098 "name": "Nvme$subsystem", 00:14:23.098 "trtype": "$TEST_TRANSPORT", 00:14:23.098 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:23.098 "adrfam": "ipv4", 00:14:23.098 "trsvcid": "$NVMF_PORT", 00:14:23.098 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:23.098 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:23.098 "hdgst": ${hdgst:-false}, 00:14:23.098 "ddgst": ${ddgst:-false} 00:14:23.098 }, 00:14:23.098 "method": "bdev_nvme_attach_controller" 00:14:23.098 } 00:14:23.098 EOF 00:14:23.098 )") 00:14:23.098 01:50:11 -- nvmf/common.sh@542 -- # cat 00:14:23.098 01:50:11 -- nvmf/common.sh@544 -- # jq . 00:14:23.098 01:50:11 -- nvmf/common.sh@545 -- # IFS=, 00:14:23.098 01:50:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:23.098 "params": { 00:14:23.098 "name": "Nvme0", 00:14:23.098 "trtype": "tcp", 00:14:23.098 "traddr": "10.0.0.2", 00:14:23.098 "adrfam": "ipv4", 00:14:23.098 "trsvcid": "4420", 00:14:23.098 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:23.098 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:23.098 "hdgst": false, 00:14:23.098 "ddgst": false 00:14:23.098 }, 00:14:23.098 "method": "bdev_nvme_attach_controller" 00:14:23.098 }' 00:14:23.357 [2024-11-19 01:50:11.655457] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:23.357 [2024-11-19 01:50:11.655539] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3419832 ] 00:14:23.357 EAL: No free 2048 kB hugepages reported on node 1 00:14:23.357 [2024-11-19 01:50:11.715709] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:23.357 [2024-11-19 01:50:11.825085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:23.616 Running I/O for 1 seconds... 00:14:24.991 00:14:24.991 Latency(us) 00:14:24.991 [2024-11-19T00:50:13.534Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:24.991 [2024-11-19T00:50:13.534Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:24.991 Verification LBA range: start 0x0 length 0x400 00:14:24.991 Nvme0n1 : 1.01 4095.24 255.95 0.00 0.00 15367.59 952.70 23107.51 00:14:24.991 [2024-11-19T00:50:13.534Z] =================================================================================================================== 00:14:24.991 [2024-11-19T00:50:13.534Z] Total : 4095.24 255.95 0.00 0.00 15367.59 952.70 23107.51 00:14:24.991 01:50:13 -- target/host_management.sh@101 -- # stoptarget 00:14:24.991 01:50:13 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:24.991 01:50:13 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:24.991 01:50:13 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:24.991 01:50:13 -- target/host_management.sh@40 -- # nvmftestfini 00:14:24.991 01:50:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:24.991 01:50:13 -- nvmf/common.sh@116 -- # sync 00:14:24.991 01:50:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:24.991 01:50:13 -- nvmf/common.sh@119 -- # set +e 00:14:24.991 01:50:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:24.991 01:50:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:24.991 rmmod nvme_tcp 00:14:24.991 rmmod nvme_fabrics 00:14:24.991 rmmod nvme_keyring 00:14:24.991 01:50:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:24.991 01:50:13 -- nvmf/common.sh@123 -- # set -e 00:14:24.991 01:50:13 -- nvmf/common.sh@124 -- # return 0 00:14:24.991 01:50:13 -- nvmf/common.sh@477 -- # '[' -n 3419370 ']' 00:14:24.991 01:50:13 -- nvmf/common.sh@478 -- # killprocess 3419370 00:14:24.991 01:50:13 -- common/autotest_common.sh@936 -- # '[' -z 3419370 ']' 00:14:24.991 01:50:13 -- common/autotest_common.sh@940 -- # kill -0 3419370 00:14:24.991 01:50:13 -- common/autotest_common.sh@941 -- # uname 00:14:24.991 01:50:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:24.991 01:50:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3419370 00:14:24.991 01:50:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:24.991 01:50:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:24.991 01:50:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3419370' 00:14:24.991 killing process with pid 3419370 00:14:24.991 01:50:13 -- common/autotest_common.sh@955 -- # kill 3419370 00:14:24.991 01:50:13 -- common/autotest_common.sh@960 -- # wait 3419370 00:14:25.249 [2024-11-19 01:50:13.779859] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:25.508 01:50:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:25.508 01:50:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:25.508 01:50:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:25.508 01:50:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:25.508 01:50:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:25.508 01:50:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:25.508 01:50:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:25.508 01:50:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:27.413 01:50:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:27.413 00:14:27.413 real 0m7.535s 00:14:27.413 user 0m23.730s 00:14:27.413 sys 0m1.384s 00:14:27.413 01:50:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:27.413 01:50:15 -- common/autotest_common.sh@10 -- # set +x 00:14:27.413 ************************************ 00:14:27.413 END TEST nvmf_host_management 00:14:27.413 ************************************ 00:14:27.413 01:50:15 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:27.413 00:14:27.413 real 0m10.010s 00:14:27.413 user 0m24.641s 00:14:27.413 sys 0m2.980s 00:14:27.413 01:50:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:27.413 01:50:15 -- common/autotest_common.sh@10 -- # set +x 00:14:27.413 ************************************ 00:14:27.413 END TEST nvmf_host_management 00:14:27.413 ************************************ 00:14:27.413 01:50:15 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:27.413 01:50:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:27.413 01:50:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:27.413 01:50:15 -- common/autotest_common.sh@10 -- # set +x 00:14:27.413 ************************************ 00:14:27.413 START TEST nvmf_lvol 00:14:27.413 ************************************ 00:14:27.413 01:50:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:27.413 * Looking for test storage... 00:14:27.413 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:27.413 01:50:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:27.413 01:50:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:27.413 01:50:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:27.672 01:50:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:27.672 01:50:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:27.672 01:50:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:27.672 01:50:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:27.672 01:50:16 -- scripts/common.sh@335 -- # IFS=.-: 00:14:27.672 01:50:16 -- scripts/common.sh@335 -- # read -ra ver1 00:14:27.672 01:50:16 -- scripts/common.sh@336 -- # IFS=.-: 00:14:27.672 01:50:16 -- scripts/common.sh@336 -- # read -ra ver2 00:14:27.672 01:50:16 -- scripts/common.sh@337 -- # local 'op=<' 00:14:27.672 01:50:16 -- scripts/common.sh@339 -- # ver1_l=2 00:14:27.672 01:50:16 -- scripts/common.sh@340 -- # ver2_l=1 00:14:27.672 01:50:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:27.672 01:50:16 -- scripts/common.sh@343 -- # case "$op" in 00:14:27.672 01:50:16 -- scripts/common.sh@344 -- # : 1 00:14:27.672 01:50:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:27.672 01:50:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:27.672 01:50:16 -- scripts/common.sh@364 -- # decimal 1 00:14:27.672 01:50:16 -- scripts/common.sh@352 -- # local d=1 00:14:27.672 01:50:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:27.672 01:50:16 -- scripts/common.sh@354 -- # echo 1 00:14:27.672 01:50:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:27.672 01:50:16 -- scripts/common.sh@365 -- # decimal 2 00:14:27.672 01:50:16 -- scripts/common.sh@352 -- # local d=2 00:14:27.672 01:50:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:27.672 01:50:16 -- scripts/common.sh@354 -- # echo 2 00:14:27.672 01:50:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:27.672 01:50:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:27.672 01:50:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:27.672 01:50:16 -- scripts/common.sh@367 -- # return 0 00:14:27.672 01:50:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:27.672 01:50:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:27.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.672 --rc genhtml_branch_coverage=1 00:14:27.672 --rc genhtml_function_coverage=1 00:14:27.672 --rc genhtml_legend=1 00:14:27.672 --rc geninfo_all_blocks=1 00:14:27.672 --rc geninfo_unexecuted_blocks=1 00:14:27.672 00:14:27.672 ' 00:14:27.672 01:50:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:27.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.672 --rc genhtml_branch_coverage=1 00:14:27.672 --rc genhtml_function_coverage=1 00:14:27.672 --rc genhtml_legend=1 00:14:27.672 --rc geninfo_all_blocks=1 00:14:27.672 --rc geninfo_unexecuted_blocks=1 00:14:27.672 00:14:27.672 ' 00:14:27.672 01:50:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:27.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.672 --rc genhtml_branch_coverage=1 00:14:27.672 --rc genhtml_function_coverage=1 00:14:27.672 --rc genhtml_legend=1 00:14:27.672 --rc geninfo_all_blocks=1 00:14:27.672 --rc geninfo_unexecuted_blocks=1 00:14:27.672 00:14:27.672 ' 00:14:27.672 01:50:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:27.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.672 --rc genhtml_branch_coverage=1 00:14:27.672 --rc genhtml_function_coverage=1 00:14:27.672 --rc genhtml_legend=1 00:14:27.672 --rc geninfo_all_blocks=1 00:14:27.672 --rc geninfo_unexecuted_blocks=1 00:14:27.672 00:14:27.672 ' 00:14:27.672 01:50:16 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:27.672 01:50:16 -- nvmf/common.sh@7 -- # uname -s 00:14:27.672 01:50:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:27.672 01:50:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:27.672 01:50:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:27.672 01:50:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:27.672 01:50:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:27.672 01:50:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:27.672 01:50:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:27.672 01:50:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:27.672 01:50:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:27.672 01:50:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:27.672 01:50:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:27.672 01:50:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:27.672 01:50:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:27.672 01:50:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:27.672 01:50:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:27.672 01:50:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:27.672 01:50:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:27.672 01:50:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:27.672 01:50:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:27.672 01:50:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.672 01:50:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.672 01:50:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.672 01:50:16 -- paths/export.sh@5 -- # export PATH 00:14:27.672 01:50:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.672 01:50:16 -- nvmf/common.sh@46 -- # : 0 00:14:27.672 01:50:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:27.673 01:50:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:27.673 01:50:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:27.673 01:50:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:27.673 01:50:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:27.673 01:50:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:27.673 01:50:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:27.673 01:50:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:27.673 01:50:16 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:27.673 01:50:16 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:27.673 01:50:16 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:27.673 01:50:16 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:27.673 01:50:16 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:27.673 01:50:16 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:27.673 01:50:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:27.673 01:50:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:27.673 01:50:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:27.673 01:50:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:27.673 01:50:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:27.673 01:50:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:27.673 01:50:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:27.673 01:50:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:27.673 01:50:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:27.673 01:50:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:27.673 01:50:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:27.673 01:50:16 -- common/autotest_common.sh@10 -- # set +x 00:14:30.206 01:50:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:30.206 01:50:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:30.206 01:50:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:30.206 01:50:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:30.206 01:50:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:30.206 01:50:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:30.206 01:50:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:30.206 01:50:18 -- nvmf/common.sh@294 -- # net_devs=() 00:14:30.206 01:50:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:30.206 01:50:18 -- nvmf/common.sh@295 -- # e810=() 00:14:30.206 01:50:18 -- nvmf/common.sh@295 -- # local -ga e810 00:14:30.206 01:50:18 -- nvmf/common.sh@296 -- # x722=() 00:14:30.206 01:50:18 -- nvmf/common.sh@296 -- # local -ga x722 00:14:30.206 01:50:18 -- nvmf/common.sh@297 -- # mlx=() 00:14:30.206 01:50:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:30.206 01:50:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:30.206 01:50:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:30.206 01:50:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:30.206 01:50:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:30.206 01:50:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:30.206 01:50:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:30.206 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:30.206 01:50:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:30.206 01:50:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:30.206 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:30.206 01:50:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:30.206 01:50:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:30.206 01:50:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:30.206 01:50:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:30.206 01:50:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:30.206 01:50:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:30.206 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:30.206 01:50:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:30.206 01:50:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:30.206 01:50:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:30.206 01:50:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:30.206 01:50:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:30.206 01:50:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:30.206 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:30.206 01:50:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:30.206 01:50:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:30.206 01:50:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:30.206 01:50:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:30.206 01:50:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:30.206 01:50:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:30.206 01:50:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:30.206 01:50:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:30.206 01:50:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:30.206 01:50:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:30.206 01:50:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:30.206 01:50:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:30.206 01:50:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:30.206 01:50:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:30.206 01:50:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:30.206 01:50:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:30.206 01:50:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:30.206 01:50:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:30.206 01:50:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:30.206 01:50:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:30.206 01:50:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:30.206 01:50:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:30.206 01:50:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:30.206 01:50:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:30.206 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:30.206 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:14:30.206 00:14:30.206 --- 10.0.0.2 ping statistics --- 00:14:30.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:30.206 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:14:30.206 01:50:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:30.206 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:30.206 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:14:30.206 00:14:30.206 --- 10.0.0.1 ping statistics --- 00:14:30.206 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:30.206 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:14:30.206 01:50:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:30.206 01:50:18 -- nvmf/common.sh@410 -- # return 0 00:14:30.206 01:50:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:30.206 01:50:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:30.206 01:50:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:30.206 01:50:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:30.206 01:50:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:30.206 01:50:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:30.206 01:50:18 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:30.206 01:50:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:30.206 01:50:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:30.206 01:50:18 -- common/autotest_common.sh@10 -- # set +x 00:14:30.206 01:50:18 -- nvmf/common.sh@469 -- # nvmfpid=3422071 00:14:30.206 01:50:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:30.206 01:50:18 -- nvmf/common.sh@470 -- # waitforlisten 3422071 00:14:30.206 01:50:18 -- common/autotest_common.sh@829 -- # '[' -z 3422071 ']' 00:14:30.206 01:50:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:30.206 01:50:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:30.206 01:50:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:30.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:30.207 01:50:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:30.207 01:50:18 -- common/autotest_common.sh@10 -- # set +x 00:14:30.207 [2024-11-19 01:50:18.379694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:30.207 [2024-11-19 01:50:18.379781] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:30.207 EAL: No free 2048 kB hugepages reported on node 1 00:14:30.207 [2024-11-19 01:50:18.450341] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:30.207 [2024-11-19 01:50:18.568161] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:30.207 [2024-11-19 01:50:18.568308] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:30.207 [2024-11-19 01:50:18.568326] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:30.207 [2024-11-19 01:50:18.568338] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:30.207 [2024-11-19 01:50:18.568396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:30.207 [2024-11-19 01:50:18.568433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:30.207 [2024-11-19 01:50:18.568437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:31.148 01:50:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:31.149 01:50:19 -- common/autotest_common.sh@862 -- # return 0 00:14:31.149 01:50:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:31.149 01:50:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:31.149 01:50:19 -- common/autotest_common.sh@10 -- # set +x 00:14:31.149 01:50:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:31.149 01:50:19 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:31.149 [2024-11-19 01:50:19.679796] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:31.406 01:50:19 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:31.664 01:50:19 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:31.664 01:50:19 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:31.923 01:50:20 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:31.923 01:50:20 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:32.180 01:50:20 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:32.439 01:50:20 -- target/nvmf_lvol.sh@29 -- # lvs=94659a78-3e12-44d6-b7ec-621a3162750a 00:14:32.439 01:50:20 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 94659a78-3e12-44d6-b7ec-621a3162750a lvol 20 00:14:32.697 01:50:21 -- target/nvmf_lvol.sh@32 -- # lvol=4272ec48-bf83-4587-a241-5161344c7d5f 00:14:32.697 01:50:21 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:32.955 01:50:21 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4272ec48-bf83-4587-a241-5161344c7d5f 00:14:33.212 01:50:21 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:33.470 [2024-11-19 01:50:21.801092] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:33.470 01:50:21 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:33.728 01:50:22 -- target/nvmf_lvol.sh@42 -- # perf_pid=3422644 00:14:33.728 01:50:22 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:33.728 01:50:22 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:33.728 EAL: No free 2048 kB hugepages reported on node 1 00:14:34.663 01:50:23 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 4272ec48-bf83-4587-a241-5161344c7d5f MY_SNAPSHOT 00:14:34.922 01:50:23 -- target/nvmf_lvol.sh@47 -- # snapshot=b77f26d1-b948-4cab-9ded-e48c220a8dc7 00:14:34.922 01:50:23 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 4272ec48-bf83-4587-a241-5161344c7d5f 30 00:14:35.180 01:50:23 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone b77f26d1-b948-4cab-9ded-e48c220a8dc7 MY_CLONE 00:14:35.438 01:50:23 -- target/nvmf_lvol.sh@49 -- # clone=7ad1e296-0f1a-42c0-8b74-f13ddd7e3518 00:14:35.438 01:50:23 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 7ad1e296-0f1a-42c0-8b74-f13ddd7e3518 00:14:36.005 01:50:24 -- target/nvmf_lvol.sh@53 -- # wait 3422644 00:14:44.115 Initializing NVMe Controllers 00:14:44.115 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:44.115 Controller IO queue size 128, less than required. 00:14:44.115 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:44.115 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:44.115 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:44.115 Initialization complete. Launching workers. 00:14:44.115 ======================================================== 00:14:44.115 Latency(us) 00:14:44.115 Device Information : IOPS MiB/s Average min max 00:14:44.115 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10330.30 40.35 12399.34 1882.36 82207.83 00:14:44.115 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10849.00 42.38 11808.32 2009.10 57334.14 00:14:44.115 ======================================================== 00:14:44.115 Total : 21179.30 82.73 12096.59 1882.36 82207.83 00:14:44.115 00:14:44.115 01:50:32 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:44.371 01:50:32 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4272ec48-bf83-4587-a241-5161344c7d5f 00:14:44.627 01:50:33 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 94659a78-3e12-44d6-b7ec-621a3162750a 00:14:44.886 01:50:33 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:44.886 01:50:33 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:44.886 01:50:33 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:44.886 01:50:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:44.886 01:50:33 -- nvmf/common.sh@116 -- # sync 00:14:44.886 01:50:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:44.886 01:50:33 -- nvmf/common.sh@119 -- # set +e 00:14:44.886 01:50:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:44.886 01:50:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:44.886 rmmod nvme_tcp 00:14:44.886 rmmod nvme_fabrics 00:14:44.886 rmmod nvme_keyring 00:14:44.886 01:50:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:44.886 01:50:33 -- nvmf/common.sh@123 -- # set -e 00:14:44.886 01:50:33 -- nvmf/common.sh@124 -- # return 0 00:14:44.886 01:50:33 -- nvmf/common.sh@477 -- # '[' -n 3422071 ']' 00:14:44.886 01:50:33 -- nvmf/common.sh@478 -- # killprocess 3422071 00:14:44.886 01:50:33 -- common/autotest_common.sh@936 -- # '[' -z 3422071 ']' 00:14:44.886 01:50:33 -- common/autotest_common.sh@940 -- # kill -0 3422071 00:14:44.886 01:50:33 -- common/autotest_common.sh@941 -- # uname 00:14:45.144 01:50:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:45.144 01:50:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3422071 00:14:45.144 01:50:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:45.144 01:50:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:45.144 01:50:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3422071' 00:14:45.144 killing process with pid 3422071 00:14:45.144 01:50:33 -- common/autotest_common.sh@955 -- # kill 3422071 00:14:45.144 01:50:33 -- common/autotest_common.sh@960 -- # wait 3422071 00:14:45.403 01:50:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:45.403 01:50:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:45.403 01:50:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:45.403 01:50:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:45.403 01:50:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:45.403 01:50:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:45.403 01:50:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:45.403 01:50:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.304 01:50:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:47.304 00:14:47.304 real 0m19.948s 00:14:47.304 user 1m6.838s 00:14:47.304 sys 0m5.819s 00:14:47.304 01:50:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:47.304 01:50:35 -- common/autotest_common.sh@10 -- # set +x 00:14:47.304 ************************************ 00:14:47.304 END TEST nvmf_lvol 00:14:47.304 ************************************ 00:14:47.564 01:50:35 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:47.564 01:50:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:47.564 01:50:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:47.564 01:50:35 -- common/autotest_common.sh@10 -- # set +x 00:14:47.564 ************************************ 00:14:47.564 START TEST nvmf_lvs_grow 00:14:47.564 ************************************ 00:14:47.564 01:50:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:47.564 * Looking for test storage... 00:14:47.564 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:47.564 01:50:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:47.564 01:50:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:47.564 01:50:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:47.564 01:50:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:47.564 01:50:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:47.564 01:50:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:47.564 01:50:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:47.564 01:50:36 -- scripts/common.sh@335 -- # IFS=.-: 00:14:47.564 01:50:36 -- scripts/common.sh@335 -- # read -ra ver1 00:14:47.564 01:50:36 -- scripts/common.sh@336 -- # IFS=.-: 00:14:47.564 01:50:36 -- scripts/common.sh@336 -- # read -ra ver2 00:14:47.564 01:50:36 -- scripts/common.sh@337 -- # local 'op=<' 00:14:47.564 01:50:36 -- scripts/common.sh@339 -- # ver1_l=2 00:14:47.564 01:50:36 -- scripts/common.sh@340 -- # ver2_l=1 00:14:47.564 01:50:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:47.564 01:50:36 -- scripts/common.sh@343 -- # case "$op" in 00:14:47.564 01:50:36 -- scripts/common.sh@344 -- # : 1 00:14:47.564 01:50:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:47.564 01:50:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:47.564 01:50:36 -- scripts/common.sh@364 -- # decimal 1 00:14:47.564 01:50:36 -- scripts/common.sh@352 -- # local d=1 00:14:47.564 01:50:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:47.564 01:50:36 -- scripts/common.sh@354 -- # echo 1 00:14:47.564 01:50:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:47.564 01:50:36 -- scripts/common.sh@365 -- # decimal 2 00:14:47.564 01:50:36 -- scripts/common.sh@352 -- # local d=2 00:14:47.564 01:50:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:47.564 01:50:36 -- scripts/common.sh@354 -- # echo 2 00:14:47.564 01:50:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:47.564 01:50:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:47.564 01:50:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:47.564 01:50:36 -- scripts/common.sh@367 -- # return 0 00:14:47.564 01:50:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:47.564 01:50:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:47.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.564 --rc genhtml_branch_coverage=1 00:14:47.564 --rc genhtml_function_coverage=1 00:14:47.564 --rc genhtml_legend=1 00:14:47.564 --rc geninfo_all_blocks=1 00:14:47.564 --rc geninfo_unexecuted_blocks=1 00:14:47.564 00:14:47.564 ' 00:14:47.564 01:50:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:47.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.564 --rc genhtml_branch_coverage=1 00:14:47.564 --rc genhtml_function_coverage=1 00:14:47.564 --rc genhtml_legend=1 00:14:47.564 --rc geninfo_all_blocks=1 00:14:47.564 --rc geninfo_unexecuted_blocks=1 00:14:47.564 00:14:47.564 ' 00:14:47.564 01:50:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:47.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.564 --rc genhtml_branch_coverage=1 00:14:47.564 --rc genhtml_function_coverage=1 00:14:47.564 --rc genhtml_legend=1 00:14:47.564 --rc geninfo_all_blocks=1 00:14:47.564 --rc geninfo_unexecuted_blocks=1 00:14:47.564 00:14:47.564 ' 00:14:47.564 01:50:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:47.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.564 --rc genhtml_branch_coverage=1 00:14:47.564 --rc genhtml_function_coverage=1 00:14:47.564 --rc genhtml_legend=1 00:14:47.564 --rc geninfo_all_blocks=1 00:14:47.564 --rc geninfo_unexecuted_blocks=1 00:14:47.564 00:14:47.564 ' 00:14:47.564 01:50:36 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:47.564 01:50:36 -- nvmf/common.sh@7 -- # uname -s 00:14:47.564 01:50:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:47.564 01:50:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:47.564 01:50:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:47.564 01:50:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:47.564 01:50:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:47.564 01:50:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:47.564 01:50:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:47.564 01:50:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:47.564 01:50:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:47.564 01:50:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:47.564 01:50:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.564 01:50:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.564 01:50:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:47.564 01:50:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:47.564 01:50:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:47.564 01:50:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:47.564 01:50:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:47.564 01:50:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:47.564 01:50:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:47.564 01:50:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.564 01:50:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.564 01:50:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.564 01:50:36 -- paths/export.sh@5 -- # export PATH 00:14:47.564 01:50:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.564 01:50:36 -- nvmf/common.sh@46 -- # : 0 00:14:47.564 01:50:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:47.564 01:50:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:47.564 01:50:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:47.564 01:50:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:47.564 01:50:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:47.564 01:50:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:47.564 01:50:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:47.564 01:50:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:47.564 01:50:36 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:47.564 01:50:36 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:47.564 01:50:36 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:47.564 01:50:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:47.564 01:50:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:47.564 01:50:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:47.564 01:50:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:47.564 01:50:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:47.564 01:50:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:47.564 01:50:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:47.564 01:50:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.564 01:50:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:47.564 01:50:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:47.564 01:50:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:47.564 01:50:36 -- common/autotest_common.sh@10 -- # set +x 00:14:50.097 01:50:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:50.097 01:50:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:50.097 01:50:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:50.097 01:50:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:50.097 01:50:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:50.097 01:50:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:50.097 01:50:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:50.097 01:50:38 -- nvmf/common.sh@294 -- # net_devs=() 00:14:50.097 01:50:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:50.097 01:50:38 -- nvmf/common.sh@295 -- # e810=() 00:14:50.097 01:50:38 -- nvmf/common.sh@295 -- # local -ga e810 00:14:50.097 01:50:38 -- nvmf/common.sh@296 -- # x722=() 00:14:50.097 01:50:38 -- nvmf/common.sh@296 -- # local -ga x722 00:14:50.097 01:50:38 -- nvmf/common.sh@297 -- # mlx=() 00:14:50.097 01:50:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:50.097 01:50:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:50.097 01:50:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:50.097 01:50:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:50.097 01:50:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:50.097 01:50:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.097 01:50:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:50.097 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:50.097 01:50:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.097 01:50:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:50.097 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:50.097 01:50:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:50.097 01:50:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.097 01:50:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.097 01:50:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.097 01:50:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.097 01:50:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:50.097 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:50.097 01:50:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.097 01:50:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.097 01:50:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.097 01:50:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.097 01:50:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.097 01:50:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:50.097 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:50.097 01:50:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.097 01:50:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:50.097 01:50:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:50.097 01:50:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:50.097 01:50:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:50.097 01:50:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:50.097 01:50:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:50.097 01:50:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:50.098 01:50:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:50.098 01:50:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:50.098 01:50:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:50.098 01:50:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:50.098 01:50:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:50.098 01:50:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:50.098 01:50:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:50.098 01:50:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:50.098 01:50:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:50.098 01:50:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:50.098 01:50:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:50.098 01:50:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:50.098 01:50:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:50.098 01:50:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:50.098 01:50:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:50.098 01:50:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:50.098 01:50:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:50.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:50.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.321 ms 00:14:50.098 00:14:50.098 --- 10.0.0.2 ping statistics --- 00:14:50.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.098 rtt min/avg/max/mdev = 0.321/0.321/0.321/0.000 ms 00:14:50.098 01:50:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:50.098 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:50.098 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:14:50.098 00:14:50.098 --- 10.0.0.1 ping statistics --- 00:14:50.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.098 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:14:50.098 01:50:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:50.098 01:50:38 -- nvmf/common.sh@410 -- # return 0 00:14:50.098 01:50:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:50.098 01:50:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:50.098 01:50:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:50.098 01:50:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:50.098 01:50:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:50.098 01:50:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:50.098 01:50:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:50.098 01:50:38 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:50.098 01:50:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:50.098 01:50:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:50.098 01:50:38 -- common/autotest_common.sh@10 -- # set +x 00:14:50.098 01:50:38 -- nvmf/common.sh@469 -- # nvmfpid=3425962 00:14:50.098 01:50:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:50.098 01:50:38 -- nvmf/common.sh@470 -- # waitforlisten 3425962 00:14:50.098 01:50:38 -- common/autotest_common.sh@829 -- # '[' -z 3425962 ']' 00:14:50.098 01:50:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:50.098 01:50:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:50.098 01:50:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:50.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:50.098 01:50:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:50.098 01:50:38 -- common/autotest_common.sh@10 -- # set +x 00:14:50.098 [2024-11-19 01:50:38.340872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:50.098 [2024-11-19 01:50:38.340969] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:50.098 EAL: No free 2048 kB hugepages reported on node 1 00:14:50.098 [2024-11-19 01:50:38.410093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:50.098 [2024-11-19 01:50:38.525900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:50.098 [2024-11-19 01:50:38.526063] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:50.098 [2024-11-19 01:50:38.526081] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:50.098 [2024-11-19 01:50:38.526093] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:50.098 [2024-11-19 01:50:38.526121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:51.032 01:50:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:51.032 01:50:39 -- common/autotest_common.sh@862 -- # return 0 00:14:51.032 01:50:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:51.032 01:50:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:51.032 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:14:51.032 01:50:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:51.032 [2024-11-19 01:50:39.545436] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:51.032 01:50:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:51.032 01:50:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:51.032 01:50:39 -- common/autotest_common.sh@10 -- # set +x 00:14:51.032 ************************************ 00:14:51.032 START TEST lvs_grow_clean 00:14:51.032 ************************************ 00:14:51.032 01:50:39 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:51.032 01:50:39 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:51.290 01:50:39 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:51.548 01:50:39 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:51.548 01:50:39 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:51.806 01:50:40 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d5310b96-e0af-4122-ac60-2f6b45a46d19 00:14:51.806 01:50:40 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:14:51.806 01:50:40 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:52.064 01:50:40 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:52.064 01:50:40 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:52.064 01:50:40 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d5310b96-e0af-4122-ac60-2f6b45a46d19 lvol 150 00:14:52.323 01:50:40 -- target/nvmf_lvs_grow.sh@33 -- # lvol=ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0 00:14:52.323 01:50:40 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:52.323 01:50:40 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:52.581 [2024-11-19 01:50:41.016330] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:52.581 [2024-11-19 01:50:41.016416] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:52.581 true 00:14:52.581 01:50:41 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:14:52.581 01:50:41 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:52.839 01:50:41 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:52.839 01:50:41 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:53.097 01:50:41 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0 00:14:53.355 01:50:41 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:53.613 [2024-11-19 01:50:42.027492] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:53.613 01:50:42 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:53.871 01:50:42 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3426424 00:14:53.871 01:50:42 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:53.871 01:50:42 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:53.871 01:50:42 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3426424 /var/tmp/bdevperf.sock 00:14:53.871 01:50:42 -- common/autotest_common.sh@829 -- # '[' -z 3426424 ']' 00:14:53.871 01:50:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:53.871 01:50:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:53.871 01:50:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:53.871 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:53.871 01:50:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:53.871 01:50:42 -- common/autotest_common.sh@10 -- # set +x 00:14:53.871 [2024-11-19 01:50:42.334237] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:53.871 [2024-11-19 01:50:42.334305] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3426424 ] 00:14:53.871 EAL: No free 2048 kB hugepages reported on node 1 00:14:53.871 [2024-11-19 01:50:42.396137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:54.130 [2024-11-19 01:50:42.511843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.064 01:50:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:55.064 01:50:43 -- common/autotest_common.sh@862 -- # return 0 00:14:55.064 01:50:43 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:55.322 Nvme0n1 00:14:55.322 01:50:43 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:55.580 [ 00:14:55.580 { 00:14:55.580 "name": "Nvme0n1", 00:14:55.580 "aliases": [ 00:14:55.580 "ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0" 00:14:55.580 ], 00:14:55.580 "product_name": "NVMe disk", 00:14:55.580 "block_size": 4096, 00:14:55.580 "num_blocks": 38912, 00:14:55.580 "uuid": "ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0", 00:14:55.580 "assigned_rate_limits": { 00:14:55.580 "rw_ios_per_sec": 0, 00:14:55.580 "rw_mbytes_per_sec": 0, 00:14:55.580 "r_mbytes_per_sec": 0, 00:14:55.581 "w_mbytes_per_sec": 0 00:14:55.581 }, 00:14:55.581 "claimed": false, 00:14:55.581 "zoned": false, 00:14:55.581 "supported_io_types": { 00:14:55.581 "read": true, 00:14:55.581 "write": true, 00:14:55.581 "unmap": true, 00:14:55.581 "write_zeroes": true, 00:14:55.581 "flush": true, 00:14:55.581 "reset": true, 00:14:55.581 "compare": true, 00:14:55.581 "compare_and_write": true, 00:14:55.581 "abort": true, 00:14:55.581 "nvme_admin": true, 00:14:55.581 "nvme_io": true 00:14:55.581 }, 00:14:55.581 "driver_specific": { 00:14:55.581 "nvme": [ 00:14:55.581 { 00:14:55.581 "trid": { 00:14:55.581 "trtype": "TCP", 00:14:55.581 "adrfam": "IPv4", 00:14:55.581 "traddr": "10.0.0.2", 00:14:55.581 "trsvcid": "4420", 00:14:55.581 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:55.581 }, 00:14:55.581 "ctrlr_data": { 00:14:55.581 "cntlid": 1, 00:14:55.581 "vendor_id": "0x8086", 00:14:55.581 "model_number": "SPDK bdev Controller", 00:14:55.581 "serial_number": "SPDK0", 00:14:55.581 "firmware_revision": "24.01.1", 00:14:55.581 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:55.581 "oacs": { 00:14:55.581 "security": 0, 00:14:55.581 "format": 0, 00:14:55.581 "firmware": 0, 00:14:55.581 "ns_manage": 0 00:14:55.581 }, 00:14:55.581 "multi_ctrlr": true, 00:14:55.581 "ana_reporting": false 00:14:55.581 }, 00:14:55.581 "vs": { 00:14:55.581 "nvme_version": "1.3" 00:14:55.581 }, 00:14:55.581 "ns_data": { 00:14:55.581 "id": 1, 00:14:55.581 "can_share": true 00:14:55.581 } 00:14:55.581 } 00:14:55.581 ], 00:14:55.581 "mp_policy": "active_passive" 00:14:55.581 } 00:14:55.581 } 00:14:55.581 ] 00:14:55.581 01:50:43 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3426688 00:14:55.581 01:50:43 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:55.581 01:50:43 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:55.581 Running I/O for 10 seconds... 00:14:56.516 Latency(us) 00:14:56.516 [2024-11-19T00:50:45.059Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:56.516 [2024-11-19T00:50:45.059Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.516 Nvme0n1 : 1.00 14677.00 57.33 0.00 0.00 0.00 0.00 0.00 00:14:56.516 [2024-11-19T00:50:45.059Z] =================================================================================================================== 00:14:56.516 [2024-11-19T00:50:45.059Z] Total : 14677.00 57.33 0.00 0.00 0.00 0.00 0.00 00:14:56.516 00:14:57.452 01:50:45 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:14:57.711 [2024-11-19T00:50:46.254Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.711 Nvme0n1 : 2.00 14850.50 58.01 0.00 0.00 0.00 0.00 0.00 00:14:57.711 [2024-11-19T00:50:46.254Z] =================================================================================================================== 00:14:57.711 [2024-11-19T00:50:46.254Z] Total : 14850.50 58.01 0.00 0.00 0.00 0.00 0.00 00:14:57.711 00:14:57.711 true 00:14:57.711 01:50:46 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:14:57.711 01:50:46 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:57.969 01:50:46 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:57.969 01:50:46 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:57.969 01:50:46 -- target/nvmf_lvs_grow.sh@65 -- # wait 3426688 00:14:58.536 [2024-11-19T00:50:47.079Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.536 Nvme0n1 : 3.00 14886.00 58.15 0.00 0.00 0.00 0.00 0.00 00:14:58.536 [2024-11-19T00:50:47.079Z] =================================================================================================================== 00:14:58.536 [2024-11-19T00:50:47.079Z] Total : 14886.00 58.15 0.00 0.00 0.00 0.00 0.00 00:14:58.536 00:14:59.911 [2024-11-19T00:50:48.454Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.911 Nvme0n1 : 4.00 14991.50 58.56 0.00 0.00 0.00 0.00 0.00 00:14:59.911 [2024-11-19T00:50:48.454Z] =================================================================================================================== 00:14:59.911 [2024-11-19T00:50:48.454Z] Total : 14991.50 58.56 0.00 0.00 0.00 0.00 0.00 00:14:59.911 00:15:00.845 [2024-11-19T00:50:49.388Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.845 Nvme0n1 : 5.00 15081.60 58.91 0.00 0.00 0.00 0.00 0.00 00:15:00.845 [2024-11-19T00:50:49.388Z] =================================================================================================================== 00:15:00.845 [2024-11-19T00:50:49.388Z] Total : 15081.60 58.91 0.00 0.00 0.00 0.00 0.00 00:15:00.845 00:15:01.776 [2024-11-19T00:50:50.320Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.777 Nvme0n1 : 6.00 15121.33 59.07 0.00 0.00 0.00 0.00 0.00 00:15:01.777 [2024-11-19T00:50:50.320Z] =================================================================================================================== 00:15:01.777 [2024-11-19T00:50:50.320Z] Total : 15121.33 59.07 0.00 0.00 0.00 0.00 0.00 00:15:01.777 00:15:02.711 [2024-11-19T00:50:51.254Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.711 Nvme0n1 : 7.00 15161.43 59.22 0.00 0.00 0.00 0.00 0.00 00:15:02.711 [2024-11-19T00:50:51.254Z] =================================================================================================================== 00:15:02.711 [2024-11-19T00:50:51.254Z] Total : 15161.43 59.22 0.00 0.00 0.00 0.00 0.00 00:15:02.711 00:15:03.667 [2024-11-19T00:50:52.210Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.667 Nvme0n1 : 8.00 15196.00 59.36 0.00 0.00 0.00 0.00 0.00 00:15:03.667 [2024-11-19T00:50:52.210Z] =================================================================================================================== 00:15:03.667 [2024-11-19T00:50:52.210Z] Total : 15196.00 59.36 0.00 0.00 0.00 0.00 0.00 00:15:03.667 00:15:04.642 [2024-11-19T00:50:53.185Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.642 Nvme0n1 : 9.00 15207.00 59.40 0.00 0.00 0.00 0.00 0.00 00:15:04.642 [2024-11-19T00:50:53.185Z] =================================================================================================================== 00:15:04.642 [2024-11-19T00:50:53.185Z] Total : 15207.00 59.40 0.00 0.00 0.00 0.00 0.00 00:15:04.642 00:15:05.577 [2024-11-19T00:50:54.120Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.577 Nvme0n1 : 10.00 15243.80 59.55 0.00 0.00 0.00 0.00 0.00 00:15:05.577 [2024-11-19T00:50:54.120Z] =================================================================================================================== 00:15:05.577 [2024-11-19T00:50:54.120Z] Total : 15243.80 59.55 0.00 0.00 0.00 0.00 0.00 00:15:05.577 00:15:05.577 00:15:05.577 Latency(us) 00:15:05.577 [2024-11-19T00:50:54.120Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:05.577 [2024-11-19T00:50:54.120Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.577 Nvme0n1 : 10.01 15248.96 59.57 0.00 0.00 8389.49 4636.07 18641.35 00:15:05.577 [2024-11-19T00:50:54.120Z] =================================================================================================================== 00:15:05.577 [2024-11-19T00:50:54.120Z] Total : 15248.96 59.57 0.00 0.00 8389.49 4636.07 18641.35 00:15:05.577 0 00:15:05.577 01:50:54 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3426424 00:15:05.577 01:50:54 -- common/autotest_common.sh@936 -- # '[' -z 3426424 ']' 00:15:05.577 01:50:54 -- common/autotest_common.sh@940 -- # kill -0 3426424 00:15:05.577 01:50:54 -- common/autotest_common.sh@941 -- # uname 00:15:05.577 01:50:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:05.577 01:50:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3426424 00:15:05.835 01:50:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:05.835 01:50:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:05.835 01:50:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3426424' 00:15:05.835 killing process with pid 3426424 00:15:05.835 01:50:54 -- common/autotest_common.sh@955 -- # kill 3426424 00:15:05.835 Received shutdown signal, test time was about 10.000000 seconds 00:15:05.835 00:15:05.835 Latency(us) 00:15:05.835 [2024-11-19T00:50:54.378Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:05.835 [2024-11-19T00:50:54.378Z] =================================================================================================================== 00:15:05.835 [2024-11-19T00:50:54.378Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:05.835 01:50:54 -- common/autotest_common.sh@960 -- # wait 3426424 00:15:06.093 01:50:54 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:06.351 01:50:54 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:15:06.351 01:50:54 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:06.609 01:50:54 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:06.609 01:50:54 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:06.609 01:50:54 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:06.868 [2024-11-19 01:50:55.241605] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:06.868 01:50:55 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:15:06.868 01:50:55 -- common/autotest_common.sh@650 -- # local es=0 00:15:06.868 01:50:55 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:15:06.868 01:50:55 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:06.868 01:50:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:06.868 01:50:55 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:06.868 01:50:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:06.868 01:50:55 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:06.868 01:50:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:06.868 01:50:55 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:06.868 01:50:55 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:06.868 01:50:55 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:15:07.127 request: 00:15:07.127 { 00:15:07.127 "uuid": "d5310b96-e0af-4122-ac60-2f6b45a46d19", 00:15:07.127 "method": "bdev_lvol_get_lvstores", 00:15:07.127 "req_id": 1 00:15:07.127 } 00:15:07.127 Got JSON-RPC error response 00:15:07.127 response: 00:15:07.127 { 00:15:07.127 "code": -19, 00:15:07.127 "message": "No such device" 00:15:07.127 } 00:15:07.127 01:50:55 -- common/autotest_common.sh@653 -- # es=1 00:15:07.127 01:50:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:07.127 01:50:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:07.127 01:50:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:07.127 01:50:55 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:07.385 aio_bdev 00:15:07.385 01:50:55 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0 00:15:07.385 01:50:55 -- common/autotest_common.sh@897 -- # local bdev_name=ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0 00:15:07.385 01:50:55 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:07.385 01:50:55 -- common/autotest_common.sh@899 -- # local i 00:15:07.385 01:50:55 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:07.385 01:50:55 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:07.385 01:50:55 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:07.643 01:50:56 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0 -t 2000 00:15:07.901 [ 00:15:07.901 { 00:15:07.901 "name": "ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0", 00:15:07.901 "aliases": [ 00:15:07.901 "lvs/lvol" 00:15:07.901 ], 00:15:07.901 "product_name": "Logical Volume", 00:15:07.901 "block_size": 4096, 00:15:07.901 "num_blocks": 38912, 00:15:07.901 "uuid": "ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0", 00:15:07.901 "assigned_rate_limits": { 00:15:07.901 "rw_ios_per_sec": 0, 00:15:07.901 "rw_mbytes_per_sec": 0, 00:15:07.901 "r_mbytes_per_sec": 0, 00:15:07.901 "w_mbytes_per_sec": 0 00:15:07.901 }, 00:15:07.901 "claimed": false, 00:15:07.901 "zoned": false, 00:15:07.901 "supported_io_types": { 00:15:07.901 "read": true, 00:15:07.901 "write": true, 00:15:07.901 "unmap": true, 00:15:07.901 "write_zeroes": true, 00:15:07.901 "flush": false, 00:15:07.901 "reset": true, 00:15:07.901 "compare": false, 00:15:07.901 "compare_and_write": false, 00:15:07.901 "abort": false, 00:15:07.901 "nvme_admin": false, 00:15:07.901 "nvme_io": false 00:15:07.901 }, 00:15:07.901 "driver_specific": { 00:15:07.901 "lvol": { 00:15:07.901 "lvol_store_uuid": "d5310b96-e0af-4122-ac60-2f6b45a46d19", 00:15:07.901 "base_bdev": "aio_bdev", 00:15:07.901 "thin_provision": false, 00:15:07.901 "snapshot": false, 00:15:07.901 "clone": false, 00:15:07.901 "esnap_clone": false 00:15:07.901 } 00:15:07.901 } 00:15:07.901 } 00:15:07.901 ] 00:15:07.901 01:50:56 -- common/autotest_common.sh@905 -- # return 0 00:15:07.901 01:50:56 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:15:07.901 01:50:56 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:08.159 01:50:56 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:08.159 01:50:56 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:15:08.159 01:50:56 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:08.417 01:50:56 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:08.417 01:50:56 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ef6fc45f-6cd7-403a-afb8-5d8e85be7ae0 00:15:08.675 01:50:57 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d5310b96-e0af-4122-ac60-2f6b45a46d19 00:15:08.934 01:50:57 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:09.191 00:15:09.191 real 0m18.086s 00:15:09.191 user 0m17.922s 00:15:09.191 sys 0m1.759s 00:15:09.191 01:50:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:09.191 01:50:57 -- common/autotest_common.sh@10 -- # set +x 00:15:09.191 ************************************ 00:15:09.191 END TEST lvs_grow_clean 00:15:09.191 ************************************ 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:09.191 01:50:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:09.191 01:50:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:09.191 01:50:57 -- common/autotest_common.sh@10 -- # set +x 00:15:09.191 ************************************ 00:15:09.191 START TEST lvs_grow_dirty 00:15:09.191 ************************************ 00:15:09.191 01:50:57 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:09.191 01:50:57 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:09.757 01:50:58 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:09.757 01:50:58 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:09.757 01:50:58 -- target/nvmf_lvs_grow.sh@28 -- # lvs=ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:09.757 01:50:58 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:09.757 01:50:58 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:10.015 01:50:58 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:10.015 01:50:58 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:10.015 01:50:58 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d lvol 150 00:15:10.273 01:50:58 -- target/nvmf_lvs_grow.sh@33 -- # lvol=6318c012-19e1-4c35-a639-6f1cb4d2f0f0 00:15:10.273 01:50:58 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:10.273 01:50:58 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:10.532 [2024-11-19 01:50:59.036982] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:10.532 [2024-11-19 01:50:59.037074] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:10.532 true 00:15:10.532 01:50:59 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:10.532 01:50:59 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:10.790 01:50:59 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:10.790 01:50:59 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:11.048 01:50:59 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 6318c012-19e1-4c35-a639-6f1cb4d2f0f0 00:15:11.306 01:50:59 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:11.564 01:51:00 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:11.823 01:51:00 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3428692 00:15:11.823 01:51:00 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:11.823 01:51:00 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:11.823 01:51:00 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3428692 /var/tmp/bdevperf.sock 00:15:11.823 01:51:00 -- common/autotest_common.sh@829 -- # '[' -z 3428692 ']' 00:15:11.823 01:51:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:11.823 01:51:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:11.823 01:51:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:11.823 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:11.823 01:51:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:11.823 01:51:00 -- common/autotest_common.sh@10 -- # set +x 00:15:12.081 [2024-11-19 01:51:00.382523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:12.081 [2024-11-19 01:51:00.382614] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3428692 ] 00:15:12.081 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.081 [2024-11-19 01:51:00.446673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:12.081 [2024-11-19 01:51:00.561816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:13.015 01:51:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:13.015 01:51:01 -- common/autotest_common.sh@862 -- # return 0 00:15:13.015 01:51:01 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:13.273 Nvme0n1 00:15:13.531 01:51:01 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:13.531 [ 00:15:13.531 { 00:15:13.531 "name": "Nvme0n1", 00:15:13.531 "aliases": [ 00:15:13.531 "6318c012-19e1-4c35-a639-6f1cb4d2f0f0" 00:15:13.531 ], 00:15:13.531 "product_name": "NVMe disk", 00:15:13.531 "block_size": 4096, 00:15:13.531 "num_blocks": 38912, 00:15:13.531 "uuid": "6318c012-19e1-4c35-a639-6f1cb4d2f0f0", 00:15:13.531 "assigned_rate_limits": { 00:15:13.531 "rw_ios_per_sec": 0, 00:15:13.531 "rw_mbytes_per_sec": 0, 00:15:13.531 "r_mbytes_per_sec": 0, 00:15:13.531 "w_mbytes_per_sec": 0 00:15:13.531 }, 00:15:13.531 "claimed": false, 00:15:13.531 "zoned": false, 00:15:13.531 "supported_io_types": { 00:15:13.531 "read": true, 00:15:13.531 "write": true, 00:15:13.531 "unmap": true, 00:15:13.531 "write_zeroes": true, 00:15:13.531 "flush": true, 00:15:13.531 "reset": true, 00:15:13.531 "compare": true, 00:15:13.531 "compare_and_write": true, 00:15:13.531 "abort": true, 00:15:13.531 "nvme_admin": true, 00:15:13.531 "nvme_io": true 00:15:13.531 }, 00:15:13.531 "driver_specific": { 00:15:13.531 "nvme": [ 00:15:13.531 { 00:15:13.531 "trid": { 00:15:13.531 "trtype": "TCP", 00:15:13.531 "adrfam": "IPv4", 00:15:13.531 "traddr": "10.0.0.2", 00:15:13.531 "trsvcid": "4420", 00:15:13.531 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:13.531 }, 00:15:13.531 "ctrlr_data": { 00:15:13.531 "cntlid": 1, 00:15:13.531 "vendor_id": "0x8086", 00:15:13.531 "model_number": "SPDK bdev Controller", 00:15:13.531 "serial_number": "SPDK0", 00:15:13.531 "firmware_revision": "24.01.1", 00:15:13.531 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:13.531 "oacs": { 00:15:13.531 "security": 0, 00:15:13.531 "format": 0, 00:15:13.531 "firmware": 0, 00:15:13.531 "ns_manage": 0 00:15:13.531 }, 00:15:13.531 "multi_ctrlr": true, 00:15:13.531 "ana_reporting": false 00:15:13.531 }, 00:15:13.531 "vs": { 00:15:13.531 "nvme_version": "1.3" 00:15:13.531 }, 00:15:13.531 "ns_data": { 00:15:13.531 "id": 1, 00:15:13.531 "can_share": true 00:15:13.531 } 00:15:13.531 } 00:15:13.531 ], 00:15:13.531 "mp_policy": "active_passive" 00:15:13.531 } 00:15:13.531 } 00:15:13.531 ] 00:15:13.790 01:51:02 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3429048 00:15:13.790 01:51:02 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:13.790 01:51:02 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:13.790 Running I/O for 10 seconds... 00:15:14.724 Latency(us) 00:15:14.724 [2024-11-19T00:51:03.268Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:14.725 [2024-11-19T00:51:03.268Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.725 Nvme0n1 : 1.00 14860.00 58.05 0.00 0.00 0.00 0.00 0.00 00:15:14.725 [2024-11-19T00:51:03.268Z] =================================================================================================================== 00:15:14.725 [2024-11-19T00:51:03.268Z] Total : 14860.00 58.05 0.00 0.00 0.00 0.00 0.00 00:15:14.725 00:15:15.660 01:51:04 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:15.660 [2024-11-19T00:51:04.203Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.660 Nvme0n1 : 2.00 14970.50 58.48 0.00 0.00 0.00 0.00 0.00 00:15:15.660 [2024-11-19T00:51:04.203Z] =================================================================================================================== 00:15:15.660 [2024-11-19T00:51:04.203Z] Total : 14970.50 58.48 0.00 0.00 0.00 0.00 0.00 00:15:15.660 00:15:15.918 true 00:15:15.918 01:51:04 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:15.918 01:51:04 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:16.176 01:51:04 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:16.176 01:51:04 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:16.176 01:51:04 -- target/nvmf_lvs_grow.sh@65 -- # wait 3429048 00:15:16.742 [2024-11-19T00:51:05.285Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.742 Nvme0n1 : 3.00 15125.67 59.08 0.00 0.00 0.00 0.00 0.00 00:15:16.742 [2024-11-19T00:51:05.285Z] =================================================================================================================== 00:15:16.742 [2024-11-19T00:51:05.285Z] Total : 15125.67 59.08 0.00 0.00 0.00 0.00 0.00 00:15:16.742 00:15:17.677 [2024-11-19T00:51:06.220Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:17.677 Nvme0n1 : 4.00 15255.50 59.59 0.00 0.00 0.00 0.00 0.00 00:15:17.677 [2024-11-19T00:51:06.220Z] =================================================================================================================== 00:15:17.677 [2024-11-19T00:51:06.220Z] Total : 15255.50 59.59 0.00 0.00 0.00 0.00 0.00 00:15:17.677 00:15:19.051 [2024-11-19T00:51:07.594Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.051 Nvme0n1 : 5.00 15269.20 59.65 0.00 0.00 0.00 0.00 0.00 00:15:19.051 [2024-11-19T00:51:07.594Z] =================================================================================================================== 00:15:19.051 [2024-11-19T00:51:07.594Z] Total : 15269.20 59.65 0.00 0.00 0.00 0.00 0.00 00:15:19.051 00:15:19.986 [2024-11-19T00:51:08.529Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.986 Nvme0n1 : 6.00 15311.00 59.81 0.00 0.00 0.00 0.00 0.00 00:15:19.986 [2024-11-19T00:51:08.529Z] =================================================================================================================== 00:15:19.986 [2024-11-19T00:51:08.529Z] Total : 15311.00 59.81 0.00 0.00 0.00 0.00 0.00 00:15:19.986 00:15:20.919 [2024-11-19T00:51:09.462Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.919 Nvme0n1 : 7.00 15384.43 60.10 0.00 0.00 0.00 0.00 0.00 00:15:20.919 [2024-11-19T00:51:09.462Z] =================================================================================================================== 00:15:20.919 [2024-11-19T00:51:09.462Z] Total : 15384.43 60.10 0.00 0.00 0.00 0.00 0.00 00:15:20.919 00:15:21.853 [2024-11-19T00:51:10.396Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:21.853 Nvme0n1 : 8.00 15406.25 60.18 0.00 0.00 0.00 0.00 0.00 00:15:21.853 [2024-11-19T00:51:10.396Z] =================================================================================================================== 00:15:21.853 [2024-11-19T00:51:10.396Z] Total : 15406.25 60.18 0.00 0.00 0.00 0.00 0.00 00:15:21.853 00:15:22.787 [2024-11-19T00:51:11.330Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.787 Nvme0n1 : 9.00 15419.22 60.23 0.00 0.00 0.00 0.00 0.00 00:15:22.787 [2024-11-19T00:51:11.330Z] =================================================================================================================== 00:15:22.787 [2024-11-19T00:51:11.330Z] Total : 15419.22 60.23 0.00 0.00 0.00 0.00 0.00 00:15:22.787 00:15:23.722 [2024-11-19T00:51:12.265Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:23.722 Nvme0n1 : 10.00 15433.00 60.29 0.00 0.00 0.00 0.00 0.00 00:15:23.722 [2024-11-19T00:51:12.265Z] =================================================================================================================== 00:15:23.722 [2024-11-19T00:51:12.265Z] Total : 15433.00 60.29 0.00 0.00 0.00 0.00 0.00 00:15:23.722 00:15:23.722 00:15:23.722 Latency(us) 00:15:23.722 [2024-11-19T00:51:12.265Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:23.722 [2024-11-19T00:51:12.265Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:23.722 Nvme0n1 : 10.00 15431.99 60.28 0.00 0.00 8288.27 4271.98 18641.35 00:15:23.722 [2024-11-19T00:51:12.265Z] =================================================================================================================== 00:15:23.722 [2024-11-19T00:51:12.265Z] Total : 15431.99 60.28 0.00 0.00 8288.27 4271.98 18641.35 00:15:23.722 0 00:15:23.722 01:51:12 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3428692 00:15:23.722 01:51:12 -- common/autotest_common.sh@936 -- # '[' -z 3428692 ']' 00:15:23.722 01:51:12 -- common/autotest_common.sh@940 -- # kill -0 3428692 00:15:23.722 01:51:12 -- common/autotest_common.sh@941 -- # uname 00:15:23.722 01:51:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:23.722 01:51:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3428692 00:15:23.980 01:51:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:23.980 01:51:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:23.980 01:51:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3428692' 00:15:23.980 killing process with pid 3428692 00:15:23.980 01:51:12 -- common/autotest_common.sh@955 -- # kill 3428692 00:15:23.980 Received shutdown signal, test time was about 10.000000 seconds 00:15:23.980 00:15:23.980 Latency(us) 00:15:23.980 [2024-11-19T00:51:12.523Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:23.980 [2024-11-19T00:51:12.523Z] =================================================================================================================== 00:15:23.980 [2024-11-19T00:51:12.523Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:23.980 01:51:12 -- common/autotest_common.sh@960 -- # wait 3428692 00:15:24.238 01:51:12 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:24.497 01:51:12 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:24.497 01:51:12 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:24.755 01:51:13 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:24.755 01:51:13 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:24.755 01:51:13 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3425962 00:15:24.755 01:51:13 -- target/nvmf_lvs_grow.sh@74 -- # wait 3425962 00:15:24.755 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3425962 Killed "${NVMF_APP[@]}" "$@" 00:15:24.755 01:51:13 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:24.755 01:51:13 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:24.755 01:51:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:24.755 01:51:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:24.755 01:51:13 -- common/autotest_common.sh@10 -- # set +x 00:15:24.755 01:51:13 -- nvmf/common.sh@469 -- # nvmfpid=3430919 00:15:24.755 01:51:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:24.755 01:51:13 -- nvmf/common.sh@470 -- # waitforlisten 3430919 00:15:24.755 01:51:13 -- common/autotest_common.sh@829 -- # '[' -z 3430919 ']' 00:15:24.755 01:51:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:24.755 01:51:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:24.755 01:51:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:24.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:24.755 01:51:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:24.755 01:51:13 -- common/autotest_common.sh@10 -- # set +x 00:15:24.755 [2024-11-19 01:51:13.162099] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:24.755 [2024-11-19 01:51:13.162174] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:24.755 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.755 [2024-11-19 01:51:13.226905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.014 [2024-11-19 01:51:13.336251] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:25.014 [2024-11-19 01:51:13.336387] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:25.014 [2024-11-19 01:51:13.336403] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:25.014 [2024-11-19 01:51:13.336416] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:25.014 [2024-11-19 01:51:13.336443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:25.948 01:51:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:25.948 01:51:14 -- common/autotest_common.sh@862 -- # return 0 00:15:25.948 01:51:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:25.948 01:51:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:25.948 01:51:14 -- common/autotest_common.sh@10 -- # set +x 00:15:25.948 01:51:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:25.948 01:51:14 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:25.948 [2024-11-19 01:51:14.398370] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:25.948 [2024-11-19 01:51:14.398498] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:25.948 [2024-11-19 01:51:14.398545] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:25.948 01:51:14 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:25.948 01:51:14 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 6318c012-19e1-4c35-a639-6f1cb4d2f0f0 00:15:25.948 01:51:14 -- common/autotest_common.sh@897 -- # local bdev_name=6318c012-19e1-4c35-a639-6f1cb4d2f0f0 00:15:25.948 01:51:14 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:25.948 01:51:14 -- common/autotest_common.sh@899 -- # local i 00:15:25.948 01:51:14 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:25.948 01:51:14 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:25.948 01:51:14 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:26.206 01:51:14 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 6318c012-19e1-4c35-a639-6f1cb4d2f0f0 -t 2000 00:15:26.464 [ 00:15:26.464 { 00:15:26.464 "name": "6318c012-19e1-4c35-a639-6f1cb4d2f0f0", 00:15:26.464 "aliases": [ 00:15:26.464 "lvs/lvol" 00:15:26.464 ], 00:15:26.464 "product_name": "Logical Volume", 00:15:26.464 "block_size": 4096, 00:15:26.464 "num_blocks": 38912, 00:15:26.464 "uuid": "6318c012-19e1-4c35-a639-6f1cb4d2f0f0", 00:15:26.464 "assigned_rate_limits": { 00:15:26.464 "rw_ios_per_sec": 0, 00:15:26.464 "rw_mbytes_per_sec": 0, 00:15:26.464 "r_mbytes_per_sec": 0, 00:15:26.464 "w_mbytes_per_sec": 0 00:15:26.464 }, 00:15:26.464 "claimed": false, 00:15:26.464 "zoned": false, 00:15:26.464 "supported_io_types": { 00:15:26.464 "read": true, 00:15:26.464 "write": true, 00:15:26.464 "unmap": true, 00:15:26.464 "write_zeroes": true, 00:15:26.464 "flush": false, 00:15:26.464 "reset": true, 00:15:26.464 "compare": false, 00:15:26.464 "compare_and_write": false, 00:15:26.464 "abort": false, 00:15:26.464 "nvme_admin": false, 00:15:26.464 "nvme_io": false 00:15:26.464 }, 00:15:26.464 "driver_specific": { 00:15:26.464 "lvol": { 00:15:26.464 "lvol_store_uuid": "ed45fde9-09ec-4933-a3ca-f0db1e640e2d", 00:15:26.464 "base_bdev": "aio_bdev", 00:15:26.464 "thin_provision": false, 00:15:26.464 "snapshot": false, 00:15:26.464 "clone": false, 00:15:26.464 "esnap_clone": false 00:15:26.464 } 00:15:26.464 } 00:15:26.464 } 00:15:26.464 ] 00:15:26.465 01:51:14 -- common/autotest_common.sh@905 -- # return 0 00:15:26.465 01:51:14 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:26.465 01:51:14 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:26.723 01:51:15 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:26.723 01:51:15 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:26.723 01:51:15 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:26.981 01:51:15 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:26.981 01:51:15 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:27.239 [2024-11-19 01:51:15.675678] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:27.239 01:51:15 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:27.239 01:51:15 -- common/autotest_common.sh@650 -- # local es=0 00:15:27.239 01:51:15 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:27.239 01:51:15 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:27.239 01:51:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:27.239 01:51:15 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:27.239 01:51:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:27.239 01:51:15 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:27.239 01:51:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:27.239 01:51:15 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:27.239 01:51:15 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:27.239 01:51:15 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:27.499 request: 00:15:27.499 { 00:15:27.499 "uuid": "ed45fde9-09ec-4933-a3ca-f0db1e640e2d", 00:15:27.499 "method": "bdev_lvol_get_lvstores", 00:15:27.499 "req_id": 1 00:15:27.499 } 00:15:27.499 Got JSON-RPC error response 00:15:27.499 response: 00:15:27.499 { 00:15:27.499 "code": -19, 00:15:27.499 "message": "No such device" 00:15:27.499 } 00:15:27.499 01:51:15 -- common/autotest_common.sh@653 -- # es=1 00:15:27.499 01:51:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:27.499 01:51:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:27.499 01:51:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:27.499 01:51:15 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:27.827 aio_bdev 00:15:27.827 01:51:16 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 6318c012-19e1-4c35-a639-6f1cb4d2f0f0 00:15:27.827 01:51:16 -- common/autotest_common.sh@897 -- # local bdev_name=6318c012-19e1-4c35-a639-6f1cb4d2f0f0 00:15:27.827 01:51:16 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:27.827 01:51:16 -- common/autotest_common.sh@899 -- # local i 00:15:27.827 01:51:16 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:27.827 01:51:16 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:27.827 01:51:16 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:28.094 01:51:16 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 6318c012-19e1-4c35-a639-6f1cb4d2f0f0 -t 2000 00:15:28.352 [ 00:15:28.352 { 00:15:28.352 "name": "6318c012-19e1-4c35-a639-6f1cb4d2f0f0", 00:15:28.352 "aliases": [ 00:15:28.352 "lvs/lvol" 00:15:28.352 ], 00:15:28.352 "product_name": "Logical Volume", 00:15:28.352 "block_size": 4096, 00:15:28.352 "num_blocks": 38912, 00:15:28.352 "uuid": "6318c012-19e1-4c35-a639-6f1cb4d2f0f0", 00:15:28.352 "assigned_rate_limits": { 00:15:28.352 "rw_ios_per_sec": 0, 00:15:28.352 "rw_mbytes_per_sec": 0, 00:15:28.352 "r_mbytes_per_sec": 0, 00:15:28.352 "w_mbytes_per_sec": 0 00:15:28.352 }, 00:15:28.352 "claimed": false, 00:15:28.352 "zoned": false, 00:15:28.352 "supported_io_types": { 00:15:28.352 "read": true, 00:15:28.352 "write": true, 00:15:28.352 "unmap": true, 00:15:28.352 "write_zeroes": true, 00:15:28.352 "flush": false, 00:15:28.352 "reset": true, 00:15:28.352 "compare": false, 00:15:28.352 "compare_and_write": false, 00:15:28.352 "abort": false, 00:15:28.352 "nvme_admin": false, 00:15:28.352 "nvme_io": false 00:15:28.352 }, 00:15:28.352 "driver_specific": { 00:15:28.352 "lvol": { 00:15:28.352 "lvol_store_uuid": "ed45fde9-09ec-4933-a3ca-f0db1e640e2d", 00:15:28.352 "base_bdev": "aio_bdev", 00:15:28.352 "thin_provision": false, 00:15:28.352 "snapshot": false, 00:15:28.352 "clone": false, 00:15:28.352 "esnap_clone": false 00:15:28.352 } 00:15:28.352 } 00:15:28.352 } 00:15:28.352 ] 00:15:28.352 01:51:16 -- common/autotest_common.sh@905 -- # return 0 00:15:28.352 01:51:16 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:28.352 01:51:16 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:28.610 01:51:17 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:28.610 01:51:17 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:28.610 01:51:17 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:28.868 01:51:17 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:28.868 01:51:17 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 6318c012-19e1-4c35-a639-6f1cb4d2f0f0 00:15:29.126 01:51:17 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u ed45fde9-09ec-4933-a3ca-f0db1e640e2d 00:15:29.384 01:51:17 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:29.642 01:51:18 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:29.642 00:15:29.642 real 0m20.402s 00:15:29.642 user 0m51.369s 00:15:29.642 sys 0m4.628s 00:15:29.642 01:51:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:29.642 01:51:18 -- common/autotest_common.sh@10 -- # set +x 00:15:29.642 ************************************ 00:15:29.642 END TEST lvs_grow_dirty 00:15:29.642 ************************************ 00:15:29.642 01:51:18 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:29.642 01:51:18 -- common/autotest_common.sh@806 -- # type=--id 00:15:29.642 01:51:18 -- common/autotest_common.sh@807 -- # id=0 00:15:29.642 01:51:18 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:29.642 01:51:18 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:29.642 01:51:18 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:29.642 01:51:18 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:29.642 01:51:18 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:29.642 01:51:18 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:29.642 nvmf_trace.0 00:15:29.642 01:51:18 -- common/autotest_common.sh@821 -- # return 0 00:15:29.642 01:51:18 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:29.642 01:51:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:29.642 01:51:18 -- nvmf/common.sh@116 -- # sync 00:15:29.642 01:51:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:29.642 01:51:18 -- nvmf/common.sh@119 -- # set +e 00:15:29.642 01:51:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:29.642 01:51:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:29.642 rmmod nvme_tcp 00:15:29.642 rmmod nvme_fabrics 00:15:29.642 rmmod nvme_keyring 00:15:29.901 01:51:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:29.901 01:51:18 -- nvmf/common.sh@123 -- # set -e 00:15:29.901 01:51:18 -- nvmf/common.sh@124 -- # return 0 00:15:29.901 01:51:18 -- nvmf/common.sh@477 -- # '[' -n 3430919 ']' 00:15:29.901 01:51:18 -- nvmf/common.sh@478 -- # killprocess 3430919 00:15:29.901 01:51:18 -- common/autotest_common.sh@936 -- # '[' -z 3430919 ']' 00:15:29.901 01:51:18 -- common/autotest_common.sh@940 -- # kill -0 3430919 00:15:29.901 01:51:18 -- common/autotest_common.sh@941 -- # uname 00:15:29.901 01:51:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:29.901 01:51:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3430919 00:15:29.901 01:51:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:29.901 01:51:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:29.901 01:51:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3430919' 00:15:29.901 killing process with pid 3430919 00:15:29.901 01:51:18 -- common/autotest_common.sh@955 -- # kill 3430919 00:15:29.901 01:51:18 -- common/autotest_common.sh@960 -- # wait 3430919 00:15:30.159 01:51:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:30.159 01:51:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:30.159 01:51:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:30.159 01:51:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:30.159 01:51:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:30.159 01:51:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:30.159 01:51:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:30.159 01:51:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:32.060 01:51:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:32.060 00:15:32.060 real 0m44.682s 00:15:32.060 user 1m16.064s 00:15:32.060 sys 0m8.360s 00:15:32.060 01:51:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:32.060 01:51:20 -- common/autotest_common.sh@10 -- # set +x 00:15:32.060 ************************************ 00:15:32.060 END TEST nvmf_lvs_grow 00:15:32.060 ************************************ 00:15:32.060 01:51:20 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:32.060 01:51:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:32.060 01:51:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:32.060 01:51:20 -- common/autotest_common.sh@10 -- # set +x 00:15:32.060 ************************************ 00:15:32.060 START TEST nvmf_bdev_io_wait 00:15:32.060 ************************************ 00:15:32.060 01:51:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:32.319 * Looking for test storage... 00:15:32.319 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:32.319 01:51:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:32.319 01:51:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:32.319 01:51:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:32.319 01:51:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:32.319 01:51:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:32.319 01:51:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:32.319 01:51:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:32.319 01:51:20 -- scripts/common.sh@335 -- # IFS=.-: 00:15:32.319 01:51:20 -- scripts/common.sh@335 -- # read -ra ver1 00:15:32.319 01:51:20 -- scripts/common.sh@336 -- # IFS=.-: 00:15:32.319 01:51:20 -- scripts/common.sh@336 -- # read -ra ver2 00:15:32.319 01:51:20 -- scripts/common.sh@337 -- # local 'op=<' 00:15:32.319 01:51:20 -- scripts/common.sh@339 -- # ver1_l=2 00:15:32.319 01:51:20 -- scripts/common.sh@340 -- # ver2_l=1 00:15:32.319 01:51:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:32.319 01:51:20 -- scripts/common.sh@343 -- # case "$op" in 00:15:32.319 01:51:20 -- scripts/common.sh@344 -- # : 1 00:15:32.319 01:51:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:32.319 01:51:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:32.319 01:51:20 -- scripts/common.sh@364 -- # decimal 1 00:15:32.319 01:51:20 -- scripts/common.sh@352 -- # local d=1 00:15:32.319 01:51:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:32.319 01:51:20 -- scripts/common.sh@354 -- # echo 1 00:15:32.319 01:51:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:32.319 01:51:20 -- scripts/common.sh@365 -- # decimal 2 00:15:32.319 01:51:20 -- scripts/common.sh@352 -- # local d=2 00:15:32.319 01:51:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:32.319 01:51:20 -- scripts/common.sh@354 -- # echo 2 00:15:32.319 01:51:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:32.319 01:51:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:32.319 01:51:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:32.319 01:51:20 -- scripts/common.sh@367 -- # return 0 00:15:32.319 01:51:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:32.319 01:51:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:32.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.319 --rc genhtml_branch_coverage=1 00:15:32.319 --rc genhtml_function_coverage=1 00:15:32.319 --rc genhtml_legend=1 00:15:32.319 --rc geninfo_all_blocks=1 00:15:32.319 --rc geninfo_unexecuted_blocks=1 00:15:32.319 00:15:32.319 ' 00:15:32.319 01:51:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:32.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.319 --rc genhtml_branch_coverage=1 00:15:32.319 --rc genhtml_function_coverage=1 00:15:32.319 --rc genhtml_legend=1 00:15:32.319 --rc geninfo_all_blocks=1 00:15:32.319 --rc geninfo_unexecuted_blocks=1 00:15:32.319 00:15:32.319 ' 00:15:32.319 01:51:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:32.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.319 --rc genhtml_branch_coverage=1 00:15:32.319 --rc genhtml_function_coverage=1 00:15:32.319 --rc genhtml_legend=1 00:15:32.319 --rc geninfo_all_blocks=1 00:15:32.319 --rc geninfo_unexecuted_blocks=1 00:15:32.319 00:15:32.319 ' 00:15:32.319 01:51:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:32.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.319 --rc genhtml_branch_coverage=1 00:15:32.319 --rc genhtml_function_coverage=1 00:15:32.319 --rc genhtml_legend=1 00:15:32.319 --rc geninfo_all_blocks=1 00:15:32.319 --rc geninfo_unexecuted_blocks=1 00:15:32.319 00:15:32.319 ' 00:15:32.319 01:51:20 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:32.319 01:51:20 -- nvmf/common.sh@7 -- # uname -s 00:15:32.319 01:51:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:32.319 01:51:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:32.319 01:51:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:32.319 01:51:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:32.319 01:51:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:32.319 01:51:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:32.319 01:51:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:32.319 01:51:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:32.319 01:51:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:32.319 01:51:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:32.319 01:51:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:32.319 01:51:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:32.319 01:51:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:32.319 01:51:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:32.319 01:51:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:32.319 01:51:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:32.319 01:51:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:32.319 01:51:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:32.319 01:51:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:32.319 01:51:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.319 01:51:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.319 01:51:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.319 01:51:20 -- paths/export.sh@5 -- # export PATH 00:15:32.320 01:51:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.320 01:51:20 -- nvmf/common.sh@46 -- # : 0 00:15:32.320 01:51:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:32.320 01:51:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:32.320 01:51:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:32.320 01:51:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:32.320 01:51:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:32.320 01:51:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:32.320 01:51:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:32.320 01:51:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:32.320 01:51:20 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:32.320 01:51:20 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:32.320 01:51:20 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:32.320 01:51:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:32.320 01:51:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:32.320 01:51:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:32.320 01:51:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:32.320 01:51:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:32.320 01:51:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:32.320 01:51:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:32.320 01:51:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:32.320 01:51:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:32.320 01:51:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:32.320 01:51:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:32.320 01:51:20 -- common/autotest_common.sh@10 -- # set +x 00:15:34.852 01:51:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:34.852 01:51:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:34.852 01:51:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:34.852 01:51:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:34.852 01:51:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:34.852 01:51:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:34.852 01:51:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:34.852 01:51:22 -- nvmf/common.sh@294 -- # net_devs=() 00:15:34.852 01:51:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:34.852 01:51:22 -- nvmf/common.sh@295 -- # e810=() 00:15:34.852 01:51:22 -- nvmf/common.sh@295 -- # local -ga e810 00:15:34.852 01:51:22 -- nvmf/common.sh@296 -- # x722=() 00:15:34.852 01:51:22 -- nvmf/common.sh@296 -- # local -ga x722 00:15:34.852 01:51:22 -- nvmf/common.sh@297 -- # mlx=() 00:15:34.852 01:51:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:34.852 01:51:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:34.852 01:51:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:34.852 01:51:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:34.852 01:51:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:34.852 01:51:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:34.852 01:51:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:34.852 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:34.852 01:51:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:34.852 01:51:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:34.852 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:34.852 01:51:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:34.852 01:51:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:34.852 01:51:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:34.852 01:51:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:34.852 01:51:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:34.852 01:51:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:34.852 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:34.852 01:51:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:34.852 01:51:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:34.852 01:51:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:34.852 01:51:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:34.852 01:51:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:34.852 01:51:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:34.852 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:34.852 01:51:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:34.852 01:51:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:34.852 01:51:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:34.852 01:51:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:34.852 01:51:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:34.852 01:51:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:34.852 01:51:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:34.852 01:51:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:34.852 01:51:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:34.852 01:51:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:34.852 01:51:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:34.852 01:51:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:34.852 01:51:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:34.852 01:51:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:34.852 01:51:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:34.852 01:51:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:34.852 01:51:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:34.852 01:51:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:34.852 01:51:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:34.852 01:51:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:34.852 01:51:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:34.852 01:51:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:34.852 01:51:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:34.852 01:51:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:34.852 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:34.852 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:15:34.852 00:15:34.852 --- 10.0.0.2 ping statistics --- 00:15:34.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:34.852 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:15:34.852 01:51:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:34.852 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:34.852 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:15:34.852 00:15:34.852 --- 10.0.0.1 ping statistics --- 00:15:34.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:34.852 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:15:34.852 01:51:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:34.852 01:51:22 -- nvmf/common.sh@410 -- # return 0 00:15:34.852 01:51:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:34.852 01:51:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:34.852 01:51:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:34.852 01:51:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:34.852 01:51:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:34.852 01:51:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:34.852 01:51:22 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:34.852 01:51:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:34.853 01:51:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:34.853 01:51:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 01:51:22 -- nvmf/common.sh@469 -- # nvmfpid=3433491 00:15:34.853 01:51:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:34.853 01:51:22 -- nvmf/common.sh@470 -- # waitforlisten 3433491 00:15:34.853 01:51:22 -- common/autotest_common.sh@829 -- # '[' -z 3433491 ']' 00:15:34.853 01:51:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:34.853 01:51:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:34.853 01:51:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:34.853 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:34.853 01:51:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:34.853 01:51:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 [2024-11-19 01:51:22.983617] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:34.853 [2024-11-19 01:51:22.983718] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:34.853 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.853 [2024-11-19 01:51:23.049794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:34.853 [2024-11-19 01:51:23.164409] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:34.853 [2024-11-19 01:51:23.164536] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:34.853 [2024-11-19 01:51:23.164552] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:34.853 [2024-11-19 01:51:23.164565] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:34.853 [2024-11-19 01:51:23.164658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:34.853 [2024-11-19 01:51:23.164701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:34.853 [2024-11-19 01:51:23.164774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:34.853 [2024-11-19 01:51:23.164777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:34.853 01:51:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:34.853 01:51:23 -- common/autotest_common.sh@862 -- # return 0 00:15:34.853 01:51:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:34.853 01:51:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 01:51:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:34.853 01:51:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 01:51:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:34.853 01:51:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 01:51:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:34.853 01:51:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 [2024-11-19 01:51:23.326214] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:34.853 01:51:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:34.853 01:51:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 Malloc0 00:15:34.853 01:51:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:34.853 01:51:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 01:51:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:34.853 01:51:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 01:51:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:34.853 01:51:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.853 01:51:23 -- common/autotest_common.sh@10 -- # set +x 00:15:34.853 [2024-11-19 01:51:23.391299] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:34.853 01:51:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.853 01:51:23 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3433640 00:15:35.112 01:51:23 -- target/bdev_io_wait.sh@30 -- # READ_PID=3433641 00:15:35.112 01:51:23 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:35.112 01:51:23 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:35.112 01:51:23 -- nvmf/common.sh@520 -- # config=() 00:15:35.112 01:51:23 -- nvmf/common.sh@520 -- # local subsystem config 00:15:35.112 01:51:23 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3433644 00:15:35.112 01:51:23 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:35.112 01:51:23 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:35.112 01:51:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:35.112 01:51:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:35.112 { 00:15:35.112 "params": { 00:15:35.112 "name": "Nvme$subsystem", 00:15:35.112 "trtype": "$TEST_TRANSPORT", 00:15:35.112 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:35.112 "adrfam": "ipv4", 00:15:35.112 "trsvcid": "$NVMF_PORT", 00:15:35.112 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:35.112 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:35.112 "hdgst": ${hdgst:-false}, 00:15:35.112 "ddgst": ${ddgst:-false} 00:15:35.112 }, 00:15:35.112 "method": "bdev_nvme_attach_controller" 00:15:35.112 } 00:15:35.113 EOF 00:15:35.113 )") 00:15:35.113 01:51:23 -- nvmf/common.sh@520 -- # config=() 00:15:35.113 01:51:23 -- nvmf/common.sh@520 -- # local subsystem config 00:15:35.113 01:51:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:35.113 01:51:23 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3433646 00:15:35.113 01:51:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:35.113 { 00:15:35.113 "params": { 00:15:35.113 "name": "Nvme$subsystem", 00:15:35.113 "trtype": "$TEST_TRANSPORT", 00:15:35.113 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:35.113 "adrfam": "ipv4", 00:15:35.113 "trsvcid": "$NVMF_PORT", 00:15:35.113 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:35.113 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:35.113 "hdgst": ${hdgst:-false}, 00:15:35.113 "ddgst": ${ddgst:-false} 00:15:35.113 }, 00:15:35.113 "method": "bdev_nvme_attach_controller" 00:15:35.113 } 00:15:35.113 EOF 00:15:35.113 )") 00:15:35.113 01:51:23 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:35.113 01:51:23 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:35.113 01:51:23 -- target/bdev_io_wait.sh@35 -- # sync 00:15:35.113 01:51:23 -- nvmf/common.sh@520 -- # config=() 00:15:35.113 01:51:23 -- nvmf/common.sh@520 -- # local subsystem config 00:15:35.113 01:51:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:35.113 01:51:23 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:35.113 01:51:23 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:35.113 01:51:23 -- nvmf/common.sh@542 -- # cat 00:15:35.113 01:51:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:35.113 { 00:15:35.113 "params": { 00:15:35.113 "name": "Nvme$subsystem", 00:15:35.113 "trtype": "$TEST_TRANSPORT", 00:15:35.113 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:35.113 "adrfam": "ipv4", 00:15:35.113 "trsvcid": "$NVMF_PORT", 00:15:35.113 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:35.113 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:35.113 "hdgst": ${hdgst:-false}, 00:15:35.113 "ddgst": ${ddgst:-false} 00:15:35.113 }, 00:15:35.113 "method": "bdev_nvme_attach_controller" 00:15:35.113 } 00:15:35.113 EOF 00:15:35.113 )") 00:15:35.113 01:51:23 -- nvmf/common.sh@520 -- # config=() 00:15:35.113 01:51:23 -- nvmf/common.sh@520 -- # local subsystem config 00:15:35.113 01:51:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:35.113 01:51:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:35.113 { 00:15:35.113 "params": { 00:15:35.113 "name": "Nvme$subsystem", 00:15:35.113 "trtype": "$TEST_TRANSPORT", 00:15:35.113 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:35.113 "adrfam": "ipv4", 00:15:35.113 "trsvcid": "$NVMF_PORT", 00:15:35.113 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:35.113 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:35.113 "hdgst": ${hdgst:-false}, 00:15:35.113 "ddgst": ${ddgst:-false} 00:15:35.113 }, 00:15:35.113 "method": "bdev_nvme_attach_controller" 00:15:35.113 } 00:15:35.113 EOF 00:15:35.113 )") 00:15:35.113 01:51:23 -- nvmf/common.sh@542 -- # cat 00:15:35.113 01:51:23 -- nvmf/common.sh@542 -- # cat 00:15:35.113 01:51:23 -- target/bdev_io_wait.sh@37 -- # wait 3433640 00:15:35.113 01:51:23 -- nvmf/common.sh@542 -- # cat 00:15:35.113 01:51:23 -- nvmf/common.sh@544 -- # jq . 00:15:35.113 01:51:23 -- nvmf/common.sh@544 -- # jq . 00:15:35.113 01:51:23 -- nvmf/common.sh@544 -- # jq . 00:15:35.113 01:51:23 -- nvmf/common.sh@544 -- # jq . 00:15:35.113 01:51:23 -- nvmf/common.sh@545 -- # IFS=, 00:15:35.113 01:51:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:35.113 "params": { 00:15:35.113 "name": "Nvme1", 00:15:35.113 "trtype": "tcp", 00:15:35.113 "traddr": "10.0.0.2", 00:15:35.113 "adrfam": "ipv4", 00:15:35.113 "trsvcid": "4420", 00:15:35.113 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:35.113 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:35.113 "hdgst": false, 00:15:35.113 "ddgst": false 00:15:35.113 }, 00:15:35.113 "method": "bdev_nvme_attach_controller" 00:15:35.113 }' 00:15:35.113 01:51:23 -- nvmf/common.sh@545 -- # IFS=, 00:15:35.113 01:51:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:35.113 "params": { 00:15:35.113 "name": "Nvme1", 00:15:35.113 "trtype": "tcp", 00:15:35.113 "traddr": "10.0.0.2", 00:15:35.113 "adrfam": "ipv4", 00:15:35.113 "trsvcid": "4420", 00:15:35.113 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:35.113 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:35.113 "hdgst": false, 00:15:35.113 "ddgst": false 00:15:35.113 }, 00:15:35.113 "method": "bdev_nvme_attach_controller" 00:15:35.113 }' 00:15:35.113 01:51:23 -- nvmf/common.sh@545 -- # IFS=, 00:15:35.113 01:51:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:35.113 "params": { 00:15:35.113 "name": "Nvme1", 00:15:35.113 "trtype": "tcp", 00:15:35.113 "traddr": "10.0.0.2", 00:15:35.113 "adrfam": "ipv4", 00:15:35.113 "trsvcid": "4420", 00:15:35.113 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:35.113 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:35.113 "hdgst": false, 00:15:35.113 "ddgst": false 00:15:35.113 }, 00:15:35.113 "method": "bdev_nvme_attach_controller" 00:15:35.113 }' 00:15:35.113 01:51:23 -- nvmf/common.sh@545 -- # IFS=, 00:15:35.113 01:51:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:35.113 "params": { 00:15:35.113 "name": "Nvme1", 00:15:35.113 "trtype": "tcp", 00:15:35.113 "traddr": "10.0.0.2", 00:15:35.113 "adrfam": "ipv4", 00:15:35.113 "trsvcid": "4420", 00:15:35.113 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:35.113 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:35.113 "hdgst": false, 00:15:35.113 "ddgst": false 00:15:35.113 }, 00:15:35.113 "method": "bdev_nvme_attach_controller" 00:15:35.113 }' 00:15:35.113 [2024-11-19 01:51:23.435241] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:35.113 [2024-11-19 01:51:23.435308] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:35.113 [2024-11-19 01:51:23.436343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:35.113 [2024-11-19 01:51:23.436341] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:35.113 [2024-11-19 01:51:23.436341] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:35.113 [2024-11-19 01:51:23.436429] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-19 01:51:23.436430] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-19 01:51:23.436429] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:35.113 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:35.113 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:35.113 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.113 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.113 [2024-11-19 01:51:23.607747] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.372 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.372 [2024-11-19 01:51:23.701930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:35.372 [2024-11-19 01:51:23.707277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.372 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.372 [2024-11-19 01:51:23.803112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:35.372 [2024-11-19 01:51:23.805318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.372 [2024-11-19 01:51:23.879051] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.372 [2024-11-19 01:51:23.904130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:35.630 [2024-11-19 01:51:23.972043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:35.630 Running I/O for 1 seconds... 00:15:35.630 Running I/O for 1 seconds... 00:15:35.889 Running I/O for 1 seconds... 00:15:35.889 Running I/O for 1 seconds... 00:15:36.823 00:15:36.823 Latency(us) 00:15:36.823 [2024-11-19T00:51:25.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.823 [2024-11-19T00:51:25.366Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:36.823 Nvme1n1 : 1.00 184451.02 720.51 0.00 0.00 691.31 289.75 940.56 00:15:36.823 [2024-11-19T00:51:25.366Z] =================================================================================================================== 00:15:36.823 [2024-11-19T00:51:25.366Z] Total : 184451.02 720.51 0.00 0.00 691.31 289.75 940.56 00:15:36.823 00:15:36.823 Latency(us) 00:15:36.823 [2024-11-19T00:51:25.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.823 [2024-11-19T00:51:25.366Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:36.823 Nvme1n1 : 1.02 7443.93 29.08 0.00 0.00 17065.67 8446.86 27379.48 00:15:36.823 [2024-11-19T00:51:25.366Z] =================================================================================================================== 00:15:36.823 [2024-11-19T00:51:25.366Z] Total : 7443.93 29.08 0.00 0.00 17065.67 8446.86 27379.48 00:15:36.823 00:15:36.823 Latency(us) 00:15:36.823 [2024-11-19T00:51:25.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.823 [2024-11-19T00:51:25.366Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:36.823 Nvme1n1 : 1.01 9220.81 36.02 0.00 0.00 13820.11 7815.77 27185.30 00:15:36.823 [2024-11-19T00:51:25.366Z] =================================================================================================================== 00:15:36.823 [2024-11-19T00:51:25.366Z] Total : 9220.81 36.02 0.00 0.00 13820.11 7815.77 27185.30 00:15:36.823 00:15:36.823 Latency(us) 00:15:36.823 [2024-11-19T00:51:25.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.823 [2024-11-19T00:51:25.366Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:36.823 Nvme1n1 : 1.00 7374.63 28.81 0.00 0.00 17310.23 4417.61 42913.94 00:15:36.823 [2024-11-19T00:51:25.366Z] =================================================================================================================== 00:15:36.823 [2024-11-19T00:51:25.366Z] Total : 7374.63 28.81 0.00 0.00 17310.23 4417.61 42913.94 00:15:37.082 01:51:25 -- target/bdev_io_wait.sh@38 -- # wait 3433641 00:15:37.082 01:51:25 -- target/bdev_io_wait.sh@39 -- # wait 3433644 00:15:37.082 01:51:25 -- target/bdev_io_wait.sh@40 -- # wait 3433646 00:15:37.082 01:51:25 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:37.082 01:51:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:37.082 01:51:25 -- common/autotest_common.sh@10 -- # set +x 00:15:37.082 01:51:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:37.082 01:51:25 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:37.082 01:51:25 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:37.082 01:51:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:37.082 01:51:25 -- nvmf/common.sh@116 -- # sync 00:15:37.082 01:51:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:37.082 01:51:25 -- nvmf/common.sh@119 -- # set +e 00:15:37.082 01:51:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:37.082 01:51:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:37.082 rmmod nvme_tcp 00:15:37.082 rmmod nvme_fabrics 00:15:37.082 rmmod nvme_keyring 00:15:37.082 01:51:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:37.339 01:51:25 -- nvmf/common.sh@123 -- # set -e 00:15:37.339 01:51:25 -- nvmf/common.sh@124 -- # return 0 00:15:37.339 01:51:25 -- nvmf/common.sh@477 -- # '[' -n 3433491 ']' 00:15:37.339 01:51:25 -- nvmf/common.sh@478 -- # killprocess 3433491 00:15:37.339 01:51:25 -- common/autotest_common.sh@936 -- # '[' -z 3433491 ']' 00:15:37.339 01:51:25 -- common/autotest_common.sh@940 -- # kill -0 3433491 00:15:37.339 01:51:25 -- common/autotest_common.sh@941 -- # uname 00:15:37.339 01:51:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:37.339 01:51:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3433491 00:15:37.339 01:51:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:37.339 01:51:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:37.339 01:51:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3433491' 00:15:37.339 killing process with pid 3433491 00:15:37.339 01:51:25 -- common/autotest_common.sh@955 -- # kill 3433491 00:15:37.339 01:51:25 -- common/autotest_common.sh@960 -- # wait 3433491 00:15:37.598 01:51:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:37.598 01:51:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:37.598 01:51:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:37.598 01:51:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:37.598 01:51:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:37.598 01:51:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:37.598 01:51:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:37.598 01:51:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:39.499 01:51:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:39.499 00:15:39.499 real 0m7.370s 00:15:39.499 user 0m17.152s 00:15:39.499 sys 0m3.503s 00:15:39.499 01:51:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:39.499 01:51:27 -- common/autotest_common.sh@10 -- # set +x 00:15:39.499 ************************************ 00:15:39.499 END TEST nvmf_bdev_io_wait 00:15:39.499 ************************************ 00:15:39.499 01:51:27 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:39.499 01:51:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:39.499 01:51:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:39.499 01:51:27 -- common/autotest_common.sh@10 -- # set +x 00:15:39.499 ************************************ 00:15:39.499 START TEST nvmf_queue_depth 00:15:39.499 ************************************ 00:15:39.499 01:51:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:39.499 * Looking for test storage... 00:15:39.499 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:39.499 01:51:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:39.499 01:51:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:39.499 01:51:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:39.758 01:51:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:39.758 01:51:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:39.758 01:51:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:39.758 01:51:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:39.758 01:51:28 -- scripts/common.sh@335 -- # IFS=.-: 00:15:39.758 01:51:28 -- scripts/common.sh@335 -- # read -ra ver1 00:15:39.758 01:51:28 -- scripts/common.sh@336 -- # IFS=.-: 00:15:39.758 01:51:28 -- scripts/common.sh@336 -- # read -ra ver2 00:15:39.758 01:51:28 -- scripts/common.sh@337 -- # local 'op=<' 00:15:39.758 01:51:28 -- scripts/common.sh@339 -- # ver1_l=2 00:15:39.758 01:51:28 -- scripts/common.sh@340 -- # ver2_l=1 00:15:39.758 01:51:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:39.758 01:51:28 -- scripts/common.sh@343 -- # case "$op" in 00:15:39.758 01:51:28 -- scripts/common.sh@344 -- # : 1 00:15:39.758 01:51:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:39.758 01:51:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:39.758 01:51:28 -- scripts/common.sh@364 -- # decimal 1 00:15:39.758 01:51:28 -- scripts/common.sh@352 -- # local d=1 00:15:39.758 01:51:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:39.758 01:51:28 -- scripts/common.sh@354 -- # echo 1 00:15:39.759 01:51:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:39.759 01:51:28 -- scripts/common.sh@365 -- # decimal 2 00:15:39.759 01:51:28 -- scripts/common.sh@352 -- # local d=2 00:15:39.759 01:51:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:39.759 01:51:28 -- scripts/common.sh@354 -- # echo 2 00:15:39.759 01:51:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:39.759 01:51:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:39.759 01:51:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:39.759 01:51:28 -- scripts/common.sh@367 -- # return 0 00:15:39.759 01:51:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:39.759 01:51:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:39.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.759 --rc genhtml_branch_coverage=1 00:15:39.759 --rc genhtml_function_coverage=1 00:15:39.759 --rc genhtml_legend=1 00:15:39.759 --rc geninfo_all_blocks=1 00:15:39.759 --rc geninfo_unexecuted_blocks=1 00:15:39.759 00:15:39.759 ' 00:15:39.759 01:51:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:39.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.759 --rc genhtml_branch_coverage=1 00:15:39.759 --rc genhtml_function_coverage=1 00:15:39.759 --rc genhtml_legend=1 00:15:39.759 --rc geninfo_all_blocks=1 00:15:39.759 --rc geninfo_unexecuted_blocks=1 00:15:39.759 00:15:39.759 ' 00:15:39.759 01:51:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:39.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.759 --rc genhtml_branch_coverage=1 00:15:39.759 --rc genhtml_function_coverage=1 00:15:39.759 --rc genhtml_legend=1 00:15:39.759 --rc geninfo_all_blocks=1 00:15:39.759 --rc geninfo_unexecuted_blocks=1 00:15:39.759 00:15:39.759 ' 00:15:39.759 01:51:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:39.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:39.759 --rc genhtml_branch_coverage=1 00:15:39.759 --rc genhtml_function_coverage=1 00:15:39.759 --rc genhtml_legend=1 00:15:39.759 --rc geninfo_all_blocks=1 00:15:39.759 --rc geninfo_unexecuted_blocks=1 00:15:39.759 00:15:39.759 ' 00:15:39.759 01:51:28 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:39.759 01:51:28 -- nvmf/common.sh@7 -- # uname -s 00:15:39.759 01:51:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:39.759 01:51:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:39.759 01:51:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:39.759 01:51:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:39.759 01:51:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:39.759 01:51:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:39.759 01:51:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:39.759 01:51:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:39.759 01:51:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:39.759 01:51:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:39.759 01:51:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:39.759 01:51:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:39.759 01:51:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:39.759 01:51:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:39.759 01:51:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:39.759 01:51:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:39.759 01:51:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:39.759 01:51:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:39.759 01:51:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:39.759 01:51:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.759 01:51:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.759 01:51:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.759 01:51:28 -- paths/export.sh@5 -- # export PATH 00:15:39.759 01:51:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.759 01:51:28 -- nvmf/common.sh@46 -- # : 0 00:15:39.759 01:51:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:39.759 01:51:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:39.759 01:51:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:39.759 01:51:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:39.759 01:51:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:39.759 01:51:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:39.759 01:51:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:39.759 01:51:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:39.759 01:51:28 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:39.759 01:51:28 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:39.759 01:51:28 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:39.759 01:51:28 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:39.759 01:51:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:39.759 01:51:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:39.759 01:51:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:39.759 01:51:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:39.759 01:51:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:39.759 01:51:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:39.759 01:51:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:39.759 01:51:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:39.759 01:51:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:39.759 01:51:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:39.759 01:51:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:39.759 01:51:28 -- common/autotest_common.sh@10 -- # set +x 00:15:41.661 01:51:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:41.661 01:51:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:41.661 01:51:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:41.661 01:51:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:41.661 01:51:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:41.661 01:51:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:41.661 01:51:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:41.661 01:51:30 -- nvmf/common.sh@294 -- # net_devs=() 00:15:41.661 01:51:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:41.661 01:51:30 -- nvmf/common.sh@295 -- # e810=() 00:15:41.661 01:51:30 -- nvmf/common.sh@295 -- # local -ga e810 00:15:41.661 01:51:30 -- nvmf/common.sh@296 -- # x722=() 00:15:41.661 01:51:30 -- nvmf/common.sh@296 -- # local -ga x722 00:15:41.661 01:51:30 -- nvmf/common.sh@297 -- # mlx=() 00:15:41.661 01:51:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:41.661 01:51:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:41.661 01:51:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:41.661 01:51:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:41.661 01:51:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:41.661 01:51:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:41.661 01:51:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:41.661 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:41.661 01:51:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:41.661 01:51:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:41.661 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:41.661 01:51:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:41.661 01:51:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:41.661 01:51:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:41.661 01:51:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:41.661 01:51:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:41.661 01:51:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:41.661 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:41.661 01:51:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:41.661 01:51:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:41.661 01:51:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:41.661 01:51:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:41.661 01:51:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:41.661 01:51:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:41.661 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:41.661 01:51:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:41.661 01:51:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:41.661 01:51:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:41.661 01:51:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:41.661 01:51:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:41.661 01:51:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:41.661 01:51:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:41.661 01:51:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:41.661 01:51:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:41.662 01:51:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:41.662 01:51:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:41.662 01:51:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:41.662 01:51:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:41.662 01:51:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:41.662 01:51:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:41.662 01:51:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:41.662 01:51:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:41.662 01:51:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:41.920 01:51:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:41.920 01:51:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:41.920 01:51:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:41.920 01:51:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:41.920 01:51:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:41.920 01:51:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:41.920 01:51:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:41.920 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:41.920 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:15:41.920 00:15:41.920 --- 10.0.0.2 ping statistics --- 00:15:41.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:41.920 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:15:41.920 01:51:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:41.920 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:41.920 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:15:41.920 00:15:41.920 --- 10.0.0.1 ping statistics --- 00:15:41.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:41.920 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:15:41.920 01:51:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:41.920 01:51:30 -- nvmf/common.sh@410 -- # return 0 00:15:41.920 01:51:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:41.920 01:51:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:41.920 01:51:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:41.920 01:51:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:41.920 01:51:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:41.920 01:51:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:41.920 01:51:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:41.920 01:51:30 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:41.920 01:51:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:41.920 01:51:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:41.920 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:41.920 01:51:30 -- nvmf/common.sh@469 -- # nvmfpid=3435891 00:15:41.920 01:51:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:41.920 01:51:30 -- nvmf/common.sh@470 -- # waitforlisten 3435891 00:15:41.920 01:51:30 -- common/autotest_common.sh@829 -- # '[' -z 3435891 ']' 00:15:41.920 01:51:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:41.920 01:51:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:41.920 01:51:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:41.920 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:41.920 01:51:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:41.920 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:41.920 [2024-11-19 01:51:30.334011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:41.920 [2024-11-19 01:51:30.334095] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:41.920 EAL: No free 2048 kB hugepages reported on node 1 00:15:41.920 [2024-11-19 01:51:30.415022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:42.179 [2024-11-19 01:51:30.546712] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:42.179 [2024-11-19 01:51:30.546914] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:42.179 [2024-11-19 01:51:30.546956] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:42.179 [2024-11-19 01:51:30.546981] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:42.179 [2024-11-19 01:51:30.547023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:42.179 01:51:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:42.179 01:51:30 -- common/autotest_common.sh@862 -- # return 0 00:15:42.179 01:51:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:42.179 01:51:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:42.179 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:42.179 01:51:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:42.179 01:51:30 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:42.179 01:51:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.179 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:42.179 [2024-11-19 01:51:30.715812] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:42.179 01:51:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.179 01:51:30 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:42.179 01:51:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.179 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:42.438 Malloc0 00:15:42.438 01:51:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.438 01:51:30 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:42.438 01:51:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.438 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:42.438 01:51:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.438 01:51:30 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:42.438 01:51:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.438 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:42.438 01:51:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.438 01:51:30 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:42.438 01:51:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.438 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:42.438 [2024-11-19 01:51:30.775811] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:42.438 01:51:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.438 01:51:30 -- target/queue_depth.sh@30 -- # bdevperf_pid=3435913 00:15:42.438 01:51:30 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:42.438 01:51:30 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:42.438 01:51:30 -- target/queue_depth.sh@33 -- # waitforlisten 3435913 /var/tmp/bdevperf.sock 00:15:42.438 01:51:30 -- common/autotest_common.sh@829 -- # '[' -z 3435913 ']' 00:15:42.438 01:51:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:42.438 01:51:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:42.438 01:51:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:42.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:42.438 01:51:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:42.438 01:51:30 -- common/autotest_common.sh@10 -- # set +x 00:15:42.438 [2024-11-19 01:51:30.815022] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:42.438 [2024-11-19 01:51:30.815086] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3435913 ] 00:15:42.438 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.438 [2024-11-19 01:51:30.871671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:42.438 [2024-11-19 01:51:30.979859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:43.372 01:51:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:43.372 01:51:31 -- common/autotest_common.sh@862 -- # return 0 00:15:43.372 01:51:31 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:43.372 01:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:43.372 01:51:31 -- common/autotest_common.sh@10 -- # set +x 00:15:43.631 NVMe0n1 00:15:43.631 01:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:43.631 01:51:31 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:43.631 Running I/O for 10 seconds... 00:15:53.608 00:15:53.608 Latency(us) 00:15:53.608 [2024-11-19T00:51:42.151Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:53.608 [2024-11-19T00:51:42.151Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:53.608 Verification LBA range: start 0x0 length 0x4000 00:15:53.608 NVMe0n1 : 10.08 11445.68 44.71 0.00 0.00 89099.33 14854.83 67186.54 00:15:53.608 [2024-11-19T00:51:42.151Z] =================================================================================================================== 00:15:53.608 [2024-11-19T00:51:42.151Z] Total : 11445.68 44.71 0.00 0.00 89099.33 14854.83 67186.54 00:15:53.608 0 00:15:53.608 01:51:42 -- target/queue_depth.sh@39 -- # killprocess 3435913 00:15:53.608 01:51:42 -- common/autotest_common.sh@936 -- # '[' -z 3435913 ']' 00:15:53.608 01:51:42 -- common/autotest_common.sh@940 -- # kill -0 3435913 00:15:53.608 01:51:42 -- common/autotest_common.sh@941 -- # uname 00:15:53.608 01:51:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:53.608 01:51:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3435913 00:15:53.866 01:51:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:53.866 01:51:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:53.866 01:51:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3435913' 00:15:53.866 killing process with pid 3435913 00:15:53.866 01:51:42 -- common/autotest_common.sh@955 -- # kill 3435913 00:15:53.866 Received shutdown signal, test time was about 10.000000 seconds 00:15:53.866 00:15:53.866 Latency(us) 00:15:53.866 [2024-11-19T00:51:42.409Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:53.866 [2024-11-19T00:51:42.409Z] =================================================================================================================== 00:15:53.866 [2024-11-19T00:51:42.409Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:53.866 01:51:42 -- common/autotest_common.sh@960 -- # wait 3435913 00:15:54.124 01:51:42 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:54.124 01:51:42 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:54.124 01:51:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:54.124 01:51:42 -- nvmf/common.sh@116 -- # sync 00:15:54.124 01:51:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:54.124 01:51:42 -- nvmf/common.sh@119 -- # set +e 00:15:54.124 01:51:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:54.124 01:51:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:54.124 rmmod nvme_tcp 00:15:54.124 rmmod nvme_fabrics 00:15:54.124 rmmod nvme_keyring 00:15:54.124 01:51:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:54.124 01:51:42 -- nvmf/common.sh@123 -- # set -e 00:15:54.124 01:51:42 -- nvmf/common.sh@124 -- # return 0 00:15:54.124 01:51:42 -- nvmf/common.sh@477 -- # '[' -n 3435891 ']' 00:15:54.124 01:51:42 -- nvmf/common.sh@478 -- # killprocess 3435891 00:15:54.124 01:51:42 -- common/autotest_common.sh@936 -- # '[' -z 3435891 ']' 00:15:54.124 01:51:42 -- common/autotest_common.sh@940 -- # kill -0 3435891 00:15:54.124 01:51:42 -- common/autotest_common.sh@941 -- # uname 00:15:54.124 01:51:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:54.124 01:51:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3435891 00:15:54.124 01:51:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:54.124 01:51:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:54.124 01:51:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3435891' 00:15:54.124 killing process with pid 3435891 00:15:54.124 01:51:42 -- common/autotest_common.sh@955 -- # kill 3435891 00:15:54.124 01:51:42 -- common/autotest_common.sh@960 -- # wait 3435891 00:15:54.383 01:51:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:54.383 01:51:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:54.383 01:51:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:54.383 01:51:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:54.383 01:51:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:54.383 01:51:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:54.383 01:51:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:54.383 01:51:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.916 01:51:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:56.916 00:15:56.916 real 0m16.903s 00:15:56.916 user 0m23.466s 00:15:56.916 sys 0m3.561s 00:15:56.916 01:51:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:56.916 01:51:44 -- common/autotest_common.sh@10 -- # set +x 00:15:56.916 ************************************ 00:15:56.916 END TEST nvmf_queue_depth 00:15:56.916 ************************************ 00:15:56.916 01:51:44 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.916 01:51:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:56.916 01:51:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:56.916 01:51:44 -- common/autotest_common.sh@10 -- # set +x 00:15:56.916 ************************************ 00:15:56.916 START TEST nvmf_multipath 00:15:56.916 ************************************ 00:15:56.916 01:51:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.916 * Looking for test storage... 00:15:56.916 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:56.916 01:51:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:56.916 01:51:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:56.916 01:51:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:56.916 01:51:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:56.916 01:51:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:56.916 01:51:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:56.916 01:51:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:56.916 01:51:45 -- scripts/common.sh@335 -- # IFS=.-: 00:15:56.916 01:51:45 -- scripts/common.sh@335 -- # read -ra ver1 00:15:56.916 01:51:45 -- scripts/common.sh@336 -- # IFS=.-: 00:15:56.916 01:51:45 -- scripts/common.sh@336 -- # read -ra ver2 00:15:56.916 01:51:45 -- scripts/common.sh@337 -- # local 'op=<' 00:15:56.916 01:51:45 -- scripts/common.sh@339 -- # ver1_l=2 00:15:56.916 01:51:45 -- scripts/common.sh@340 -- # ver2_l=1 00:15:56.916 01:51:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:56.916 01:51:45 -- scripts/common.sh@343 -- # case "$op" in 00:15:56.916 01:51:45 -- scripts/common.sh@344 -- # : 1 00:15:56.916 01:51:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:56.916 01:51:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:56.916 01:51:45 -- scripts/common.sh@364 -- # decimal 1 00:15:56.916 01:51:45 -- scripts/common.sh@352 -- # local d=1 00:15:56.916 01:51:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:56.916 01:51:45 -- scripts/common.sh@354 -- # echo 1 00:15:56.916 01:51:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:56.916 01:51:45 -- scripts/common.sh@365 -- # decimal 2 00:15:56.916 01:51:45 -- scripts/common.sh@352 -- # local d=2 00:15:56.916 01:51:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:56.916 01:51:45 -- scripts/common.sh@354 -- # echo 2 00:15:56.916 01:51:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:56.916 01:51:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:56.916 01:51:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:56.916 01:51:45 -- scripts/common.sh@367 -- # return 0 00:15:56.916 01:51:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:56.916 01:51:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:56.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.916 --rc genhtml_branch_coverage=1 00:15:56.916 --rc genhtml_function_coverage=1 00:15:56.916 --rc genhtml_legend=1 00:15:56.916 --rc geninfo_all_blocks=1 00:15:56.916 --rc geninfo_unexecuted_blocks=1 00:15:56.916 00:15:56.916 ' 00:15:56.916 01:51:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:56.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.916 --rc genhtml_branch_coverage=1 00:15:56.916 --rc genhtml_function_coverage=1 00:15:56.916 --rc genhtml_legend=1 00:15:56.916 --rc geninfo_all_blocks=1 00:15:56.916 --rc geninfo_unexecuted_blocks=1 00:15:56.916 00:15:56.916 ' 00:15:56.916 01:51:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:56.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.916 --rc genhtml_branch_coverage=1 00:15:56.916 --rc genhtml_function_coverage=1 00:15:56.916 --rc genhtml_legend=1 00:15:56.916 --rc geninfo_all_blocks=1 00:15:56.916 --rc geninfo_unexecuted_blocks=1 00:15:56.916 00:15:56.916 ' 00:15:56.916 01:51:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:56.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.916 --rc genhtml_branch_coverage=1 00:15:56.916 --rc genhtml_function_coverage=1 00:15:56.916 --rc genhtml_legend=1 00:15:56.916 --rc geninfo_all_blocks=1 00:15:56.916 --rc geninfo_unexecuted_blocks=1 00:15:56.916 00:15:56.916 ' 00:15:56.916 01:51:45 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:56.916 01:51:45 -- nvmf/common.sh@7 -- # uname -s 00:15:56.916 01:51:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:56.916 01:51:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:56.916 01:51:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:56.916 01:51:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:56.916 01:51:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:56.916 01:51:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:56.916 01:51:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:56.916 01:51:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:56.916 01:51:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:56.916 01:51:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:56.916 01:51:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.916 01:51:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.916 01:51:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:56.916 01:51:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:56.916 01:51:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:56.916 01:51:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:56.916 01:51:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:56.916 01:51:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:56.916 01:51:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:56.916 01:51:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.916 01:51:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.916 01:51:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.916 01:51:45 -- paths/export.sh@5 -- # export PATH 00:15:56.916 01:51:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.916 01:51:45 -- nvmf/common.sh@46 -- # : 0 00:15:56.916 01:51:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:56.916 01:51:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:56.916 01:51:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:56.916 01:51:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:56.916 01:51:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:56.916 01:51:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:56.916 01:51:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:56.916 01:51:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:56.916 01:51:45 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:56.916 01:51:45 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:56.916 01:51:45 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:56.916 01:51:45 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:56.916 01:51:45 -- target/multipath.sh@43 -- # nvmftestinit 00:15:56.916 01:51:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:56.916 01:51:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:56.917 01:51:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:56.917 01:51:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:56.917 01:51:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:56.917 01:51:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.917 01:51:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.917 01:51:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.917 01:51:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:56.917 01:51:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:56.917 01:51:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:56.917 01:51:45 -- common/autotest_common.sh@10 -- # set +x 00:15:58.817 01:51:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:58.817 01:51:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:58.817 01:51:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:58.817 01:51:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:58.817 01:51:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:58.817 01:51:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:58.817 01:51:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:58.817 01:51:46 -- nvmf/common.sh@294 -- # net_devs=() 00:15:58.817 01:51:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:58.817 01:51:46 -- nvmf/common.sh@295 -- # e810=() 00:15:58.817 01:51:46 -- nvmf/common.sh@295 -- # local -ga e810 00:15:58.817 01:51:46 -- nvmf/common.sh@296 -- # x722=() 00:15:58.817 01:51:46 -- nvmf/common.sh@296 -- # local -ga x722 00:15:58.817 01:51:46 -- nvmf/common.sh@297 -- # mlx=() 00:15:58.817 01:51:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:58.817 01:51:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:58.817 01:51:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:58.817 01:51:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:58.817 01:51:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:58.817 01:51:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:58.817 01:51:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:58.817 01:51:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:58.817 01:51:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.817 01:51:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:58.817 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:58.817 01:51:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.817 01:51:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.818 01:51:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:58.818 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:58.818 01:51:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:58.818 01:51:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.818 01:51:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.818 01:51:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.818 01:51:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.818 01:51:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:58.818 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:58.818 01:51:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.818 01:51:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.818 01:51:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.818 01:51:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.818 01:51:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.818 01:51:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:58.818 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:58.818 01:51:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.818 01:51:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:58.818 01:51:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:58.818 01:51:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:58.818 01:51:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:58.818 01:51:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:58.818 01:51:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:58.818 01:51:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:58.818 01:51:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:58.818 01:51:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:58.818 01:51:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:58.818 01:51:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:58.818 01:51:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:58.818 01:51:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:58.818 01:51:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:58.818 01:51:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:58.818 01:51:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:58.818 01:51:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:58.818 01:51:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:58.818 01:51:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:58.818 01:51:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:58.818 01:51:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:58.818 01:51:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:58.818 01:51:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:58.818 01:51:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:58.818 01:51:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:58.818 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:58.818 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.285 ms 00:15:58.818 00:15:58.818 --- 10.0.0.2 ping statistics --- 00:15:58.818 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.818 rtt min/avg/max/mdev = 0.285/0.285/0.285/0.000 ms 00:15:58.818 01:51:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:58.818 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:58.818 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:15:58.818 00:15:58.818 --- 10.0.0.1 ping statistics --- 00:15:58.818 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.818 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:15:58.818 01:51:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:58.818 01:51:47 -- nvmf/common.sh@410 -- # return 0 00:15:58.818 01:51:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:58.818 01:51:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:58.818 01:51:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:58.818 01:51:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:58.818 01:51:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:58.818 01:51:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:58.818 01:51:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:58.818 01:51:47 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:58.818 01:51:47 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:58.818 only one NIC for nvmf test 00:15:58.818 01:51:47 -- target/multipath.sh@47 -- # nvmftestfini 00:15:58.818 01:51:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:58.818 01:51:47 -- nvmf/common.sh@116 -- # sync 00:15:58.818 01:51:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:58.818 01:51:47 -- nvmf/common.sh@119 -- # set +e 00:15:58.818 01:51:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:58.818 01:51:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:58.818 rmmod nvme_tcp 00:15:58.818 rmmod nvme_fabrics 00:15:58.818 rmmod nvme_keyring 00:15:58.818 01:51:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:58.818 01:51:47 -- nvmf/common.sh@123 -- # set -e 00:15:58.818 01:51:47 -- nvmf/common.sh@124 -- # return 0 00:15:58.818 01:51:47 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:58.818 01:51:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:58.818 01:51:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:58.818 01:51:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:58.818 01:51:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:58.818 01:51:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:58.818 01:51:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.818 01:51:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.818 01:51:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.725 01:51:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.725 01:51:49 -- target/multipath.sh@48 -- # exit 0 00:16:00.725 01:51:49 -- target/multipath.sh@1 -- # nvmftestfini 00:16:00.725 01:51:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:00.725 01:51:49 -- nvmf/common.sh@116 -- # sync 00:16:00.725 01:51:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:00.725 01:51:49 -- nvmf/common.sh@119 -- # set +e 00:16:00.725 01:51:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:00.725 01:51:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:00.725 01:51:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:00.725 01:51:49 -- nvmf/common.sh@123 -- # set -e 00:16:00.725 01:51:49 -- nvmf/common.sh@124 -- # return 0 00:16:00.725 01:51:49 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:00.725 01:51:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.725 01:51:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.725 01:51:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.725 01:51:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.725 01:51:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.725 01:51:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.725 01:51:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.725 01:51:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.725 01:51:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.725 00:16:00.725 real 0m4.352s 00:16:00.725 user 0m0.871s 00:16:00.725 sys 0m1.464s 00:16:00.725 01:51:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:00.725 01:51:49 -- common/autotest_common.sh@10 -- # set +x 00:16:00.725 ************************************ 00:16:00.725 END TEST nvmf_multipath 00:16:00.725 ************************************ 00:16:00.983 01:51:49 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.983 01:51:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:00.983 01:51:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:00.983 01:51:49 -- common/autotest_common.sh@10 -- # set +x 00:16:00.983 ************************************ 00:16:00.983 START TEST nvmf_zcopy 00:16:00.983 ************************************ 00:16:00.983 01:51:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.983 * Looking for test storage... 00:16:00.983 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:00.983 01:51:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:00.983 01:51:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:00.983 01:51:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:00.983 01:51:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:00.983 01:51:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:00.983 01:51:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:00.983 01:51:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:00.983 01:51:49 -- scripts/common.sh@335 -- # IFS=.-: 00:16:00.983 01:51:49 -- scripts/common.sh@335 -- # read -ra ver1 00:16:00.983 01:51:49 -- scripts/common.sh@336 -- # IFS=.-: 00:16:00.983 01:51:49 -- scripts/common.sh@336 -- # read -ra ver2 00:16:00.983 01:51:49 -- scripts/common.sh@337 -- # local 'op=<' 00:16:00.983 01:51:49 -- scripts/common.sh@339 -- # ver1_l=2 00:16:00.983 01:51:49 -- scripts/common.sh@340 -- # ver2_l=1 00:16:00.983 01:51:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:00.983 01:51:49 -- scripts/common.sh@343 -- # case "$op" in 00:16:00.983 01:51:49 -- scripts/common.sh@344 -- # : 1 00:16:00.983 01:51:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:00.983 01:51:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:00.983 01:51:49 -- scripts/common.sh@364 -- # decimal 1 00:16:00.983 01:51:49 -- scripts/common.sh@352 -- # local d=1 00:16:00.983 01:51:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:00.983 01:51:49 -- scripts/common.sh@354 -- # echo 1 00:16:00.983 01:51:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:00.983 01:51:49 -- scripts/common.sh@365 -- # decimal 2 00:16:00.983 01:51:49 -- scripts/common.sh@352 -- # local d=2 00:16:00.983 01:51:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:00.983 01:51:49 -- scripts/common.sh@354 -- # echo 2 00:16:00.983 01:51:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:00.983 01:51:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:00.983 01:51:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:00.983 01:51:49 -- scripts/common.sh@367 -- # return 0 00:16:00.983 01:51:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:00.983 01:51:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:00.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.983 --rc genhtml_branch_coverage=1 00:16:00.983 --rc genhtml_function_coverage=1 00:16:00.983 --rc genhtml_legend=1 00:16:00.983 --rc geninfo_all_blocks=1 00:16:00.983 --rc geninfo_unexecuted_blocks=1 00:16:00.983 00:16:00.983 ' 00:16:00.983 01:51:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:00.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.983 --rc genhtml_branch_coverage=1 00:16:00.983 --rc genhtml_function_coverage=1 00:16:00.983 --rc genhtml_legend=1 00:16:00.983 --rc geninfo_all_blocks=1 00:16:00.983 --rc geninfo_unexecuted_blocks=1 00:16:00.983 00:16:00.983 ' 00:16:00.983 01:51:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:00.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.983 --rc genhtml_branch_coverage=1 00:16:00.983 --rc genhtml_function_coverage=1 00:16:00.983 --rc genhtml_legend=1 00:16:00.983 --rc geninfo_all_blocks=1 00:16:00.983 --rc geninfo_unexecuted_blocks=1 00:16:00.983 00:16:00.983 ' 00:16:00.983 01:51:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:00.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.983 --rc genhtml_branch_coverage=1 00:16:00.983 --rc genhtml_function_coverage=1 00:16:00.983 --rc genhtml_legend=1 00:16:00.983 --rc geninfo_all_blocks=1 00:16:00.983 --rc geninfo_unexecuted_blocks=1 00:16:00.983 00:16:00.983 ' 00:16:00.983 01:51:49 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:00.983 01:51:49 -- nvmf/common.sh@7 -- # uname -s 00:16:00.983 01:51:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:00.983 01:51:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:00.983 01:51:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:00.983 01:51:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:00.983 01:51:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:00.983 01:51:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:00.983 01:51:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:00.983 01:51:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:00.983 01:51:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:00.983 01:51:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:00.983 01:51:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.983 01:51:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.983 01:51:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:00.983 01:51:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:00.983 01:51:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:00.983 01:51:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:00.983 01:51:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:00.983 01:51:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:00.983 01:51:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:00.983 01:51:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.983 01:51:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.984 01:51:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.984 01:51:49 -- paths/export.sh@5 -- # export PATH 00:16:00.984 01:51:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.984 01:51:49 -- nvmf/common.sh@46 -- # : 0 00:16:00.984 01:51:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:00.984 01:51:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:00.984 01:51:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:00.984 01:51:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:00.984 01:51:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:00.984 01:51:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:00.984 01:51:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:00.984 01:51:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:00.984 01:51:49 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:00.984 01:51:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:00.984 01:51:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:00.984 01:51:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:00.984 01:51:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:00.984 01:51:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:00.984 01:51:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.984 01:51:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.984 01:51:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.984 01:51:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:00.984 01:51:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:00.984 01:51:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:00.984 01:51:49 -- common/autotest_common.sh@10 -- # set +x 00:16:02.885 01:51:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:02.885 01:51:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:02.885 01:51:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:02.885 01:51:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:02.885 01:51:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:02.885 01:51:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:02.885 01:51:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:02.885 01:51:51 -- nvmf/common.sh@294 -- # net_devs=() 00:16:02.885 01:51:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:02.885 01:51:51 -- nvmf/common.sh@295 -- # e810=() 00:16:02.885 01:51:51 -- nvmf/common.sh@295 -- # local -ga e810 00:16:02.885 01:51:51 -- nvmf/common.sh@296 -- # x722=() 00:16:02.885 01:51:51 -- nvmf/common.sh@296 -- # local -ga x722 00:16:02.885 01:51:51 -- nvmf/common.sh@297 -- # mlx=() 00:16:02.885 01:51:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:02.885 01:51:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:02.885 01:51:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:02.885 01:51:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:02.885 01:51:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:02.885 01:51:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:02.885 01:51:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:02.886 01:51:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:02.886 01:51:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.886 01:51:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:02.886 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:02.886 01:51:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.886 01:51:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:02.886 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:02.886 01:51:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:02.886 01:51:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.886 01:51:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.886 01:51:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.886 01:51:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.886 01:51:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:02.886 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:02.886 01:51:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.886 01:51:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.886 01:51:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.886 01:51:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.886 01:51:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.886 01:51:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:02.886 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:02.886 01:51:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.886 01:51:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:02.886 01:51:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:02.886 01:51:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:02.886 01:51:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:02.886 01:51:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:02.886 01:51:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:02.886 01:51:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:02.886 01:51:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:02.886 01:51:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:02.886 01:51:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:02.886 01:51:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:02.886 01:51:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:02.886 01:51:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:02.886 01:51:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:02.886 01:51:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:02.886 01:51:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:02.886 01:51:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:03.145 01:51:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:03.145 01:51:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:03.145 01:51:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:03.145 01:51:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:03.145 01:51:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:03.145 01:51:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:03.145 01:51:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:03.145 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:03.145 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:16:03.145 00:16:03.145 --- 10.0.0.2 ping statistics --- 00:16:03.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.145 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:16:03.145 01:51:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:03.145 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:03.145 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:16:03.145 00:16:03.145 --- 10.0.0.1 ping statistics --- 00:16:03.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.145 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:16:03.145 01:51:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:03.145 01:51:51 -- nvmf/common.sh@410 -- # return 0 00:16:03.145 01:51:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:03.145 01:51:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:03.145 01:51:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:03.145 01:51:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:03.145 01:51:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:03.145 01:51:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:03.145 01:51:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:03.145 01:51:51 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:03.145 01:51:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:03.145 01:51:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:03.145 01:51:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.145 01:51:51 -- nvmf/common.sh@469 -- # nvmfpid=3441291 00:16:03.145 01:51:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:03.146 01:51:51 -- nvmf/common.sh@470 -- # waitforlisten 3441291 00:16:03.146 01:51:51 -- common/autotest_common.sh@829 -- # '[' -z 3441291 ']' 00:16:03.146 01:51:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:03.146 01:51:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:03.146 01:51:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:03.146 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:03.146 01:51:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:03.146 01:51:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.146 [2024-11-19 01:51:51.666469] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:03.146 [2024-11-19 01:51:51.666574] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:03.405 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.405 [2024-11-19 01:51:51.736926] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:03.405 [2024-11-19 01:51:51.855217] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:03.405 [2024-11-19 01:51:51.855402] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:03.405 [2024-11-19 01:51:51.855423] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:03.405 [2024-11-19 01:51:51.855439] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:03.405 [2024-11-19 01:51:51.855470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:04.339 01:51:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:04.339 01:51:52 -- common/autotest_common.sh@862 -- # return 0 00:16:04.339 01:51:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:04.339 01:51:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:04.339 01:51:52 -- common/autotest_common.sh@10 -- # set +x 00:16:04.339 01:51:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:04.339 01:51:52 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:04.339 01:51:52 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:04.339 01:51:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.339 01:51:52 -- common/autotest_common.sh@10 -- # set +x 00:16:04.339 [2024-11-19 01:51:52.675944] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:04.339 01:51:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.339 01:51:52 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:04.339 01:51:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.339 01:51:52 -- common/autotest_common.sh@10 -- # set +x 00:16:04.339 01:51:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.339 01:51:52 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:04.339 01:51:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.339 01:51:52 -- common/autotest_common.sh@10 -- # set +x 00:16:04.339 [2024-11-19 01:51:52.692143] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:04.339 01:51:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.339 01:51:52 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:04.339 01:51:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.339 01:51:52 -- common/autotest_common.sh@10 -- # set +x 00:16:04.339 01:51:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.339 01:51:52 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:04.339 01:51:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.339 01:51:52 -- common/autotest_common.sh@10 -- # set +x 00:16:04.339 malloc0 00:16:04.339 01:51:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.339 01:51:52 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:04.339 01:51:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.339 01:51:52 -- common/autotest_common.sh@10 -- # set +x 00:16:04.339 01:51:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.339 01:51:52 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:04.339 01:51:52 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:04.339 01:51:52 -- nvmf/common.sh@520 -- # config=() 00:16:04.339 01:51:52 -- nvmf/common.sh@520 -- # local subsystem config 00:16:04.339 01:51:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:04.339 01:51:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:04.339 { 00:16:04.339 "params": { 00:16:04.339 "name": "Nvme$subsystem", 00:16:04.339 "trtype": "$TEST_TRANSPORT", 00:16:04.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:04.339 "adrfam": "ipv4", 00:16:04.339 "trsvcid": "$NVMF_PORT", 00:16:04.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:04.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:04.339 "hdgst": ${hdgst:-false}, 00:16:04.339 "ddgst": ${ddgst:-false} 00:16:04.340 }, 00:16:04.340 "method": "bdev_nvme_attach_controller" 00:16:04.340 } 00:16:04.340 EOF 00:16:04.340 )") 00:16:04.340 01:51:52 -- nvmf/common.sh@542 -- # cat 00:16:04.340 01:51:52 -- nvmf/common.sh@544 -- # jq . 00:16:04.340 01:51:52 -- nvmf/common.sh@545 -- # IFS=, 00:16:04.340 01:51:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:04.340 "params": { 00:16:04.340 "name": "Nvme1", 00:16:04.340 "trtype": "tcp", 00:16:04.340 "traddr": "10.0.0.2", 00:16:04.340 "adrfam": "ipv4", 00:16:04.340 "trsvcid": "4420", 00:16:04.340 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:04.340 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:04.340 "hdgst": false, 00:16:04.340 "ddgst": false 00:16:04.340 }, 00:16:04.340 "method": "bdev_nvme_attach_controller" 00:16:04.340 }' 00:16:04.340 [2024-11-19 01:51:52.762011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:04.340 [2024-11-19 01:51:52.762094] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3441450 ] 00:16:04.340 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.340 [2024-11-19 01:51:52.823336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:04.598 [2024-11-19 01:51:52.942506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:04.857 Running I/O for 10 seconds... 00:16:14.829 00:16:14.829 Latency(us) 00:16:14.829 [2024-11-19T00:52:03.372Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:14.829 [2024-11-19T00:52:03.372Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:14.829 Verification LBA range: start 0x0 length 0x1000 00:16:14.829 Nvme1n1 : 10.01 8713.82 68.08 0.00 0.00 14654.70 1401.74 22719.15 00:16:14.829 [2024-11-19T00:52:03.372Z] =================================================================================================================== 00:16:14.829 [2024-11-19T00:52:03.372Z] Total : 8713.82 68.08 0.00 0.00 14654.70 1401.74 22719.15 00:16:15.088 01:52:03 -- target/zcopy.sh@39 -- # perfpid=3442684 00:16:15.088 01:52:03 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:15.088 01:52:03 -- common/autotest_common.sh@10 -- # set +x 00:16:15.088 01:52:03 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:15.088 01:52:03 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:15.088 01:52:03 -- nvmf/common.sh@520 -- # config=() 00:16:15.088 01:52:03 -- nvmf/common.sh@520 -- # local subsystem config 00:16:15.088 01:52:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:15.088 01:52:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:15.088 { 00:16:15.088 "params": { 00:16:15.088 "name": "Nvme$subsystem", 00:16:15.088 "trtype": "$TEST_TRANSPORT", 00:16:15.088 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:15.088 "adrfam": "ipv4", 00:16:15.088 "trsvcid": "$NVMF_PORT", 00:16:15.088 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:15.088 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:15.088 "hdgst": ${hdgst:-false}, 00:16:15.088 "ddgst": ${ddgst:-false} 00:16:15.088 }, 00:16:15.088 "method": "bdev_nvme_attach_controller" 00:16:15.088 } 00:16:15.088 EOF 00:16:15.088 )") 00:16:15.088 01:52:03 -- nvmf/common.sh@542 -- # cat 00:16:15.088 [2024-11-19 01:52:03.479809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.479854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 01:52:03 -- nvmf/common.sh@544 -- # jq . 00:16:15.088 01:52:03 -- nvmf/common.sh@545 -- # IFS=, 00:16:15.088 01:52:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:15.088 "params": { 00:16:15.088 "name": "Nvme1", 00:16:15.088 "trtype": "tcp", 00:16:15.088 "traddr": "10.0.0.2", 00:16:15.088 "adrfam": "ipv4", 00:16:15.088 "trsvcid": "4420", 00:16:15.088 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:15.088 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:15.088 "hdgst": false, 00:16:15.088 "ddgst": false 00:16:15.088 }, 00:16:15.088 "method": "bdev_nvme_attach_controller" 00:16:15.088 }' 00:16:15.088 [2024-11-19 01:52:03.487749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.487773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.495772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.495795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.503792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.503814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.511813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.511834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.516345] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:15.088 [2024-11-19 01:52:03.516427] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3442684 ] 00:16:15.088 [2024-11-19 01:52:03.519833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.519854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.527855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.527876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.535875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.535897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.088 [2024-11-19 01:52:03.543898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.543946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.551943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.551969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.559971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.559996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.567999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.568025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.576012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.576036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.577796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.088 [2024-11-19 01:52:03.584058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.584091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.592102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.592143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.600080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.600106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.608103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.608127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.616125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.616150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.624146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.624172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.088 [2024-11-19 01:52:03.632168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.088 [2024-11-19 01:52:03.632195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.640186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.640211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.648247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.648289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.656247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.656276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.664258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.664285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.672281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.672306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.680304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.680329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.688326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.688351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.696349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.696374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.697289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:15.346 [2024-11-19 01:52:03.704371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.704396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.712405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.712432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.720447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.720486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.728469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.728506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.736496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.736551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.744526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.744567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.752544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.752585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.760568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.760609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.768557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.768583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.776606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.776652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.784628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.784688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.792664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.792716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.800655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.800694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.808685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.808706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.816726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.816752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.824727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.824752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.832752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.832776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.840767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.840791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.848787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.848811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.856808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.856834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.864829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.864851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.872855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.872877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.880878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.880901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.346 [2024-11-19 01:52:03.888925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.346 [2024-11-19 01:52:03.888951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.896943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.896967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.904957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.904978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.912990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.913017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.921005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.921031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.929034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.929062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.937056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.937084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.945080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.945109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.953103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.953129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.961128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.961154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.969147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.969173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.977173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.977199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.985199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.985225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:03.993220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:03.993245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:04.001254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:04.001284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 Running I/O for 5 seconds... 00:16:15.603 [2024-11-19 01:52:04.009266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:04.009292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:04.022661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:04.022713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.603 [2024-11-19 01:52:04.032949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.603 [2024-11-19 01:52:04.032981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.044282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.044314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.057888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.057917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.068821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.068850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.079883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.079928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.090984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.091017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.102005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.102036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.112951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.112983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.123996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.124027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.135170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.135202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.604 [2024-11-19 01:52:04.146487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.604 [2024-11-19 01:52:04.146519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.158142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.158174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.169575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.169606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.180567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.180598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.192016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.192048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.203030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.203060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.216275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.216305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.226520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.226551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.237887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.237915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.248230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.248261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.260045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.260086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.270893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.270937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.281965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.281996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.293247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.293278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.306099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.306130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.316533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.316563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.327993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.328024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.341114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.341147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.351851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.351878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.362909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.362955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.375417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.375449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.385272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.385302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.862 [2024-11-19 01:52:04.397066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.862 [2024-11-19 01:52:04.397097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.408197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.408230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.419531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.419562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.430714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.430744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.441609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.441652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.453220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.453251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.464565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.464595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.476178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.476217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.487400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.487431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.500542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.500572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.510715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.510744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.521421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.521452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.532526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.532556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.545379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.545410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.555794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.555822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.566786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.566814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.579815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.579842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.589803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.589831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.601772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.601799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.612735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.121 [2024-11-19 01:52:04.612762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.121 [2024-11-19 01:52:04.625553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.122 [2024-11-19 01:52:04.625583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.122 [2024-11-19 01:52:04.635888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.122 [2024-11-19 01:52:04.635931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.122 [2024-11-19 01:52:04.647225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.122 [2024-11-19 01:52:04.647255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.122 [2024-11-19 01:52:04.658629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.122 [2024-11-19 01:52:04.658666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.669980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.670012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.681464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.681496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.694546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.694585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.705754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.705781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.717500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.717531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.728708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.728736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.741606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.741653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.752245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.752275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.763850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.763878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.774957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.774988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.787839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.787867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.798205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.798236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.809054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.809085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.821889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.821917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.832183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.832213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.843038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.843069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.853848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.853876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.864715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.864744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.876070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.876101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.887160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.887191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.898043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.898074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.909208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.909246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.381 [2024-11-19 01:52:04.922493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.381 [2024-11-19 01:52:04.922532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.639 [2024-11-19 01:52:04.933775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.639 [2024-11-19 01:52:04.933803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.639 [2024-11-19 01:52:04.944797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:04.944825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:04.955826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:04.955854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:04.967005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:04.967036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:04.980120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:04.980151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:04.991227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:04.991258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.002049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.002081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.012831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.012860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.024328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.024358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.035505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.035537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.046509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.046540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.057721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.057750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.071077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.071110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.082140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.082172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.093015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.093047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.104212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.104243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.117314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.117346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.127711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.127747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.138727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.138755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.151811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.151839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.162435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.162465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.640 [2024-11-19 01:52:05.173298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.640 [2024-11-19 01:52:05.173329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.898 [2024-11-19 01:52:05.186398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.898 [2024-11-19 01:52:05.186429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.898 [2024-11-19 01:52:05.196279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.898 [2024-11-19 01:52:05.196311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.898 [2024-11-19 01:52:05.208108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.898 [2024-11-19 01:52:05.208140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.898 [2024-11-19 01:52:05.219460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.898 [2024-11-19 01:52:05.219491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.898 [2024-11-19 01:52:05.232551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.898 [2024-11-19 01:52:05.232582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.242968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.242999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.254050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.254081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.265221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.265252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.276718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.276747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.287538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.287570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.298980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.299011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.312149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.312180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.322577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.322609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.333731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.333759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.345226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.345257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.356647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.356679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.369495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.369526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.379811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.379839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.390978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.391012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.402368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.402400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.413620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.413672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.426625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.426690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.899 [2024-11-19 01:52:05.436791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.899 [2024-11-19 01:52:05.436819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.448576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.448608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.460029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.460060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.473545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.473576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.484174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.484205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.495308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.495339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.508162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.508193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.517620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.517677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.529487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.529518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.542495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.542526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.553040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.553071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.564438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.564469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.577373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.577403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.587871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.587899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.598892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.598938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.609710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.609738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.621047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.621078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.631811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.631839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.642768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.642795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.655905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.655950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.666378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.666408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.677552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.677584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.690866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.690894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.160 [2024-11-19 01:52:05.700802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.160 [2024-11-19 01:52:05.700830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.712125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.712154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.722835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.722863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.733876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.733905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.747012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.747044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.756814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.756842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.768315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.768345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.779021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.779053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.790052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.790083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.802618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.802673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.812990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.813022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.824195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.824226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.836954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.836985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.847087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.847117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.858058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.858089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.870979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.871011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.880846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.880874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.892081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.892112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.476 [2024-11-19 01:52:05.904569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.476 [2024-11-19 01:52:05.904599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.914287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.914318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.926276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.926307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.939055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.939086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.949948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.949978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.961200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.961231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.972556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.972586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.983955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.983994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.477 [2024-11-19 01:52:05.995088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.477 [2024-11-19 01:52:05.995119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.758 [2024-11-19 01:52:06.006073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.758 [2024-11-19 01:52:06.006106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.758 [2024-11-19 01:52:06.016774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.758 [2024-11-19 01:52:06.016802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.758 [2024-11-19 01:52:06.028625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.758 [2024-11-19 01:52:06.028685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.758 [2024-11-19 01:52:06.039518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.758 [2024-11-19 01:52:06.039548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.758 [2024-11-19 01:52:06.050455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.758 [2024-11-19 01:52:06.050486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.758 [2024-11-19 01:52:06.061775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.758 [2024-11-19 01:52:06.061803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.758 [2024-11-19 01:52:06.072931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.072962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.084090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.084121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.095324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.095354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.108512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.108543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.118807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.118835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.130345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.130376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.141714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.141743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.154819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.154847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.165357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.165388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.176332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.176363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.187471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.187502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.198582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.198623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.209630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.209686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.220810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.220839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.233994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.234026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.244935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.244966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.255990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.256021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.268835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.268863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.279111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.279141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.290250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.290280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.759 [2024-11-19 01:52:06.303812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.759 [2024-11-19 01:52:06.303844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.017 [2024-11-19 01:52:06.314734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.017 [2024-11-19 01:52:06.314762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.325969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.326000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.339170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.339202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.349730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.349758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.361304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.361336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.372602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.372632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.383770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.383798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.395276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.395308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.406267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.406298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.417454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.417493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.428754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.428781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.439854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.439882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.451112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.451143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.462285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.462315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.475107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.475138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.484839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.484866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.496529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.496560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.507392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.507423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.518918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.518964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.530413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.530444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.542014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.542045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.552503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.552535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.018 [2024-11-19 01:52:06.563531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.018 [2024-11-19 01:52:06.563571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.574590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.574622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.585773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.585801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.596487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.596519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.607497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.607528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.620766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.620794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.631200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.631239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.642324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.642354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.655356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.655387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.667035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.667065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.676728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.676755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.688719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.688748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.700499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.700530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.713618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.713658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.723809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.723837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.735097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.735128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.748136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.748168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.758616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.758660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.769463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.769494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.780599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.780629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.791839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.791867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.802280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.802311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.277 [2024-11-19 01:52:06.813280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.277 [2024-11-19 01:52:06.813311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.824566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.824602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.835405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.835437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.846549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.846590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.859824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.859852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.870525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.870556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.881663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.881707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.894802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.894831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.905543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.905573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.916565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.916596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.927668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.927712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.938926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.938957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.951845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.951874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.962490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.962521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.973710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.973738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.985015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.985047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:06.995662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:06.995705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:07.006532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:07.006563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:07.017470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:07.017500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:07.028307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:07.028338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:07.039053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.536 [2024-11-19 01:52:07.039084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.536 [2024-11-19 01:52:07.049782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.537 [2024-11-19 01:52:07.049810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.537 [2024-11-19 01:52:07.060897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.537 [2024-11-19 01:52:07.060942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.537 [2024-11-19 01:52:07.072159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.537 [2024-11-19 01:52:07.072191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.084223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.084254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.095264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.095295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.106644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.106689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.119837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.119880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.130496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.130527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.142164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.142196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.153478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.153509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.164793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.164822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.176524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.176555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.187506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.187537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.198984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.199016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.209876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.209905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.220863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.220891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.232157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.232187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.245025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.245056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.255542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.255575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.267020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.267052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.277970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.278002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.289247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.289278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.302660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.302704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.313279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.313311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.324304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.324336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.796 [2024-11-19 01:52:07.335308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.796 [2024-11-19 01:52:07.335339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.347930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.347963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.358908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.358952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.370340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.370379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.381903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.381948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.393180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.393211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.404329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.404361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.415171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.415202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.427975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.428007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.437751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.437778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.449341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.449371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.461961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.461992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.471848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.471876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.483857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.483886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.495668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.495711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.509002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.509033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.519531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.519562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.530565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.530596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.541304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.541335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.552041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.552071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.563086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.563116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.573847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.573875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.585424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.585456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.055 [2024-11-19 01:52:07.597360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.055 [2024-11-19 01:52:07.597391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.609199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.609230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.619986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.620017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.631016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.631048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.643752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.643780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.653703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.653730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.664793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.664821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.676069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.676100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.687197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.687228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.698376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.698414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.709131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.709162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.722024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.722055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.732340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.732370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.743511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.743542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.756569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.756600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.767083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.767114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.778030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.778061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.788832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.788859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.800027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.800058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-19 01:52:07.811248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-19 01:52:07.811278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-19 01:52:07.822370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-19 01:52:07.822401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-19 01:52:07.833274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-19 01:52:07.833304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-19 01:52:07.844970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-19 01:52:07.845002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-19 01:52:07.856340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-19 01:52:07.856371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.573 [2024-11-19 01:52:07.869767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.573 [2024-11-19 01:52:07.869796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.573 [2024-11-19 01:52:07.880524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.573 [2024-11-19 01:52:07.880555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.573 [2024-11-19 01:52:07.891266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.573 [2024-11-19 01:52:07.891296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.901835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.901863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.913051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.913091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.926501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.926531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.937578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.937608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.948599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.948634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.959729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.959757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.972291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.972322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.982821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.982850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:07.994148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:07.994179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.006651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.006695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.017205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.017236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.028145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.028176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.039493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.039524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.050727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.050756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.061533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.061564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.072789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.072817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.085730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.085758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.096456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.096487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-19 01:52:08.107459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-19 01:52:08.107490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.120651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.120695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.131083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.131124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.142110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.142142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.152968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.153000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.163822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.163850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.174692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.174720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.186004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.186035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.196686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.196714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.207449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.207480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.218436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.218467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.229427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.229458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.242242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.242273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.253115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.253146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.264033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.264064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.275363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.275394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.286458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.286490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.299120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.299152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.309760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.309787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.320525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.320556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.333374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.333405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.344357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.344395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.355613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.355652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.366702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.366730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-19 01:52:08.378335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-19 01:52:08.378374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.389968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.390000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.402998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.403030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.413312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.413344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.425004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.425035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.436250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.436284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.449458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.449489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.459817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.459846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.471229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.471260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.482338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.482369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.493768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.493797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.505093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.505125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.516448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.516486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.529711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.529740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.540257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.540288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.551075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.551106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.562507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.562550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.573697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.573726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.586984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.587015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.598082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.598113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.609383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.609415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.620694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.620722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-19 01:52:08.631904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-19 01:52:08.631950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.642781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.642809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.654060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.654092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.664716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.664744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.675990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.676021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.688935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.688966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.699621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.699660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.710815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.710843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.723724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.723752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.733804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.733832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.745129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.745160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.758525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.758555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.768782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.768810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.779422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.779452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.793049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.793080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.804192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.804223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.815543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.815574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.826432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.826463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.837031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.837062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.848471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.848502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.861331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.861362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.871623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.871677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.882769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.882797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.352 [2024-11-19 01:52:08.896175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.352 [2024-11-19 01:52:08.896207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.906654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.906699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.917783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.917811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.928847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.928875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.944264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.944297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.954627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.954681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.965901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.965946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.979524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.979556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:08.990333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:08.990364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.001252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.001282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.012666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.012713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.023854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.023883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.031148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.031178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 00:16:20.611 Latency(us) 00:16:20.611 [2024-11-19T00:52:09.154Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:20.611 [2024-11-19T00:52:09.154Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:20.611 Nvme1n1 : 5.01 11406.16 89.11 0.00 0.00 11207.30 4830.25 22039.51 00:16:20.611 [2024-11-19T00:52:09.154Z] =================================================================================================================== 00:16:20.611 [2024-11-19T00:52:09.154Z] Total : 11406.16 89.11 0.00 0.00 11207.30 4830.25 22039.51 00:16:20.611 [2024-11-19 01:52:09.039165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.039193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.047184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.047214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.055205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.055233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.063277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.063326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.071297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.071344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.079322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.079370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.087342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.087392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.095378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.095430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.103392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.103441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.111406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.111452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.119432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.119481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.127453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.127502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.611 [2024-11-19 01:52:09.135493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.611 [2024-11-19 01:52:09.135542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.612 [2024-11-19 01:52:09.143497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.612 [2024-11-19 01:52:09.143544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.612 [2024-11-19 01:52:09.151516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.612 [2024-11-19 01:52:09.151562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.159543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.159596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.167519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.167548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.175539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.175565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.183559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.183584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.191579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.191608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.199599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.199625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.207695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.207742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.215724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.215767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.223678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.223715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.231709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.231730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.239728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.239750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.247747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.247767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.255835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.255879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.263838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.263889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.271811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.271840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.279817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.279847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 [2024-11-19 01:52:09.287838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.869 [2024-11-19 01:52:09.287859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.869 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3442684) - No such process 00:16:20.869 01:52:09 -- target/zcopy.sh@49 -- # wait 3442684 00:16:20.869 01:52:09 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:20.869 01:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.869 01:52:09 -- common/autotest_common.sh@10 -- # set +x 00:16:20.869 01:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.869 01:52:09 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:20.869 01:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.869 01:52:09 -- common/autotest_common.sh@10 -- # set +x 00:16:20.869 delay0 00:16:20.869 01:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.869 01:52:09 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:20.869 01:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.869 01:52:09 -- common/autotest_common.sh@10 -- # set +x 00:16:20.869 01:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.869 01:52:09 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:20.869 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.127 [2024-11-19 01:52:09.444766] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:27.686 [2024-11-19 01:52:15.639442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x126f2f0 is same with the state(5) to be set 00:16:27.686 Initializing NVMe Controllers 00:16:27.686 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:27.686 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:27.686 Initialization complete. Launching workers. 00:16:27.686 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 916 00:16:27.686 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1203, failed to submit 33 00:16:27.686 success 1042, unsuccess 161, failed 0 00:16:27.686 01:52:15 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:27.686 01:52:15 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:27.686 01:52:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:27.686 01:52:15 -- nvmf/common.sh@116 -- # sync 00:16:27.686 01:52:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:27.686 01:52:15 -- nvmf/common.sh@119 -- # set +e 00:16:27.686 01:52:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:27.686 01:52:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:27.686 rmmod nvme_tcp 00:16:27.686 rmmod nvme_fabrics 00:16:27.686 rmmod nvme_keyring 00:16:27.686 01:52:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:27.686 01:52:15 -- nvmf/common.sh@123 -- # set -e 00:16:27.686 01:52:15 -- nvmf/common.sh@124 -- # return 0 00:16:27.686 01:52:15 -- nvmf/common.sh@477 -- # '[' -n 3441291 ']' 00:16:27.686 01:52:15 -- nvmf/common.sh@478 -- # killprocess 3441291 00:16:27.686 01:52:15 -- common/autotest_common.sh@936 -- # '[' -z 3441291 ']' 00:16:27.686 01:52:15 -- common/autotest_common.sh@940 -- # kill -0 3441291 00:16:27.686 01:52:15 -- common/autotest_common.sh@941 -- # uname 00:16:27.686 01:52:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:27.686 01:52:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3441291 00:16:27.686 01:52:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:27.686 01:52:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:27.686 01:52:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3441291' 00:16:27.686 killing process with pid 3441291 00:16:27.686 01:52:15 -- common/autotest_common.sh@955 -- # kill 3441291 00:16:27.686 01:52:15 -- common/autotest_common.sh@960 -- # wait 3441291 00:16:27.686 01:52:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:27.686 01:52:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:27.686 01:52:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:27.686 01:52:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:27.686 01:52:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:27.686 01:52:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:27.686 01:52:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:27.686 01:52:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:29.591 01:52:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:29.591 00:16:29.591 real 0m28.787s 00:16:29.591 user 0m42.580s 00:16:29.591 sys 0m8.076s 00:16:29.591 01:52:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:29.591 01:52:18 -- common/autotest_common.sh@10 -- # set +x 00:16:29.591 ************************************ 00:16:29.591 END TEST nvmf_zcopy 00:16:29.591 ************************************ 00:16:29.591 01:52:18 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:29.591 01:52:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:29.591 01:52:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:29.591 01:52:18 -- common/autotest_common.sh@10 -- # set +x 00:16:29.591 ************************************ 00:16:29.591 START TEST nvmf_nmic 00:16:29.591 ************************************ 00:16:29.591 01:52:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:29.849 * Looking for test storage... 00:16:29.849 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:29.849 01:52:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:29.849 01:52:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:29.849 01:52:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:29.849 01:52:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:29.849 01:52:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:29.849 01:52:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:29.849 01:52:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:29.849 01:52:18 -- scripts/common.sh@335 -- # IFS=.-: 00:16:29.850 01:52:18 -- scripts/common.sh@335 -- # read -ra ver1 00:16:29.850 01:52:18 -- scripts/common.sh@336 -- # IFS=.-: 00:16:29.850 01:52:18 -- scripts/common.sh@336 -- # read -ra ver2 00:16:29.850 01:52:18 -- scripts/common.sh@337 -- # local 'op=<' 00:16:29.850 01:52:18 -- scripts/common.sh@339 -- # ver1_l=2 00:16:29.850 01:52:18 -- scripts/common.sh@340 -- # ver2_l=1 00:16:29.850 01:52:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:29.850 01:52:18 -- scripts/common.sh@343 -- # case "$op" in 00:16:29.850 01:52:18 -- scripts/common.sh@344 -- # : 1 00:16:29.850 01:52:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:29.850 01:52:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:29.850 01:52:18 -- scripts/common.sh@364 -- # decimal 1 00:16:29.850 01:52:18 -- scripts/common.sh@352 -- # local d=1 00:16:29.850 01:52:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:29.850 01:52:18 -- scripts/common.sh@354 -- # echo 1 00:16:29.850 01:52:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:29.850 01:52:18 -- scripts/common.sh@365 -- # decimal 2 00:16:29.850 01:52:18 -- scripts/common.sh@352 -- # local d=2 00:16:29.850 01:52:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:29.850 01:52:18 -- scripts/common.sh@354 -- # echo 2 00:16:29.850 01:52:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:29.850 01:52:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:29.850 01:52:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:29.850 01:52:18 -- scripts/common.sh@367 -- # return 0 00:16:29.850 01:52:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:29.850 01:52:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:29.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.850 --rc genhtml_branch_coverage=1 00:16:29.850 --rc genhtml_function_coverage=1 00:16:29.850 --rc genhtml_legend=1 00:16:29.850 --rc geninfo_all_blocks=1 00:16:29.850 --rc geninfo_unexecuted_blocks=1 00:16:29.850 00:16:29.850 ' 00:16:29.850 01:52:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:29.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.850 --rc genhtml_branch_coverage=1 00:16:29.850 --rc genhtml_function_coverage=1 00:16:29.850 --rc genhtml_legend=1 00:16:29.850 --rc geninfo_all_blocks=1 00:16:29.850 --rc geninfo_unexecuted_blocks=1 00:16:29.850 00:16:29.850 ' 00:16:29.850 01:52:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:29.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.850 --rc genhtml_branch_coverage=1 00:16:29.850 --rc genhtml_function_coverage=1 00:16:29.850 --rc genhtml_legend=1 00:16:29.850 --rc geninfo_all_blocks=1 00:16:29.850 --rc geninfo_unexecuted_blocks=1 00:16:29.850 00:16:29.850 ' 00:16:29.850 01:52:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:29.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.850 --rc genhtml_branch_coverage=1 00:16:29.850 --rc genhtml_function_coverage=1 00:16:29.850 --rc genhtml_legend=1 00:16:29.850 --rc geninfo_all_blocks=1 00:16:29.850 --rc geninfo_unexecuted_blocks=1 00:16:29.850 00:16:29.850 ' 00:16:29.850 01:52:18 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:29.850 01:52:18 -- nvmf/common.sh@7 -- # uname -s 00:16:29.850 01:52:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:29.850 01:52:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:29.850 01:52:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:29.850 01:52:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:29.850 01:52:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:29.850 01:52:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:29.850 01:52:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:29.850 01:52:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:29.850 01:52:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:29.850 01:52:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:29.850 01:52:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.850 01:52:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.850 01:52:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:29.850 01:52:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:29.850 01:52:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:29.850 01:52:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:29.850 01:52:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:29.850 01:52:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:29.850 01:52:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:29.850 01:52:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.850 01:52:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.850 01:52:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.850 01:52:18 -- paths/export.sh@5 -- # export PATH 00:16:29.850 01:52:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.850 01:52:18 -- nvmf/common.sh@46 -- # : 0 00:16:29.850 01:52:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:29.850 01:52:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:29.850 01:52:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:29.850 01:52:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:29.850 01:52:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:29.850 01:52:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:29.850 01:52:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:29.850 01:52:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:29.850 01:52:18 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:29.850 01:52:18 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:29.850 01:52:18 -- target/nmic.sh@14 -- # nvmftestinit 00:16:29.850 01:52:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:29.850 01:52:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:29.850 01:52:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:29.850 01:52:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:29.850 01:52:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:29.850 01:52:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:29.850 01:52:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:29.850 01:52:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:29.850 01:52:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:29.850 01:52:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:29.850 01:52:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:29.850 01:52:18 -- common/autotest_common.sh@10 -- # set +x 00:16:32.384 01:52:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:32.384 01:52:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:32.384 01:52:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:32.384 01:52:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:32.384 01:52:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:32.384 01:52:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:32.384 01:52:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:32.384 01:52:20 -- nvmf/common.sh@294 -- # net_devs=() 00:16:32.384 01:52:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:32.384 01:52:20 -- nvmf/common.sh@295 -- # e810=() 00:16:32.384 01:52:20 -- nvmf/common.sh@295 -- # local -ga e810 00:16:32.384 01:52:20 -- nvmf/common.sh@296 -- # x722=() 00:16:32.384 01:52:20 -- nvmf/common.sh@296 -- # local -ga x722 00:16:32.384 01:52:20 -- nvmf/common.sh@297 -- # mlx=() 00:16:32.384 01:52:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:32.384 01:52:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:32.384 01:52:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:32.384 01:52:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:32.384 01:52:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:32.384 01:52:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:32.384 01:52:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:32.384 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:32.384 01:52:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:32.384 01:52:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:32.384 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:32.384 01:52:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:32.384 01:52:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:32.384 01:52:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:32.384 01:52:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:32.384 01:52:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:32.384 01:52:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:32.384 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:32.384 01:52:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:32.384 01:52:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:32.384 01:52:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:32.384 01:52:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:32.384 01:52:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:32.384 01:52:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:32.384 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:32.384 01:52:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:32.384 01:52:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:32.384 01:52:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:32.384 01:52:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:32.384 01:52:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:32.384 01:52:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:32.384 01:52:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:32.384 01:52:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:32.384 01:52:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:32.384 01:52:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:32.384 01:52:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:32.384 01:52:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:32.384 01:52:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:32.384 01:52:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:32.384 01:52:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:32.384 01:52:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:32.384 01:52:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:32.384 01:52:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:32.384 01:52:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:32.385 01:52:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:32.385 01:52:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:32.385 01:52:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:32.385 01:52:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:32.385 01:52:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:32.385 01:52:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:32.385 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:32.385 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:16:32.385 00:16:32.385 --- 10.0.0.2 ping statistics --- 00:16:32.385 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.385 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:16:32.385 01:52:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:32.385 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:32.385 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:16:32.385 00:16:32.385 --- 10.0.0.1 ping statistics --- 00:16:32.385 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.385 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:16:32.385 01:52:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:32.385 01:52:20 -- nvmf/common.sh@410 -- # return 0 00:16:32.385 01:52:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:32.385 01:52:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:32.385 01:52:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:32.385 01:52:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:32.385 01:52:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:32.385 01:52:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:32.385 01:52:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:32.385 01:52:20 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:32.385 01:52:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:32.385 01:52:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:32.385 01:52:20 -- common/autotest_common.sh@10 -- # set +x 00:16:32.385 01:52:20 -- nvmf/common.sh@469 -- # nvmfpid=3446127 00:16:32.385 01:52:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:32.385 01:52:20 -- nvmf/common.sh@470 -- # waitforlisten 3446127 00:16:32.385 01:52:20 -- common/autotest_common.sh@829 -- # '[' -z 3446127 ']' 00:16:32.385 01:52:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:32.385 01:52:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:32.385 01:52:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:32.385 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:32.385 01:52:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:32.385 01:52:20 -- common/autotest_common.sh@10 -- # set +x 00:16:32.385 [2024-11-19 01:52:20.563795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:32.385 [2024-11-19 01:52:20.563910] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:32.385 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.385 [2024-11-19 01:52:20.638147] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:32.385 [2024-11-19 01:52:20.759331] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:32.385 [2024-11-19 01:52:20.759519] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:32.385 [2024-11-19 01:52:20.759541] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:32.385 [2024-11-19 01:52:20.759558] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:32.385 [2024-11-19 01:52:20.759654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:32.385 [2024-11-19 01:52:20.759717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:32.385 [2024-11-19 01:52:20.759771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:32.385 [2024-11-19 01:52:20.759774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:33.319 01:52:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:33.319 01:52:21 -- common/autotest_common.sh@862 -- # return 0 00:16:33.319 01:52:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:33.319 01:52:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 01:52:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:33.319 01:52:21 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 [2024-11-19 01:52:21.555151] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:33.319 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.319 01:52:21 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 Malloc0 00:16:33.319 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.319 01:52:21 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.319 01:52:21 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.319 01:52:21 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 [2024-11-19 01:52:21.606425] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:33.319 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.319 01:52:21 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:33.319 test case1: single bdev can't be used in multiple subsystems 00:16:33.319 01:52:21 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.319 01:52:21 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.319 01:52:21 -- target/nmic.sh@28 -- # nmic_status=0 00:16:33.319 01:52:21 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:33.319 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.319 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.319 [2024-11-19 01:52:21.630290] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:33.319 [2024-11-19 01:52:21.630319] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:33.319 [2024-11-19 01:52:21.630338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:33.319 request: 00:16:33.319 { 00:16:33.319 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:33.319 "namespace": { 00:16:33.319 "bdev_name": "Malloc0" 00:16:33.319 }, 00:16:33.320 "method": "nvmf_subsystem_add_ns", 00:16:33.320 "req_id": 1 00:16:33.320 } 00:16:33.320 Got JSON-RPC error response 00:16:33.320 response: 00:16:33.320 { 00:16:33.320 "code": -32602, 00:16:33.320 "message": "Invalid parameters" 00:16:33.320 } 00:16:33.320 01:52:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:33.320 01:52:21 -- target/nmic.sh@29 -- # nmic_status=1 00:16:33.320 01:52:21 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:33.320 01:52:21 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:33.320 Adding namespace failed - expected result. 00:16:33.320 01:52:21 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:33.320 test case2: host connect to nvmf target in multiple paths 00:16:33.320 01:52:21 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:33.320 01:52:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.320 01:52:21 -- common/autotest_common.sh@10 -- # set +x 00:16:33.320 [2024-11-19 01:52:21.638395] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:33.320 01:52:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.320 01:52:21 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:33.886 01:52:22 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:34.452 01:52:22 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:34.452 01:52:22 -- common/autotest_common.sh@1187 -- # local i=0 00:16:34.452 01:52:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:34.452 01:52:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:34.452 01:52:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:36.978 01:52:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:36.978 01:52:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:36.978 01:52:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:36.978 01:52:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:36.978 01:52:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:36.978 01:52:24 -- common/autotest_common.sh@1197 -- # return 0 00:16:36.978 01:52:24 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:36.978 [global] 00:16:36.978 thread=1 00:16:36.978 invalidate=1 00:16:36.978 rw=write 00:16:36.978 time_based=1 00:16:36.978 runtime=1 00:16:36.978 ioengine=libaio 00:16:36.978 direct=1 00:16:36.978 bs=4096 00:16:36.978 iodepth=1 00:16:36.978 norandommap=0 00:16:36.978 numjobs=1 00:16:36.978 00:16:36.978 verify_dump=1 00:16:36.978 verify_backlog=512 00:16:36.978 verify_state_save=0 00:16:36.979 do_verify=1 00:16:36.979 verify=crc32c-intel 00:16:36.979 [job0] 00:16:36.979 filename=/dev/nvme0n1 00:16:36.979 Could not set queue depth (nvme0n1) 00:16:36.979 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:36.979 fio-3.35 00:16:36.979 Starting 1 thread 00:16:37.912 00:16:37.912 job0: (groupid=0, jobs=1): err= 0: pid=3446790: Tue Nov 19 01:52:26 2024 00:16:37.912 read: IOPS=1003, BW=4015KiB/s (4112kB/s)(4160KiB/1036msec) 00:16:37.912 slat (nsec): min=5008, max=65233, avg=10404.98, stdev=6367.59 00:16:37.912 clat (usec): min=165, max=41970, avg=744.13, stdev=4704.28 00:16:37.912 lat (usec): min=171, max=42003, avg=754.54, stdev=4704.85 00:16:37.912 clat percentiles (usec): 00:16:37.912 | 1.00th=[ 169], 5.00th=[ 174], 10.00th=[ 176], 20.00th=[ 180], 00:16:37.912 | 30.00th=[ 182], 40.00th=[ 186], 50.00th=[ 190], 60.00th=[ 194], 00:16:37.912 | 70.00th=[ 198], 80.00th=[ 206], 90.00th=[ 219], 95.00th=[ 265], 00:16:37.912 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:16:37.912 | 99.99th=[42206] 00:16:37.912 write: IOPS=1482, BW=5931KiB/s (6073kB/s)(6144KiB/1036msec); 0 zone resets 00:16:37.912 slat (nsec): min=6435, max=59893, avg=11273.13, stdev=5456.01 00:16:37.912 clat (usec): min=117, max=439, avg=147.06, stdev=31.38 00:16:37.912 lat (usec): min=124, max=499, avg=158.33, stdev=34.54 00:16:37.912 clat percentiles (usec): 00:16:37.912 | 1.00th=[ 122], 5.00th=[ 125], 10.00th=[ 126], 20.00th=[ 129], 00:16:37.912 | 30.00th=[ 133], 40.00th=[ 135], 50.00th=[ 139], 60.00th=[ 141], 00:16:37.912 | 70.00th=[ 149], 80.00th=[ 161], 90.00th=[ 172], 95.00th=[ 219], 00:16:37.912 | 99.00th=[ 293], 99.50th=[ 363], 99.90th=[ 392], 99.95th=[ 441], 00:16:37.912 | 99.99th=[ 441] 00:16:37.912 bw ( KiB/s): min=12288, max=12288, per=100.00%, avg=12288.00, stdev= 0.00, samples=1 00:16:37.912 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:16:37.912 lat (usec) : 250=96.82%, 500=2.64% 00:16:37.912 lat (msec) : 50=0.54% 00:16:37.912 cpu : usr=1.84%, sys=2.51%, ctx=2576, majf=0, minf=1 00:16:37.912 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:37.912 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:37.912 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:37.912 issued rwts: total=1040,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:37.912 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:37.912 00:16:37.912 Run status group 0 (all jobs): 00:16:37.912 READ: bw=4015KiB/s (4112kB/s), 4015KiB/s-4015KiB/s (4112kB/s-4112kB/s), io=4160KiB (4260kB), run=1036-1036msec 00:16:37.912 WRITE: bw=5931KiB/s (6073kB/s), 5931KiB/s-5931KiB/s (6073kB/s-6073kB/s), io=6144KiB (6291kB), run=1036-1036msec 00:16:37.912 00:16:37.912 Disk stats (read/write): 00:16:37.912 nvme0n1: ios=1085/1536, merge=0/0, ticks=617/217, in_queue=834, util=91.48% 00:16:37.912 01:52:26 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:37.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:37.912 01:52:26 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:37.912 01:52:26 -- common/autotest_common.sh@1208 -- # local i=0 00:16:37.912 01:52:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:37.912 01:52:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.170 01:52:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:38.170 01:52:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.171 01:52:26 -- common/autotest_common.sh@1220 -- # return 0 00:16:38.171 01:52:26 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:38.171 01:52:26 -- target/nmic.sh@53 -- # nvmftestfini 00:16:38.171 01:52:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:38.171 01:52:26 -- nvmf/common.sh@116 -- # sync 00:16:38.171 01:52:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:38.171 01:52:26 -- nvmf/common.sh@119 -- # set +e 00:16:38.171 01:52:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:38.171 01:52:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:38.171 rmmod nvme_tcp 00:16:38.171 rmmod nvme_fabrics 00:16:38.171 rmmod nvme_keyring 00:16:38.171 01:52:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:38.171 01:52:26 -- nvmf/common.sh@123 -- # set -e 00:16:38.171 01:52:26 -- nvmf/common.sh@124 -- # return 0 00:16:38.171 01:52:26 -- nvmf/common.sh@477 -- # '[' -n 3446127 ']' 00:16:38.171 01:52:26 -- nvmf/common.sh@478 -- # killprocess 3446127 00:16:38.171 01:52:26 -- common/autotest_common.sh@936 -- # '[' -z 3446127 ']' 00:16:38.171 01:52:26 -- common/autotest_common.sh@940 -- # kill -0 3446127 00:16:38.171 01:52:26 -- common/autotest_common.sh@941 -- # uname 00:16:38.171 01:52:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.171 01:52:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3446127 00:16:38.171 01:52:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:38.171 01:52:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:38.171 01:52:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3446127' 00:16:38.171 killing process with pid 3446127 00:16:38.171 01:52:26 -- common/autotest_common.sh@955 -- # kill 3446127 00:16:38.171 01:52:26 -- common/autotest_common.sh@960 -- # wait 3446127 00:16:38.429 01:52:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:38.429 01:52:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:38.429 01:52:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:38.429 01:52:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:38.429 01:52:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:38.429 01:52:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:38.429 01:52:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:38.429 01:52:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:40.959 01:52:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:40.959 00:16:40.959 real 0m10.801s 00:16:40.959 user 0m25.538s 00:16:40.959 sys 0m2.522s 00:16:40.959 01:52:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:40.959 01:52:28 -- common/autotest_common.sh@10 -- # set +x 00:16:40.959 ************************************ 00:16:40.959 END TEST nvmf_nmic 00:16:40.959 ************************************ 00:16:40.959 01:52:28 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:40.959 01:52:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:40.959 01:52:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:40.959 01:52:28 -- common/autotest_common.sh@10 -- # set +x 00:16:40.959 ************************************ 00:16:40.959 START TEST nvmf_fio_target 00:16:40.959 ************************************ 00:16:40.959 01:52:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:40.959 * Looking for test storage... 00:16:40.959 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:40.959 01:52:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:40.959 01:52:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:40.959 01:52:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:40.959 01:52:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:40.959 01:52:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:40.959 01:52:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:40.959 01:52:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:40.959 01:52:29 -- scripts/common.sh@335 -- # IFS=.-: 00:16:40.959 01:52:29 -- scripts/common.sh@335 -- # read -ra ver1 00:16:40.959 01:52:29 -- scripts/common.sh@336 -- # IFS=.-: 00:16:40.959 01:52:29 -- scripts/common.sh@336 -- # read -ra ver2 00:16:40.959 01:52:29 -- scripts/common.sh@337 -- # local 'op=<' 00:16:40.959 01:52:29 -- scripts/common.sh@339 -- # ver1_l=2 00:16:40.959 01:52:29 -- scripts/common.sh@340 -- # ver2_l=1 00:16:40.959 01:52:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:40.959 01:52:29 -- scripts/common.sh@343 -- # case "$op" in 00:16:40.959 01:52:29 -- scripts/common.sh@344 -- # : 1 00:16:40.959 01:52:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:40.959 01:52:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:40.959 01:52:29 -- scripts/common.sh@364 -- # decimal 1 00:16:40.959 01:52:29 -- scripts/common.sh@352 -- # local d=1 00:16:40.959 01:52:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:40.959 01:52:29 -- scripts/common.sh@354 -- # echo 1 00:16:40.959 01:52:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:40.959 01:52:29 -- scripts/common.sh@365 -- # decimal 2 00:16:40.959 01:52:29 -- scripts/common.sh@352 -- # local d=2 00:16:40.959 01:52:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:40.959 01:52:29 -- scripts/common.sh@354 -- # echo 2 00:16:40.959 01:52:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:40.959 01:52:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:40.959 01:52:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:40.959 01:52:29 -- scripts/common.sh@367 -- # return 0 00:16:40.959 01:52:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:40.959 01:52:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:40.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.959 --rc genhtml_branch_coverage=1 00:16:40.959 --rc genhtml_function_coverage=1 00:16:40.959 --rc genhtml_legend=1 00:16:40.959 --rc geninfo_all_blocks=1 00:16:40.959 --rc geninfo_unexecuted_blocks=1 00:16:40.959 00:16:40.959 ' 00:16:40.959 01:52:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:40.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.959 --rc genhtml_branch_coverage=1 00:16:40.959 --rc genhtml_function_coverage=1 00:16:40.959 --rc genhtml_legend=1 00:16:40.959 --rc geninfo_all_blocks=1 00:16:40.959 --rc geninfo_unexecuted_blocks=1 00:16:40.959 00:16:40.959 ' 00:16:40.959 01:52:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:40.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.959 --rc genhtml_branch_coverage=1 00:16:40.959 --rc genhtml_function_coverage=1 00:16:40.959 --rc genhtml_legend=1 00:16:40.959 --rc geninfo_all_blocks=1 00:16:40.959 --rc geninfo_unexecuted_blocks=1 00:16:40.959 00:16:40.959 ' 00:16:40.959 01:52:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:40.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:40.959 --rc genhtml_branch_coverage=1 00:16:40.959 --rc genhtml_function_coverage=1 00:16:40.959 --rc genhtml_legend=1 00:16:40.959 --rc geninfo_all_blocks=1 00:16:40.959 --rc geninfo_unexecuted_blocks=1 00:16:40.959 00:16:40.959 ' 00:16:40.959 01:52:29 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:40.959 01:52:29 -- nvmf/common.sh@7 -- # uname -s 00:16:40.959 01:52:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:40.959 01:52:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:40.959 01:52:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:40.959 01:52:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:40.959 01:52:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:40.959 01:52:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:40.959 01:52:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:40.959 01:52:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:40.959 01:52:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:40.959 01:52:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:40.959 01:52:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:40.959 01:52:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:40.959 01:52:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:40.959 01:52:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:40.959 01:52:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:40.959 01:52:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:40.959 01:52:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:40.959 01:52:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:40.959 01:52:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:40.959 01:52:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.960 01:52:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.960 01:52:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.960 01:52:29 -- paths/export.sh@5 -- # export PATH 00:16:40.960 01:52:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.960 01:52:29 -- nvmf/common.sh@46 -- # : 0 00:16:40.960 01:52:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:40.960 01:52:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:40.960 01:52:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:40.960 01:52:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:40.960 01:52:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:40.960 01:52:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:40.960 01:52:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:40.960 01:52:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:40.960 01:52:29 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:40.960 01:52:29 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:40.960 01:52:29 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:40.960 01:52:29 -- target/fio.sh@16 -- # nvmftestinit 00:16:40.960 01:52:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:40.960 01:52:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:40.960 01:52:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:40.960 01:52:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:40.960 01:52:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:40.960 01:52:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:40.960 01:52:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:40.960 01:52:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:40.960 01:52:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:40.960 01:52:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:40.960 01:52:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:40.960 01:52:29 -- common/autotest_common.sh@10 -- # set +x 00:16:42.859 01:52:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:42.859 01:52:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:42.859 01:52:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:42.859 01:52:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:42.859 01:52:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:42.859 01:52:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:42.859 01:52:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:42.859 01:52:31 -- nvmf/common.sh@294 -- # net_devs=() 00:16:42.859 01:52:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:42.859 01:52:31 -- nvmf/common.sh@295 -- # e810=() 00:16:42.859 01:52:31 -- nvmf/common.sh@295 -- # local -ga e810 00:16:42.859 01:52:31 -- nvmf/common.sh@296 -- # x722=() 00:16:42.859 01:52:31 -- nvmf/common.sh@296 -- # local -ga x722 00:16:42.859 01:52:31 -- nvmf/common.sh@297 -- # mlx=() 00:16:42.859 01:52:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:42.859 01:52:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:42.859 01:52:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:42.859 01:52:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:42.859 01:52:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:42.859 01:52:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.859 01:52:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:42.859 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:42.859 01:52:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.859 01:52:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:42.859 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:42.859 01:52:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:42.859 01:52:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:42.859 01:52:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.859 01:52:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.859 01:52:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.859 01:52:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.859 01:52:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:42.859 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:42.859 01:52:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.859 01:52:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.859 01:52:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.859 01:52:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.859 01:52:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.859 01:52:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:42.860 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:42.860 01:52:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.860 01:52:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:42.860 01:52:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:42.860 01:52:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:42.860 01:52:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:42.860 01:52:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:42.860 01:52:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:42.860 01:52:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:42.860 01:52:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:42.860 01:52:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:42.860 01:52:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:42.860 01:52:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:42.860 01:52:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:42.860 01:52:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:42.860 01:52:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:42.860 01:52:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:42.860 01:52:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:42.860 01:52:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:42.860 01:52:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:42.860 01:52:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:42.860 01:52:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:42.860 01:52:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:42.860 01:52:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:42.860 01:52:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:42.860 01:52:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:42.860 01:52:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:42.860 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:42.860 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:16:42.860 00:16:42.860 --- 10.0.0.2 ping statistics --- 00:16:42.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.860 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:16:42.860 01:52:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:42.860 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:42.860 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:16:42.860 00:16:42.860 --- 10.0.0.1 ping statistics --- 00:16:42.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.860 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:16:42.860 01:52:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:42.860 01:52:31 -- nvmf/common.sh@410 -- # return 0 00:16:42.860 01:52:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:42.860 01:52:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:42.860 01:52:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:42.860 01:52:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:42.860 01:52:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:42.860 01:52:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:42.860 01:52:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:42.860 01:52:31 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:42.860 01:52:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:42.860 01:52:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:42.860 01:52:31 -- common/autotest_common.sh@10 -- # set +x 00:16:42.860 01:52:31 -- nvmf/common.sh@469 -- # nvmfpid=3448901 00:16:42.860 01:52:31 -- nvmf/common.sh@470 -- # waitforlisten 3448901 00:16:42.860 01:52:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:42.860 01:52:31 -- common/autotest_common.sh@829 -- # '[' -z 3448901 ']' 00:16:42.860 01:52:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:42.860 01:52:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:42.860 01:52:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:42.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:42.860 01:52:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:42.860 01:52:31 -- common/autotest_common.sh@10 -- # set +x 00:16:42.860 [2024-11-19 01:52:31.279094] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:42.860 [2024-11-19 01:52:31.279182] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:42.860 EAL: No free 2048 kB hugepages reported on node 1 00:16:42.860 [2024-11-19 01:52:31.352496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:43.119 [2024-11-19 01:52:31.472884] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:43.119 [2024-11-19 01:52:31.473028] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:43.119 [2024-11-19 01:52:31.473046] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:43.119 [2024-11-19 01:52:31.473058] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:43.119 [2024-11-19 01:52:31.473112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:43.119 [2024-11-19 01:52:31.473141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:43.119 [2024-11-19 01:52:31.473198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:43.119 [2024-11-19 01:52:31.473201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:44.052 01:52:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:44.052 01:52:32 -- common/autotest_common.sh@862 -- # return 0 00:16:44.052 01:52:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:44.052 01:52:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:44.052 01:52:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.052 01:52:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:44.052 01:52:32 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:44.052 [2024-11-19 01:52:32.557176] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:44.052 01:52:32 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.310 01:52:32 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:44.310 01:52:32 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.876 01:52:33 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:44.876 01:52:33 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.876 01:52:33 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:44.876 01:52:33 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.441 01:52:33 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:45.441 01:52:33 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:45.442 01:52:33 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.700 01:52:34 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:45.700 01:52:34 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.957 01:52:34 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:45.957 01:52:34 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.215 01:52:34 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:46.215 01:52:34 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:46.472 01:52:34 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:46.729 01:52:35 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:46.729 01:52:35 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:46.986 01:52:35 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:46.986 01:52:35 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:47.244 01:52:35 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:47.501 [2024-11-19 01:52:35.990001] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:47.501 01:52:36 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:47.759 01:52:36 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:48.016 01:52:36 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:48.582 01:52:37 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:48.582 01:52:37 -- common/autotest_common.sh@1187 -- # local i=0 00:16:48.582 01:52:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:48.582 01:52:37 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:48.582 01:52:37 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:48.582 01:52:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:51.108 01:52:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:51.108 01:52:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:51.108 01:52:39 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:51.108 01:52:39 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:51.108 01:52:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:51.108 01:52:39 -- common/autotest_common.sh@1197 -- # return 0 00:16:51.108 01:52:39 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:51.108 [global] 00:16:51.108 thread=1 00:16:51.108 invalidate=1 00:16:51.108 rw=write 00:16:51.108 time_based=1 00:16:51.108 runtime=1 00:16:51.108 ioengine=libaio 00:16:51.108 direct=1 00:16:51.108 bs=4096 00:16:51.108 iodepth=1 00:16:51.108 norandommap=0 00:16:51.108 numjobs=1 00:16:51.108 00:16:51.108 verify_dump=1 00:16:51.108 verify_backlog=512 00:16:51.108 verify_state_save=0 00:16:51.108 do_verify=1 00:16:51.108 verify=crc32c-intel 00:16:51.108 [job0] 00:16:51.108 filename=/dev/nvme0n1 00:16:51.108 [job1] 00:16:51.108 filename=/dev/nvme0n2 00:16:51.108 [job2] 00:16:51.108 filename=/dev/nvme0n3 00:16:51.108 [job3] 00:16:51.108 filename=/dev/nvme0n4 00:16:51.108 Could not set queue depth (nvme0n1) 00:16:51.108 Could not set queue depth (nvme0n2) 00:16:51.108 Could not set queue depth (nvme0n3) 00:16:51.108 Could not set queue depth (nvme0n4) 00:16:51.109 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.109 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.109 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.109 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.109 fio-3.35 00:16:51.109 Starting 4 threads 00:16:52.480 00:16:52.480 job0: (groupid=0, jobs=1): err= 0: pid=3450115: Tue Nov 19 01:52:40 2024 00:16:52.480 read: IOPS=727, BW=2912KiB/s (2982kB/s)(3008KiB/1033msec) 00:16:52.480 slat (nsec): min=7023, max=46490, avg=16213.68, stdev=5559.02 00:16:52.480 clat (usec): min=202, max=42015, avg=1079.46, stdev=5573.39 00:16:52.480 lat (usec): min=211, max=42041, avg=1095.68, stdev=5573.96 00:16:52.480 clat percentiles (usec): 00:16:52.480 | 1.00th=[ 217], 5.00th=[ 233], 10.00th=[ 241], 20.00th=[ 249], 00:16:52.480 | 30.00th=[ 260], 40.00th=[ 269], 50.00th=[ 281], 60.00th=[ 293], 00:16:52.480 | 70.00th=[ 310], 80.00th=[ 334], 90.00th=[ 355], 95.00th=[ 441], 00:16:52.480 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:52.480 | 99.99th=[42206] 00:16:52.480 write: IOPS=991, BW=3965KiB/s (4060kB/s)(4096KiB/1033msec); 0 zone resets 00:16:52.480 slat (nsec): min=7506, max=50159, avg=14575.58, stdev=6468.84 00:16:52.480 clat (usec): min=135, max=505, avg=181.02, stdev=22.64 00:16:52.480 lat (usec): min=144, max=513, avg=195.59, stdev=24.93 00:16:52.480 clat percentiles (usec): 00:16:52.480 | 1.00th=[ 145], 5.00th=[ 149], 10.00th=[ 155], 20.00th=[ 163], 00:16:52.480 | 30.00th=[ 172], 40.00th=[ 178], 50.00th=[ 182], 60.00th=[ 186], 00:16:52.480 | 70.00th=[ 190], 80.00th=[ 194], 90.00th=[ 202], 95.00th=[ 215], 00:16:52.480 | 99.00th=[ 249], 99.50th=[ 260], 99.90th=[ 269], 99.95th=[ 506], 00:16:52.480 | 99.99th=[ 506] 00:16:52.480 bw ( KiB/s): min= 4096, max= 4096, per=28.58%, avg=4096.00, stdev= 0.00, samples=2 00:16:52.480 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:16:52.480 lat (usec) : 250=65.71%, 500=32.77%, 750=0.62% 00:16:52.480 lat (msec) : 2=0.06%, 20=0.06%, 50=0.79% 00:16:52.480 cpu : usr=1.26%, sys=4.26%, ctx=1776, majf=0, minf=2 00:16:52.480 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.480 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.480 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.480 issued rwts: total=752,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.480 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.480 job1: (groupid=0, jobs=1): err= 0: pid=3450116: Tue Nov 19 01:52:40 2024 00:16:52.480 read: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec) 00:16:52.480 slat (nsec): min=5511, max=71276, avg=16385.83, stdev=8030.73 00:16:52.480 clat (usec): min=182, max=41898, avg=650.34, stdev=3818.56 00:16:52.480 lat (usec): min=189, max=41932, avg=666.72, stdev=3819.40 00:16:52.480 clat percentiles (usec): 00:16:52.480 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 204], 20.00th=[ 215], 00:16:52.480 | 30.00th=[ 229], 40.00th=[ 255], 50.00th=[ 277], 60.00th=[ 293], 00:16:52.480 | 70.00th=[ 326], 80.00th=[ 355], 90.00th=[ 396], 95.00th=[ 465], 00:16:52.480 | 99.00th=[ 1237], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:16:52.480 | 99.99th=[41681] 00:16:52.480 write: IOPS=1530, BW=6122KiB/s (6269kB/s)(6128KiB/1001msec); 0 zone resets 00:16:52.480 slat (nsec): min=7227, max=50709, avg=16663.25, stdev=6366.35 00:16:52.480 clat (usec): min=127, max=645, avg=182.38, stdev=35.51 00:16:52.480 lat (usec): min=134, max=657, avg=199.04, stdev=36.32 00:16:52.480 clat percentiles (usec): 00:16:52.480 | 1.00th=[ 135], 5.00th=[ 141], 10.00th=[ 145], 20.00th=[ 151], 00:16:52.480 | 30.00th=[ 157], 40.00th=[ 165], 50.00th=[ 176], 60.00th=[ 186], 00:16:52.480 | 70.00th=[ 198], 80.00th=[ 212], 90.00th=[ 233], 95.00th=[ 245], 00:16:52.480 | 99.00th=[ 269], 99.50th=[ 281], 99.90th=[ 334], 99.95th=[ 644], 00:16:52.480 | 99.99th=[ 644] 00:16:52.480 bw ( KiB/s): min= 4096, max= 4096, per=28.58%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.480 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.480 lat (usec) : 250=72.89%, 500=25.86%, 750=0.82% 00:16:52.480 lat (msec) : 2=0.04%, 4=0.04%, 50=0.35% 00:16:52.480 cpu : usr=2.90%, sys=4.50%, ctx=2556, majf=0, minf=1 00:16:52.480 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.480 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.480 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.480 issued rwts: total=1024,1532,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.480 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.480 job2: (groupid=0, jobs=1): err= 0: pid=3450117: Tue Nov 19 01:52:40 2024 00:16:52.480 read: IOPS=23, BW=92.9KiB/s (95.2kB/s)(96.0KiB/1033msec) 00:16:52.480 slat (nsec): min=7470, max=34912, avg=21606.54, stdev=9378.39 00:16:52.480 clat (usec): min=206, max=42067, avg=37891.77, stdev=11601.99 00:16:52.480 lat (usec): min=221, max=42083, avg=37913.37, stdev=11603.10 00:16:52.480 clat percentiles (usec): 00:16:52.480 | 1.00th=[ 206], 5.00th=[ 297], 10.00th=[40633], 20.00th=[41157], 00:16:52.480 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:52.480 | 70.00th=[41681], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:52.480 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:52.480 | 99.99th=[42206] 00:16:52.480 write: IOPS=495, BW=1983KiB/s (2030kB/s)(2048KiB/1033msec); 0 zone resets 00:16:52.480 slat (nsec): min=7484, max=56049, avg=17706.79, stdev=7572.71 00:16:52.480 clat (usec): min=158, max=485, avg=218.05, stdev=27.48 00:16:52.480 lat (usec): min=180, max=513, avg=235.75, stdev=26.70 00:16:52.480 clat percentiles (usec): 00:16:52.480 | 1.00th=[ 172], 5.00th=[ 184], 10.00th=[ 190], 20.00th=[ 196], 00:16:52.480 | 30.00th=[ 202], 40.00th=[ 208], 50.00th=[ 217], 60.00th=[ 225], 00:16:52.480 | 70.00th=[ 231], 80.00th=[ 239], 90.00th=[ 249], 95.00th=[ 255], 00:16:52.480 | 99.00th=[ 269], 99.50th=[ 330], 99.90th=[ 486], 99.95th=[ 486], 00:16:52.480 | 99.99th=[ 486] 00:16:52.481 bw ( KiB/s): min= 4096, max= 4096, per=28.58%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.481 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.481 lat (usec) : 250=87.31%, 500=8.58% 00:16:52.481 lat (msec) : 50=4.10% 00:16:52.481 cpu : usr=0.58%, sys=1.16%, ctx=536, majf=0, minf=1 00:16:52.481 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.481 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.481 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.481 job3: (groupid=0, jobs=1): err= 0: pid=3450118: Tue Nov 19 01:52:40 2024 00:16:52.481 read: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec) 00:16:52.481 slat (nsec): min=7631, max=44990, avg=17105.51, stdev=5649.49 00:16:52.481 clat (usec): min=211, max=42191, avg=1643.63, stdev=7383.83 00:16:52.481 lat (usec): min=220, max=42217, avg=1660.73, stdev=7384.15 00:16:52.481 clat percentiles (usec): 00:16:52.481 | 1.00th=[ 223], 5.00th=[ 235], 10.00th=[ 241], 20.00th=[ 249], 00:16:52.481 | 30.00th=[ 253], 40.00th=[ 260], 50.00th=[ 265], 60.00th=[ 269], 00:16:52.481 | 70.00th=[ 277], 80.00th=[ 289], 90.00th=[ 363], 95.00th=[ 453], 00:16:52.481 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:52.481 | 99.99th=[42206] 00:16:52.481 write: IOPS=632, BW=2529KiB/s (2590kB/s)(2532KiB/1001msec); 0 zone resets 00:16:52.481 slat (nsec): min=8066, max=48335, avg=19260.58, stdev=7555.23 00:16:52.481 clat (usec): min=151, max=253, avg=202.38, stdev=17.38 00:16:52.481 lat (usec): min=161, max=279, avg=221.64, stdev=20.14 00:16:52.481 clat percentiles (usec): 00:16:52.481 | 1.00th=[ 161], 5.00th=[ 174], 10.00th=[ 180], 20.00th=[ 188], 00:16:52.481 | 30.00th=[ 194], 40.00th=[ 198], 50.00th=[ 204], 60.00th=[ 208], 00:16:52.481 | 70.00th=[ 215], 80.00th=[ 217], 90.00th=[ 225], 95.00th=[ 229], 00:16:52.481 | 99.00th=[ 241], 99.50th=[ 245], 99.90th=[ 255], 99.95th=[ 255], 00:16:52.481 | 99.99th=[ 255] 00:16:52.481 bw ( KiB/s): min= 4096, max= 4096, per=28.58%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.481 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.481 lat (usec) : 250=65.50%, 500=32.49%, 750=0.52% 00:16:52.481 lat (msec) : 50=1.48% 00:16:52.481 cpu : usr=1.40%, sys=2.80%, ctx=1146, majf=0, minf=1 00:16:52.481 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.481 issued rwts: total=512,633,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.481 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.481 00:16:52.481 Run status group 0 (all jobs): 00:16:52.481 READ: bw=8953KiB/s (9167kB/s), 92.9KiB/s-4092KiB/s (95.2kB/s-4190kB/s), io=9248KiB (9470kB), run=1001-1033msec 00:16:52.481 WRITE: bw=14.0MiB/s (14.7MB/s), 1983KiB/s-6122KiB/s (2030kB/s-6269kB/s), io=14.5MiB (15.2MB), run=1001-1033msec 00:16:52.481 00:16:52.481 Disk stats (read/write): 00:16:52.481 nvme0n1: ios=562/937, merge=0/0, ticks=666/174, in_queue=840, util=86.67% 00:16:52.481 nvme0n2: ios=876/1024, merge=0/0, ticks=824/176, in_queue=1000, util=91.25% 00:16:52.481 nvme0n3: ios=19/512, merge=0/0, ticks=703/107, in_queue=810, util=89.03% 00:16:52.481 nvme0n4: ios=446/512, merge=0/0, ticks=1644/102, in_queue=1746, util=97.58% 00:16:52.481 01:52:40 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:52.481 [global] 00:16:52.481 thread=1 00:16:52.481 invalidate=1 00:16:52.481 rw=randwrite 00:16:52.481 time_based=1 00:16:52.481 runtime=1 00:16:52.481 ioengine=libaio 00:16:52.481 direct=1 00:16:52.481 bs=4096 00:16:52.481 iodepth=1 00:16:52.481 norandommap=0 00:16:52.481 numjobs=1 00:16:52.481 00:16:52.481 verify_dump=1 00:16:52.481 verify_backlog=512 00:16:52.481 verify_state_save=0 00:16:52.481 do_verify=1 00:16:52.481 verify=crc32c-intel 00:16:52.481 [job0] 00:16:52.481 filename=/dev/nvme0n1 00:16:52.481 [job1] 00:16:52.481 filename=/dev/nvme0n2 00:16:52.481 [job2] 00:16:52.481 filename=/dev/nvme0n3 00:16:52.481 [job3] 00:16:52.481 filename=/dev/nvme0n4 00:16:52.481 Could not set queue depth (nvme0n1) 00:16:52.481 Could not set queue depth (nvme0n2) 00:16:52.481 Could not set queue depth (nvme0n3) 00:16:52.481 Could not set queue depth (nvme0n4) 00:16:52.481 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.481 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.481 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.481 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.481 fio-3.35 00:16:52.481 Starting 4 threads 00:16:53.932 00:16:53.932 job0: (groupid=0, jobs=1): err= 0: pid=3450348: Tue Nov 19 01:52:42 2024 00:16:53.932 read: IOPS=23, BW=95.5KiB/s (97.8kB/s)(96.0KiB/1005msec) 00:16:53.932 slat (nsec): min=11862, max=35433, avg=28885.83, stdev=7814.60 00:16:53.932 clat (usec): min=322, max=42045, avg=37802.35, stdev=11547.07 00:16:53.932 lat (usec): min=356, max=42063, avg=37831.23, stdev=11545.16 00:16:53.932 clat percentiles (usec): 00:16:53.932 | 1.00th=[ 322], 5.00th=[ 355], 10.00th=[40633], 20.00th=[41157], 00:16:53.932 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:53.932 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:53.932 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.932 | 99.99th=[42206] 00:16:53.932 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:16:53.932 slat (nsec): min=6933, max=38468, avg=12176.26, stdev=6199.56 00:16:53.932 clat (usec): min=138, max=243, avg=173.01, stdev=16.63 00:16:53.932 lat (usec): min=146, max=279, avg=185.19, stdev=19.83 00:16:53.932 clat percentiles (usec): 00:16:53.932 | 1.00th=[ 145], 5.00th=[ 151], 10.00th=[ 153], 20.00th=[ 157], 00:16:53.932 | 30.00th=[ 163], 40.00th=[ 167], 50.00th=[ 174], 60.00th=[ 176], 00:16:53.932 | 70.00th=[ 182], 80.00th=[ 188], 90.00th=[ 196], 95.00th=[ 200], 00:16:53.932 | 99.00th=[ 215], 99.50th=[ 227], 99.90th=[ 243], 99.95th=[ 243], 00:16:53.932 | 99.99th=[ 243] 00:16:53.932 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.932 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.932 lat (usec) : 250=95.52%, 500=0.37% 00:16:53.932 lat (msec) : 50=4.10% 00:16:53.932 cpu : usr=0.50%, sys=0.90%, ctx=537, majf=0, minf=1 00:16:53.932 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.932 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.932 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.932 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.932 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.932 job1: (groupid=0, jobs=1): err= 0: pid=3450354: Tue Nov 19 01:52:42 2024 00:16:53.932 read: IOPS=38, BW=156KiB/s (160kB/s)(160KiB/1026msec) 00:16:53.932 slat (nsec): min=7409, max=36983, avg=26785.00, stdev=9132.27 00:16:53.932 clat (usec): min=253, max=42343, avg=22967.85, stdev=20668.79 00:16:53.932 lat (usec): min=274, max=42357, avg=22994.64, stdev=20666.05 00:16:53.932 clat percentiles (usec): 00:16:53.932 | 1.00th=[ 253], 5.00th=[ 258], 10.00th=[ 265], 20.00th=[ 359], 00:16:53.932 | 30.00th=[ 449], 40.00th=[ 474], 50.00th=[41157], 60.00th=[41157], 00:16:53.932 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:53.932 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.932 | 99.99th=[42206] 00:16:53.932 write: IOPS=499, BW=1996KiB/s (2044kB/s)(2048KiB/1026msec); 0 zone resets 00:16:53.932 slat (nsec): min=7339, max=56401, avg=14928.07, stdev=8123.37 00:16:53.932 clat (usec): min=138, max=321, avg=187.97, stdev=23.11 00:16:53.932 lat (usec): min=146, max=332, avg=202.90, stdev=26.82 00:16:53.932 clat percentiles (usec): 00:16:53.932 | 1.00th=[ 145], 5.00th=[ 153], 10.00th=[ 159], 20.00th=[ 167], 00:16:53.932 | 30.00th=[ 174], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 194], 00:16:53.932 | 70.00th=[ 202], 80.00th=[ 208], 90.00th=[ 217], 95.00th=[ 227], 00:16:53.932 | 99.00th=[ 245], 99.50th=[ 265], 99.90th=[ 322], 99.95th=[ 322], 00:16:53.932 | 99.99th=[ 322] 00:16:53.932 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.932 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.932 lat (usec) : 250=92.03%, 500=3.62%, 1000=0.36% 00:16:53.932 lat (msec) : 50=3.99% 00:16:53.932 cpu : usr=0.49%, sys=1.07%, ctx=553, majf=0, minf=1 00:16:53.932 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.932 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.932 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.932 issued rwts: total=40,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.932 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.932 job2: (groupid=0, jobs=1): err= 0: pid=3450356: Tue Nov 19 01:52:42 2024 00:16:53.932 read: IOPS=48, BW=196KiB/s (201kB/s)(196KiB/1001msec) 00:16:53.932 slat (nsec): min=8184, max=72924, avg=29494.69, stdev=10843.02 00:16:53.932 clat (usec): min=244, max=42221, avg=17945.82, stdev=20503.92 00:16:53.932 lat (usec): min=276, max=42235, avg=17975.31, stdev=20498.43 00:16:53.932 clat percentiles (usec): 00:16:53.932 | 1.00th=[ 245], 5.00th=[ 265], 10.00th=[ 273], 20.00th=[ 343], 00:16:53.932 | 30.00th=[ 383], 40.00th=[ 416], 50.00th=[ 437], 60.00th=[40633], 00:16:53.932 | 70.00th=[40633], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:53.932 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.932 | 99.99th=[42206] 00:16:53.932 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:16:53.932 slat (nsec): min=7862, max=68410, avg=15337.71, stdev=8213.20 00:16:53.932 clat (usec): min=144, max=1306, avg=213.06, stdev=53.69 00:16:53.932 lat (usec): min=156, max=1328, avg=228.40, stdev=55.14 00:16:53.932 clat percentiles (usec): 00:16:53.932 | 1.00th=[ 155], 5.00th=[ 172], 10.00th=[ 182], 20.00th=[ 192], 00:16:53.932 | 30.00th=[ 202], 40.00th=[ 206], 50.00th=[ 212], 60.00th=[ 217], 00:16:53.932 | 70.00th=[ 225], 80.00th=[ 231], 90.00th=[ 241], 95.00th=[ 249], 00:16:53.932 | 99.00th=[ 262], 99.50th=[ 269], 99.90th=[ 1303], 99.95th=[ 1303], 00:16:53.932 | 99.99th=[ 1303] 00:16:53.932 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.932 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.932 lat (usec) : 250=87.17%, 500=8.73%, 1000=0.18% 00:16:53.932 lat (msec) : 2=0.18%, 50=3.74% 00:16:53.932 cpu : usr=0.30%, sys=1.40%, ctx=562, majf=0, minf=1 00:16:53.932 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.932 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.932 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.932 issued rwts: total=49,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.932 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.932 job3: (groupid=0, jobs=1): err= 0: pid=3450357: Tue Nov 19 01:52:42 2024 00:16:53.932 read: IOPS=22, BW=91.5KiB/s (93.7kB/s)(92.0KiB/1005msec) 00:16:53.932 slat (nsec): min=12877, max=39488, avg=26194.26, stdev=9471.48 00:16:53.932 clat (usec): min=314, max=42114, avg=39374.18, stdev=8528.46 00:16:53.932 lat (usec): min=354, max=42132, avg=39400.38, stdev=8525.69 00:16:53.932 clat percentiles (usec): 00:16:53.933 | 1.00th=[ 314], 5.00th=[40109], 10.00th=[40633], 20.00th=[41157], 00:16:53.933 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:53.933 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:53.933 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:53.933 | 99.99th=[42206] 00:16:53.933 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:16:53.933 slat (nsec): min=6172, max=33002, avg=10885.65, stdev=5865.50 00:16:53.933 clat (usec): min=146, max=250, avg=178.93, stdev=14.51 00:16:53.933 lat (usec): min=153, max=257, avg=189.81, stdev=16.21 00:16:53.933 clat percentiles (usec): 00:16:53.933 | 1.00th=[ 153], 5.00th=[ 157], 10.00th=[ 161], 20.00th=[ 167], 00:16:53.933 | 30.00th=[ 172], 40.00th=[ 174], 50.00th=[ 178], 60.00th=[ 182], 00:16:53.933 | 70.00th=[ 186], 80.00th=[ 190], 90.00th=[ 198], 95.00th=[ 204], 00:16:53.933 | 99.00th=[ 217], 99.50th=[ 227], 99.90th=[ 251], 99.95th=[ 251], 00:16:53.933 | 99.99th=[ 251] 00:16:53.933 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:53.933 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:53.933 lat (usec) : 250=95.51%, 500=0.37% 00:16:53.933 lat (msec) : 50=4.11% 00:16:53.933 cpu : usr=0.30%, sys=0.60%, ctx=535, majf=0, minf=2 00:16:53.933 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:53.933 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.933 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.933 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.933 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:53.933 00:16:53.933 Run status group 0 (all jobs): 00:16:53.933 READ: bw=530KiB/s (543kB/s), 91.5KiB/s-196KiB/s (93.7kB/s-201kB/s), io=544KiB (557kB), run=1001-1026msec 00:16:53.933 WRITE: bw=7984KiB/s (8176kB/s), 1996KiB/s-2046KiB/s (2044kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1026msec 00:16:53.933 00:16:53.933 Disk stats (read/write): 00:16:53.933 nvme0n1: ios=68/512, merge=0/0, ticks=772/79, in_queue=851, util=87.07% 00:16:53.933 nvme0n2: ios=70/512, merge=0/0, ticks=1299/93, in_queue=1392, util=99.39% 00:16:53.933 nvme0n3: ios=88/512, merge=0/0, ticks=1524/97, in_queue=1621, util=98.02% 00:16:53.933 nvme0n4: ios=64/512, merge=0/0, ticks=774/91, in_queue=865, util=90.65% 00:16:53.933 01:52:42 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:53.933 [global] 00:16:53.933 thread=1 00:16:53.933 invalidate=1 00:16:53.933 rw=write 00:16:53.933 time_based=1 00:16:53.933 runtime=1 00:16:53.933 ioengine=libaio 00:16:53.933 direct=1 00:16:53.933 bs=4096 00:16:53.933 iodepth=128 00:16:53.933 norandommap=0 00:16:53.933 numjobs=1 00:16:53.933 00:16:53.933 verify_dump=1 00:16:53.933 verify_backlog=512 00:16:53.933 verify_state_save=0 00:16:53.933 do_verify=1 00:16:53.933 verify=crc32c-intel 00:16:53.933 [job0] 00:16:53.933 filename=/dev/nvme0n1 00:16:53.933 [job1] 00:16:53.933 filename=/dev/nvme0n2 00:16:53.933 [job2] 00:16:53.933 filename=/dev/nvme0n3 00:16:53.933 [job3] 00:16:53.933 filename=/dev/nvme0n4 00:16:53.933 Could not set queue depth (nvme0n1) 00:16:53.933 Could not set queue depth (nvme0n2) 00:16:53.933 Could not set queue depth (nvme0n3) 00:16:53.933 Could not set queue depth (nvme0n4) 00:16:53.933 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.933 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.933 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.933 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.933 fio-3.35 00:16:53.933 Starting 4 threads 00:16:55.307 00:16:55.307 job0: (groupid=0, jobs=1): err= 0: pid=3450594: Tue Nov 19 01:52:43 2024 00:16:55.307 read: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec) 00:16:55.307 slat (usec): min=2, max=11970, avg=100.34, stdev=634.71 00:16:55.307 clat (usec): min=715, max=61737, avg=14151.40, stdev=9193.98 00:16:55.307 lat (usec): min=724, max=61759, avg=14251.74, stdev=9252.16 00:16:55.307 clat percentiles (usec): 00:16:55.307 | 1.00th=[ 1614], 5.00th=[ 3490], 10.00th=[ 8979], 20.00th=[10028], 00:16:55.307 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12125], 60.00th=[12387], 00:16:55.307 | 70.00th=[12780], 80.00th=[14877], 90.00th=[21890], 95.00th=[32113], 00:16:55.307 | 99.00th=[61080], 99.50th=[61604], 99.90th=[61604], 99.95th=[61604], 00:16:55.307 | 99.99th=[61604] 00:16:55.307 write: IOPS=4738, BW=18.5MiB/s (19.4MB/s)(18.5MiB/1002msec); 0 zone resets 00:16:55.307 slat (usec): min=3, max=10990, avg=86.43, stdev=556.57 00:16:55.307 clat (usec): min=488, max=56884, avg=12993.76, stdev=7547.67 00:16:55.307 lat (usec): min=493, max=56890, avg=13080.18, stdev=7593.46 00:16:55.307 clat percentiles (usec): 00:16:55.307 | 1.00th=[ 2343], 5.00th=[ 5342], 10.00th=[ 8094], 20.00th=[10028], 00:16:55.307 | 30.00th=[10421], 40.00th=[11207], 50.00th=[11731], 60.00th=[12518], 00:16:55.307 | 70.00th=[13304], 80.00th=[13960], 90.00th=[16909], 95.00th=[22152], 00:16:55.307 | 99.00th=[50594], 99.50th=[54789], 99.90th=[55837], 99.95th=[55837], 00:16:55.307 | 99.99th=[56886] 00:16:55.307 bw ( KiB/s): min=16488, max=20480, per=24.81%, avg=18484.00, stdev=2822.77, samples=2 00:16:55.307 iops : min= 4122, max= 5120, avg=4621.00, stdev=705.69, samples=2 00:16:55.307 lat (usec) : 500=0.03%, 750=0.03% 00:16:55.307 lat (msec) : 2=1.19%, 4=2.77%, 10=13.97%, 20=72.54%, 50=7.30% 00:16:55.307 lat (msec) : 100=2.17% 00:16:55.307 cpu : usr=5.59%, sys=9.29%, ctx=376, majf=0, minf=1 00:16:55.307 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:55.307 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.307 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.307 issued rwts: total=4608,4748,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.307 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.307 job1: (groupid=0, jobs=1): err= 0: pid=3450595: Tue Nov 19 01:52:43 2024 00:16:55.307 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:16:55.307 slat (usec): min=2, max=13401, avg=91.68, stdev=501.71 00:16:55.307 clat (usec): min=4728, max=44020, avg=12083.61, stdev=3612.63 00:16:55.307 lat (usec): min=4734, max=44025, avg=12175.29, stdev=3642.48 00:16:55.307 clat percentiles (usec): 00:16:55.307 | 1.00th=[ 8848], 5.00th=[ 9634], 10.00th=[10028], 20.00th=[10683], 00:16:55.307 | 30.00th=[10945], 40.00th=[11338], 50.00th=[11469], 60.00th=[11863], 00:16:55.307 | 70.00th=[11994], 80.00th=[12256], 90.00th=[12911], 95.00th=[15008], 00:16:55.307 | 99.00th=[27919], 99.50th=[35914], 99.90th=[43254], 99.95th=[43779], 00:16:55.307 | 99.99th=[43779] 00:16:55.307 write: IOPS=5384, BW=21.0MiB/s (22.1MB/s)(21.1MiB/1002msec); 0 zone resets 00:16:55.307 slat (usec): min=3, max=9141, avg=86.12, stdev=431.78 00:16:55.307 clat (usec): min=1265, max=44025, avg=12026.40, stdev=3570.40 00:16:55.307 lat (usec): min=1287, max=44693, avg=12112.51, stdev=3576.93 00:16:55.307 clat percentiles (usec): 00:16:55.307 | 1.00th=[ 4228], 5.00th=[ 9241], 10.00th=[ 9896], 20.00th=[10552], 00:16:55.307 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11469], 60.00th=[11863], 00:16:55.307 | 70.00th=[12387], 80.00th=[13173], 90.00th=[13960], 95.00th=[14877], 00:16:55.307 | 99.00th=[34866], 99.50th=[36439], 99.90th=[38011], 99.95th=[43779], 00:16:55.307 | 99.99th=[43779] 00:16:55.307 bw ( KiB/s): min=20480, max=21984, per=28.50%, avg=21232.00, stdev=1063.49, samples=2 00:16:55.307 iops : min= 5120, max= 5500, avg=5310.00, stdev=268.70, samples=2 00:16:55.307 lat (msec) : 2=0.16%, 4=0.20%, 10=10.99%, 20=85.60%, 50=3.04% 00:16:55.307 cpu : usr=7.69%, sys=12.09%, ctx=616, majf=0, minf=1 00:16:55.307 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:55.307 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.307 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.307 issued rwts: total=5120,5395,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.307 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.307 job2: (groupid=0, jobs=1): err= 0: pid=3450596: Tue Nov 19 01:52:43 2024 00:16:55.307 read: IOPS=3548, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1010msec) 00:16:55.307 slat (usec): min=2, max=15918, avg=123.98, stdev=821.25 00:16:55.307 clat (usec): min=4802, max=48031, avg=15900.58, stdev=6831.58 00:16:55.307 lat (usec): min=4809, max=48040, avg=16024.56, stdev=6878.91 00:16:55.307 clat percentiles (usec): 00:16:55.307 | 1.00th=[ 7046], 5.00th=[ 9634], 10.00th=[11469], 20.00th=[12518], 00:16:55.307 | 30.00th=[12780], 40.00th=[13304], 50.00th=[13698], 60.00th=[13960], 00:16:55.307 | 70.00th=[15270], 80.00th=[16712], 90.00th=[25297], 95.00th=[29492], 00:16:55.307 | 99.00th=[42730], 99.50th=[43779], 99.90th=[47973], 99.95th=[47973], 00:16:55.307 | 99.99th=[47973] 00:16:55.307 write: IOPS=3768, BW=14.7MiB/s (15.4MB/s)(14.9MiB/1010msec); 0 zone resets 00:16:55.307 slat (usec): min=3, max=24312, avg=137.43, stdev=932.04 00:16:55.307 clat (usec): min=3818, max=56449, avg=18462.17, stdev=9248.18 00:16:55.307 lat (usec): min=3828, max=68215, avg=18599.60, stdev=9308.78 00:16:55.307 clat percentiles (usec): 00:16:55.307 | 1.00th=[ 8455], 5.00th=[10552], 10.00th=[12518], 20.00th=[13698], 00:16:55.307 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14615], 60.00th=[15139], 00:16:55.307 | 70.00th=[18482], 80.00th=[22152], 90.00th=[29230], 95.00th=[38011], 00:16:55.307 | 99.00th=[53216], 99.50th=[56361], 99.90th=[56361], 99.95th=[56361], 00:16:55.307 | 99.99th=[56361] 00:16:55.307 bw ( KiB/s): min=12288, max=17144, per=19.75%, avg=14716.00, stdev=3433.71, samples=2 00:16:55.308 iops : min= 3072, max= 4286, avg=3679.00, stdev=858.43, samples=2 00:16:55.308 lat (msec) : 4=0.08%, 10=5.40%, 20=73.10%, 50=19.92%, 100=1.50% 00:16:55.308 cpu : usr=2.68%, sys=6.05%, ctx=370, majf=0, minf=2 00:16:55.308 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:16:55.308 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.308 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.308 issued rwts: total=3584,3806,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.308 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.308 job3: (groupid=0, jobs=1): err= 0: pid=3450597: Tue Nov 19 01:52:43 2024 00:16:55.308 read: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec) 00:16:55.308 slat (usec): min=2, max=9757, avg=96.89, stdev=619.88 00:16:55.308 clat (usec): min=7389, max=24437, avg=13056.27, stdev=1984.09 00:16:55.308 lat (usec): min=7399, max=24453, avg=13153.16, stdev=2054.27 00:16:55.308 clat percentiles (usec): 00:16:55.308 | 1.00th=[ 8586], 5.00th=[10421], 10.00th=[11207], 20.00th=[11600], 00:16:55.308 | 30.00th=[12256], 40.00th=[12518], 50.00th=[12780], 60.00th=[13173], 00:16:55.308 | 70.00th=[13435], 80.00th=[14091], 90.00th=[15664], 95.00th=[16450], 00:16:55.308 | 99.00th=[20055], 99.50th=[21103], 99.90th=[21103], 99.95th=[22152], 00:16:55.308 | 99.99th=[24511] 00:16:55.308 write: IOPS=4855, BW=19.0MiB/s (19.9MB/s)(19.0MiB/1002msec); 0 zone resets 00:16:55.308 slat (usec): min=3, max=13438, avg=98.18, stdev=651.44 00:16:55.308 clat (usec): min=1180, max=30306, avg=13758.51, stdev=2858.28 00:16:55.308 lat (usec): min=1200, max=30320, avg=13856.69, stdev=2897.89 00:16:55.308 clat percentiles (usec): 00:16:55.308 | 1.00th=[ 6325], 5.00th=[ 8717], 10.00th=[11338], 20.00th=[12649], 00:16:55.308 | 30.00th=[13042], 40.00th=[13173], 50.00th=[13304], 60.00th=[13566], 00:16:55.308 | 70.00th=[13960], 80.00th=[15139], 90.00th=[17433], 95.00th=[18744], 00:16:55.308 | 99.00th=[23462], 99.50th=[24511], 99.90th=[25560], 99.95th=[26084], 00:16:55.308 | 99.99th=[30278] 00:16:55.308 bw ( KiB/s): min=18480, max=18480, per=24.80%, avg=18480.00, stdev= 0.00, samples=1 00:16:55.308 iops : min= 4620, max= 4620, avg=4620.00, stdev= 0.00, samples=1 00:16:55.308 lat (msec) : 2=0.12%, 4=0.05%, 10=4.96%, 20=91.96%, 50=2.91% 00:16:55.308 cpu : usr=8.29%, sys=9.89%, ctx=319, majf=0, minf=1 00:16:55.308 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:55.308 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.308 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.308 issued rwts: total=4608,4865,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.308 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.308 00:16:55.308 Run status group 0 (all jobs): 00:16:55.308 READ: bw=69.3MiB/s (72.7MB/s), 13.9MiB/s-20.0MiB/s (14.5MB/s-20.9MB/s), io=70.0MiB (73.4MB), run=1002-1010msec 00:16:55.308 WRITE: bw=72.8MiB/s (76.3MB/s), 14.7MiB/s-21.0MiB/s (15.4MB/s-22.1MB/s), io=73.5MiB (77.1MB), run=1002-1010msec 00:16:55.308 00:16:55.308 Disk stats (read/write): 00:16:55.308 nvme0n1: ios=4141/4587, merge=0/0, ticks=28446/33015, in_queue=61461, util=98.50% 00:16:55.308 nvme0n2: ios=4247/4608, merge=0/0, ticks=19479/19676, in_queue=39155, util=98.48% 00:16:55.308 nvme0n3: ios=3118/3166, merge=0/0, ticks=23694/25689, in_queue=49383, util=97.92% 00:16:55.308 nvme0n4: ios=3815/4096, merge=0/0, ticks=28374/29736, in_queue=58110, util=98.22% 00:16:55.308 01:52:43 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:55.308 [global] 00:16:55.308 thread=1 00:16:55.308 invalidate=1 00:16:55.308 rw=randwrite 00:16:55.308 time_based=1 00:16:55.308 runtime=1 00:16:55.308 ioengine=libaio 00:16:55.308 direct=1 00:16:55.308 bs=4096 00:16:55.308 iodepth=128 00:16:55.308 norandommap=0 00:16:55.308 numjobs=1 00:16:55.308 00:16:55.308 verify_dump=1 00:16:55.308 verify_backlog=512 00:16:55.308 verify_state_save=0 00:16:55.308 do_verify=1 00:16:55.308 verify=crc32c-intel 00:16:55.308 [job0] 00:16:55.308 filename=/dev/nvme0n1 00:16:55.308 [job1] 00:16:55.308 filename=/dev/nvme0n2 00:16:55.308 [job2] 00:16:55.308 filename=/dev/nvme0n3 00:16:55.308 [job3] 00:16:55.308 filename=/dev/nvme0n4 00:16:55.308 Could not set queue depth (nvme0n1) 00:16:55.308 Could not set queue depth (nvme0n2) 00:16:55.308 Could not set queue depth (nvme0n3) 00:16:55.308 Could not set queue depth (nvme0n4) 00:16:55.308 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.308 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.308 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.308 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:55.308 fio-3.35 00:16:55.308 Starting 4 threads 00:16:56.683 00:16:56.683 job0: (groupid=0, jobs=1): err= 0: pid=3450949: Tue Nov 19 01:52:45 2024 00:16:56.683 read: IOPS=5741, BW=22.4MiB/s (23.5MB/s)(22.5MiB/1003msec) 00:16:56.683 slat (usec): min=2, max=5125, avg=80.06, stdev=500.74 00:16:56.683 clat (usec): min=648, max=20283, avg=10378.30, stdev=1491.91 00:16:56.683 lat (usec): min=2122, max=20291, avg=10458.36, stdev=1536.89 00:16:56.683 clat percentiles (usec): 00:16:56.683 | 1.00th=[ 6718], 5.00th=[ 7963], 10.00th=[ 8979], 20.00th=[ 9634], 00:16:56.683 | 30.00th=[ 9896], 40.00th=[10159], 50.00th=[10290], 60.00th=[10552], 00:16:56.683 | 70.00th=[10814], 80.00th=[11076], 90.00th=[11731], 95.00th=[12387], 00:16:56.683 | 99.00th=[14746], 99.50th=[16319], 99.90th=[20317], 99.95th=[20317], 00:16:56.683 | 99.99th=[20317] 00:16:56.683 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:16:56.683 slat (usec): min=3, max=9474, avg=77.55, stdev=473.30 00:16:56.683 clat (usec): min=4909, max=21383, avg=10981.89, stdev=1629.77 00:16:56.683 lat (usec): min=4933, max=21405, avg=11059.45, stdev=1665.19 00:16:56.683 clat percentiles (usec): 00:16:56.683 | 1.00th=[ 6587], 5.00th=[ 8356], 10.00th=[ 9896], 20.00th=[10290], 00:16:56.683 | 30.00th=[10552], 40.00th=[10683], 50.00th=[10814], 60.00th=[10945], 00:16:56.683 | 70.00th=[11207], 80.00th=[11600], 90.00th=[12387], 95.00th=[13960], 00:16:56.683 | 99.00th=[17171], 99.50th=[18220], 99.90th=[18220], 99.95th=[19006], 00:16:56.683 | 99.99th=[21365] 00:16:56.683 bw ( KiB/s): min=24568, max=24576, per=34.86%, avg=24572.00, stdev= 5.66, samples=2 00:16:56.683 iops : min= 6142, max= 6144, avg=6143.00, stdev= 1.41, samples=2 00:16:56.683 lat (usec) : 750=0.01% 00:16:56.683 lat (msec) : 4=0.12%, 10=22.46%, 20=77.19%, 50=0.23% 00:16:56.683 cpu : usr=7.39%, sys=10.28%, ctx=431, majf=0, minf=1 00:16:56.683 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:56.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.683 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.683 issued rwts: total=5759,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.683 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.683 job1: (groupid=0, jobs=1): err= 0: pid=3450950: Tue Nov 19 01:52:45 2024 00:16:56.683 read: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec) 00:16:56.683 slat (usec): min=2, max=10604, avg=96.92, stdev=715.07 00:16:56.683 clat (usec): min=4505, max=32298, avg=12578.88, stdev=3647.59 00:16:56.683 lat (usec): min=4519, max=32311, avg=12675.80, stdev=3707.58 00:16:56.683 clat percentiles (usec): 00:16:56.683 | 1.00th=[ 6915], 5.00th=[ 8979], 10.00th=[ 9765], 20.00th=[10421], 00:16:56.683 | 30.00th=[10683], 40.00th=[10945], 50.00th=[11207], 60.00th=[12125], 00:16:56.683 | 70.00th=[13829], 80.00th=[15139], 90.00th=[15533], 95.00th=[17957], 00:16:56.683 | 99.00th=[28181], 99.50th=[30802], 99.90th=[31851], 99.95th=[31851], 00:16:56.683 | 99.99th=[32375] 00:16:56.683 write: IOPS=4516, BW=17.6MiB/s (18.5MB/s)(17.8MiB/1009msec); 0 zone resets 00:16:56.683 slat (usec): min=3, max=12923, avg=109.88, stdev=694.52 00:16:56.683 clat (usec): min=219, max=63552, avg=16714.87, stdev=12242.20 00:16:56.683 lat (usec): min=652, max=63558, avg=16824.75, stdev=12334.30 00:16:56.683 clat percentiles (usec): 00:16:56.683 | 1.00th=[ 1074], 5.00th=[ 3490], 10.00th=[ 5932], 20.00th=[ 8455], 00:16:56.683 | 30.00th=[10159], 40.00th=[10552], 50.00th=[10945], 60.00th=[12256], 00:16:56.683 | 70.00th=[19268], 80.00th=[26870], 90.00th=[36963], 95.00th=[42730], 00:16:56.683 | 99.00th=[52167], 99.50th=[55313], 99.90th=[63701], 99.95th=[63701], 00:16:56.683 | 99.99th=[63701] 00:16:56.683 bw ( KiB/s): min=16384, max=19056, per=25.14%, avg=17720.00, stdev=1889.39, samples=2 00:16:56.683 iops : min= 4096, max= 4764, avg=4430.00, stdev=472.35, samples=2 00:16:56.683 lat (usec) : 250=0.01%, 750=0.13%, 1000=0.06% 00:16:56.683 lat (msec) : 2=1.10%, 4=1.98%, 10=16.68%, 20=62.73%, 50=16.29% 00:16:56.683 lat (msec) : 100=1.03% 00:16:56.683 cpu : usr=3.37%, sys=5.65%, ctx=343, majf=0, minf=1 00:16:56.683 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:56.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.683 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.683 issued rwts: total=4096,4557,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.683 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.683 job2: (groupid=0, jobs=1): err= 0: pid=3450951: Tue Nov 19 01:52:45 2024 00:16:56.683 read: IOPS=2632, BW=10.3MiB/s (10.8MB/s)(10.3MiB/1004msec) 00:16:56.683 slat (usec): min=3, max=14524, avg=159.44, stdev=931.43 00:16:56.683 clat (usec): min=3121, max=77429, avg=16232.82, stdev=8244.69 00:16:56.683 lat (usec): min=3640, max=77448, avg=16392.26, stdev=8415.58 00:16:56.683 clat percentiles (usec): 00:16:56.683 | 1.00th=[ 6390], 5.00th=[11469], 10.00th=[12649], 20.00th=[12911], 00:16:56.683 | 30.00th=[13960], 40.00th=[14353], 50.00th=[14746], 60.00th=[15139], 00:16:56.684 | 70.00th=[15401], 80.00th=[17171], 90.00th=[18482], 95.00th=[22414], 00:16:56.684 | 99.00th=[65274], 99.50th=[70779], 99.90th=[77071], 99.95th=[77071], 00:16:56.684 | 99.99th=[77071] 00:16:56.684 write: IOPS=3059, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1004msec); 0 zone resets 00:16:56.684 slat (usec): min=4, max=25149, avg=177.93, stdev=1052.43 00:16:56.684 clat (msec): min=7, max=115, avg=27.34, stdev=22.10 00:16:56.684 lat (msec): min=7, max=115, avg=27.52, stdev=22.21 00:16:56.684 clat percentiles (msec): 00:16:56.684 | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 14], 00:16:56.684 | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], 00:16:56.684 | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 57], 95.00th=[ 79], 00:16:56.684 | 99.00th=[ 108], 99.50th=[ 113], 99.90th=[ 116], 99.95th=[ 116], 00:16:56.684 | 99.99th=[ 116] 00:16:56.684 bw ( KiB/s): min=11768, max=12456, per=17.18%, avg=12112.00, stdev=486.49, samples=2 00:16:56.684 iops : min= 2942, max= 3114, avg=3028.00, stdev=121.62, samples=2 00:16:56.684 lat (msec) : 4=0.35%, 10=1.66%, 20=70.20%, 50=20.37%, 100=6.09% 00:16:56.684 lat (msec) : 250=1.33% 00:16:56.684 cpu : usr=3.69%, sys=6.88%, ctx=359, majf=0, minf=1 00:16:56.684 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:16:56.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.684 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.684 issued rwts: total=2643,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.684 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.684 job3: (groupid=0, jobs=1): err= 0: pid=3450952: Tue Nov 19 01:52:45 2024 00:16:56.684 read: IOPS=4089, BW=16.0MiB/s (16.7MB/s)(16.7MiB/1043msec) 00:16:56.684 slat (usec): min=3, max=14412, avg=113.46, stdev=560.66 00:16:56.684 clat (usec): min=9946, max=63422, avg=15838.05, stdev=7870.14 00:16:56.684 lat (usec): min=10348, max=67581, avg=15951.51, stdev=7882.68 00:16:56.684 clat percentiles (usec): 00:16:56.684 | 1.00th=[10814], 5.00th=[11338], 10.00th=[11863], 20.00th=[12911], 00:16:56.684 | 30.00th=[13173], 40.00th=[13435], 50.00th=[13698], 60.00th=[14091], 00:16:56.684 | 70.00th=[14353], 80.00th=[14877], 90.00th=[21627], 95.00th=[32637], 00:16:56.684 | 99.00th=[54264], 99.50th=[63177], 99.90th=[63177], 99.95th=[63177], 00:16:56.684 | 99.99th=[63177] 00:16:56.684 write: IOPS=4418, BW=17.3MiB/s (18.1MB/s)(18.0MiB/1043msec); 0 zone resets 00:16:56.684 slat (usec): min=3, max=5247, avg=101.79, stdev=450.79 00:16:56.684 clat (usec): min=9854, max=25403, avg=13897.38, stdev=1597.79 00:16:56.684 lat (usec): min=9921, max=25411, avg=13999.18, stdev=1556.55 00:16:56.684 clat percentiles (usec): 00:16:56.684 | 1.00th=[10552], 5.00th=[11600], 10.00th=[12518], 20.00th=[13042], 00:16:56.684 | 30.00th=[13173], 40.00th=[13435], 50.00th=[13698], 60.00th=[13829], 00:16:56.684 | 70.00th=[14222], 80.00th=[14877], 90.00th=[15795], 95.00th=[16319], 00:16:56.684 | 99.00th=[21627], 99.50th=[22414], 99.90th=[23200], 99.95th=[23200], 00:16:56.684 | 99.99th=[25297] 00:16:56.684 bw ( KiB/s): min=17712, max=19152, per=26.15%, avg=18432.00, stdev=1018.23, samples=2 00:16:56.684 iops : min= 4428, max= 4788, avg=4608.00, stdev=254.56, samples=2 00:16:56.684 lat (msec) : 10=0.14%, 20=93.62%, 50=5.30%, 100=0.95% 00:16:56.684 cpu : usr=5.28%, sys=8.93%, ctx=541, majf=0, minf=1 00:16:56.684 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:56.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.684 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.684 issued rwts: total=4265,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.684 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.684 00:16:56.684 Run status group 0 (all jobs): 00:16:56.684 READ: bw=62.8MiB/s (65.8MB/s), 10.3MiB/s-22.4MiB/s (10.8MB/s-23.5MB/s), io=65.5MiB (68.7MB), run=1003-1043msec 00:16:56.684 WRITE: bw=68.8MiB/s (72.2MB/s), 12.0MiB/s-23.9MiB/s (12.5MB/s-25.1MB/s), io=71.8MiB (75.3MB), run=1003-1043msec 00:16:56.684 00:16:56.684 Disk stats (read/write): 00:16:56.684 nvme0n1: ios=5019/5120, merge=0/0, ticks=24751/26728, in_queue=51479, util=88.38% 00:16:56.684 nvme0n2: ios=3634/4096, merge=0/0, ticks=44374/58232, in_queue=102606, util=97.46% 00:16:56.684 nvme0n3: ios=2090/2527, merge=0/0, ticks=17514/33359, in_queue=50873, util=97.39% 00:16:56.684 nvme0n4: ios=3584/3952, merge=0/0, ticks=12849/12822, in_queue=25671, util=89.67% 00:16:56.684 01:52:45 -- target/fio.sh@55 -- # sync 00:16:56.684 01:52:45 -- target/fio.sh@59 -- # fio_pid=3451094 00:16:56.684 01:52:45 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:56.684 01:52:45 -- target/fio.sh@61 -- # sleep 3 00:16:56.684 [global] 00:16:56.684 thread=1 00:16:56.684 invalidate=1 00:16:56.684 rw=read 00:16:56.684 time_based=1 00:16:56.684 runtime=10 00:16:56.684 ioengine=libaio 00:16:56.684 direct=1 00:16:56.684 bs=4096 00:16:56.684 iodepth=1 00:16:56.684 norandommap=1 00:16:56.684 numjobs=1 00:16:56.684 00:16:56.684 [job0] 00:16:56.684 filename=/dev/nvme0n1 00:16:56.684 [job1] 00:16:56.684 filename=/dev/nvme0n2 00:16:56.684 [job2] 00:16:56.684 filename=/dev/nvme0n3 00:16:56.684 [job3] 00:16:56.684 filename=/dev/nvme0n4 00:16:56.684 Could not set queue depth (nvme0n1) 00:16:56.684 Could not set queue depth (nvme0n2) 00:16:56.684 Could not set queue depth (nvme0n3) 00:16:56.684 Could not set queue depth (nvme0n4) 00:16:56.941 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.941 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.941 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.941 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:56.941 fio-3.35 00:16:56.941 Starting 4 threads 00:17:00.230 01:52:48 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:17:00.230 01:52:48 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:17:00.230 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=36454400, buflen=4096 00:17:00.230 fio: pid=3451189, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.230 01:52:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.230 01:52:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:17:00.230 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=319488, buflen=4096 00:17:00.230 fio: pid=3451188, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.488 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=11247616, buflen=4096 00:17:00.488 fio: pid=3451186, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.488 01:52:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.488 01:52:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:17:00.746 01:52:49 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.746 01:52:49 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:17:00.746 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=24670208, buflen=4096 00:17:00.746 fio: pid=3451187, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:00.746 00:17:00.746 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3451186: Tue Nov 19 01:52:49 2024 00:17:00.746 read: IOPS=799, BW=3196KiB/s (3273kB/s)(10.7MiB/3437msec) 00:17:00.746 slat (usec): min=4, max=23949, avg=18.93, stdev=456.77 00:17:00.746 clat (usec): min=163, max=42148, avg=1221.66, stdev=6408.58 00:17:00.746 lat (usec): min=169, max=65109, avg=1240.59, stdev=6479.93 00:17:00.746 clat percentiles (usec): 00:17:00.746 | 1.00th=[ 169], 5.00th=[ 178], 10.00th=[ 182], 20.00th=[ 186], 00:17:00.746 | 30.00th=[ 190], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 202], 00:17:00.746 | 70.00th=[ 206], 80.00th=[ 212], 90.00th=[ 262], 95.00th=[ 379], 00:17:00.746 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:00.746 | 99.99th=[42206] 00:17:00.746 bw ( KiB/s): min= 96, max= 8576, per=19.15%, avg=3648.00, stdev=4007.40, samples=6 00:17:00.746 iops : min= 24, max= 2144, avg=912.00, stdev=1001.85, samples=6 00:17:00.746 lat (usec) : 250=89.41%, 500=8.12% 00:17:00.746 lat (msec) : 50=2.44% 00:17:00.746 cpu : usr=0.49%, sys=0.79%, ctx=2750, majf=0, minf=2 00:17:00.746 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.746 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.746 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.746 issued rwts: total=2747,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.747 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.747 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3451187: Tue Nov 19 01:52:49 2024 00:17:00.747 read: IOPS=1616, BW=6464KiB/s (6619kB/s)(23.5MiB/3727msec) 00:17:00.747 slat (usec): min=5, max=8866, avg=13.54, stdev=152.50 00:17:00.747 clat (usec): min=169, max=42049, avg=598.28, stdev=3899.39 00:17:00.747 lat (usec): min=174, max=49930, avg=611.81, stdev=3931.68 00:17:00.747 clat percentiles (usec): 00:17:00.747 | 1.00th=[ 178], 5.00th=[ 186], 10.00th=[ 192], 20.00th=[ 200], 00:17:00.747 | 30.00th=[ 208], 40.00th=[ 223], 50.00th=[ 233], 60.00th=[ 239], 00:17:00.747 | 70.00th=[ 245], 80.00th=[ 249], 90.00th=[ 258], 95.00th=[ 265], 00:17:00.747 | 99.00th=[ 766], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:17:00.747 | 99.99th=[42206] 00:17:00.747 bw ( KiB/s): min= 96, max=16800, per=35.16%, avg=6697.57, stdev=7204.64, samples=7 00:17:00.747 iops : min= 24, max= 4200, avg=1674.29, stdev=1801.17, samples=7 00:17:00.747 lat (usec) : 250=81.03%, 500=17.88%, 750=0.07%, 1000=0.07% 00:17:00.747 lat (msec) : 2=0.03%, 4=0.02%, 50=0.90% 00:17:00.747 cpu : usr=1.23%, sys=2.76%, ctx=6026, majf=0, minf=2 00:17:00.747 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.747 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.747 issued rwts: total=6024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.747 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.747 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3451188: Tue Nov 19 01:52:49 2024 00:17:00.747 read: IOPS=24, BW=97.7KiB/s (100kB/s)(312KiB/3193msec) 00:17:00.747 slat (nsec): min=13042, max=39768, avg=20326.06, stdev=7635.14 00:17:00.747 clat (usec): min=236, max=42046, avg=40563.98, stdev=6585.57 00:17:00.747 lat (usec): min=271, max=42067, avg=40584.40, stdev=6584.93 00:17:00.747 clat percentiles (usec): 00:17:00.747 | 1.00th=[ 237], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:17:00.747 | 30.00th=[41157], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:17:00.747 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:17:00.747 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:00.747 | 99.99th=[42206] 00:17:00.747 bw ( KiB/s): min= 88, max= 112, per=0.51%, avg=97.33, stdev= 7.87, samples=6 00:17:00.747 iops : min= 22, max= 28, avg=24.33, stdev= 1.97, samples=6 00:17:00.747 lat (usec) : 250=1.27%, 500=1.27% 00:17:00.747 lat (msec) : 50=96.20% 00:17:00.747 cpu : usr=0.06%, sys=0.00%, ctx=80, majf=0, minf=1 00:17:00.747 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.747 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.747 issued rwts: total=79,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.747 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.747 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3451189: Tue Nov 19 01:52:49 2024 00:17:00.747 read: IOPS=3030, BW=11.8MiB/s (12.4MB/s)(34.8MiB/2937msec) 00:17:00.747 slat (nsec): min=5058, max=63895, avg=11221.22, stdev=5406.62 00:17:00.747 clat (usec): min=175, max=42117, avg=313.04, stdev=1791.13 00:17:00.747 lat (usec): min=181, max=42133, avg=324.26, stdev=1791.23 00:17:00.747 clat percentiles (usec): 00:17:00.747 | 1.00th=[ 190], 5.00th=[ 198], 10.00th=[ 204], 20.00th=[ 212], 00:17:00.747 | 30.00th=[ 221], 40.00th=[ 227], 50.00th=[ 235], 60.00th=[ 241], 00:17:00.747 | 70.00th=[ 247], 80.00th=[ 255], 90.00th=[ 265], 95.00th=[ 273], 00:17:00.747 | 99.00th=[ 297], 99.50th=[ 408], 99.90th=[41157], 99.95th=[41157], 00:17:00.747 | 99.99th=[42206] 00:17:00.747 bw ( KiB/s): min= 8048, max=16928, per=69.21%, avg=13182.40, stdev=4492.51, samples=5 00:17:00.747 iops : min= 2012, max= 4232, avg=3295.60, stdev=1123.13, samples=5 00:17:00.747 lat (usec) : 250=74.54%, 500=25.14%, 750=0.10% 00:17:00.747 lat (msec) : 4=0.01%, 50=0.19% 00:17:00.747 cpu : usr=2.18%, sys=5.48%, ctx=8903, majf=0, minf=1 00:17:00.747 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:00.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.747 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:00.747 issued rwts: total=8901,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:00.747 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:00.747 00:17:00.747 Run status group 0 (all jobs): 00:17:00.747 READ: bw=18.6MiB/s (19.5MB/s), 97.7KiB/s-11.8MiB/s (100kB/s-12.4MB/s), io=69.3MiB (72.7MB), run=2937-3727msec 00:17:00.747 00:17:00.747 Disk stats (read/write): 00:17:00.747 nvme0n1: ios=2782/0, merge=0/0, ticks=3421/0, in_queue=3421, util=98.83% 00:17:00.747 nvme0n2: ios=6020/0, merge=0/0, ticks=3422/0, in_queue=3422, util=96.38% 00:17:00.747 nvme0n3: ios=76/0, merge=0/0, ticks=3082/0, in_queue=3082, util=96.79% 00:17:00.747 nvme0n4: ios=8898/0, merge=0/0, ticks=2619/0, in_queue=2619, util=96.75% 00:17:01.005 01:52:49 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.005 01:52:49 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:01.263 01:52:49 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.263 01:52:49 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:01.521 01:52:49 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.521 01:52:49 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:01.779 01:52:50 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.779 01:52:50 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:02.038 01:52:50 -- target/fio.sh@69 -- # fio_status=0 00:17:02.038 01:52:50 -- target/fio.sh@70 -- # wait 3451094 00:17:02.038 01:52:50 -- target/fio.sh@70 -- # fio_status=4 00:17:02.038 01:52:50 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:02.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:02.038 01:52:50 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:02.038 01:52:50 -- common/autotest_common.sh@1208 -- # local i=0 00:17:02.038 01:52:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:17:02.296 01:52:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:02.296 01:52:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:17:02.296 01:52:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:02.296 01:52:50 -- common/autotest_common.sh@1220 -- # return 0 00:17:02.296 01:52:50 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:02.296 01:52:50 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:02.296 nvmf hotplug test: fio failed as expected 00:17:02.296 01:52:50 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:02.554 01:52:50 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:02.554 01:52:50 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:02.554 01:52:50 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:02.554 01:52:50 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:02.554 01:52:50 -- target/fio.sh@91 -- # nvmftestfini 00:17:02.554 01:52:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:02.554 01:52:50 -- nvmf/common.sh@116 -- # sync 00:17:02.554 01:52:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:02.554 01:52:50 -- nvmf/common.sh@119 -- # set +e 00:17:02.554 01:52:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:02.554 01:52:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:02.554 rmmod nvme_tcp 00:17:02.554 rmmod nvme_fabrics 00:17:02.554 rmmod nvme_keyring 00:17:02.554 01:52:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:02.554 01:52:50 -- nvmf/common.sh@123 -- # set -e 00:17:02.554 01:52:50 -- nvmf/common.sh@124 -- # return 0 00:17:02.554 01:52:50 -- nvmf/common.sh@477 -- # '[' -n 3448901 ']' 00:17:02.554 01:52:50 -- nvmf/common.sh@478 -- # killprocess 3448901 00:17:02.554 01:52:50 -- common/autotest_common.sh@936 -- # '[' -z 3448901 ']' 00:17:02.554 01:52:50 -- common/autotest_common.sh@940 -- # kill -0 3448901 00:17:02.554 01:52:50 -- common/autotest_common.sh@941 -- # uname 00:17:02.554 01:52:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:02.554 01:52:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3448901 00:17:02.554 01:52:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:02.554 01:52:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:02.554 01:52:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3448901' 00:17:02.554 killing process with pid 3448901 00:17:02.554 01:52:50 -- common/autotest_common.sh@955 -- # kill 3448901 00:17:02.554 01:52:50 -- common/autotest_common.sh@960 -- # wait 3448901 00:17:02.813 01:52:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:02.813 01:52:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:02.813 01:52:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:02.813 01:52:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:02.813 01:52:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:02.813 01:52:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.813 01:52:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.813 01:52:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:05.348 01:52:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:05.348 00:17:05.348 real 0m24.350s 00:17:05.348 user 1m26.373s 00:17:05.348 sys 0m6.605s 00:17:05.348 01:52:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:05.348 01:52:53 -- common/autotest_common.sh@10 -- # set +x 00:17:05.348 ************************************ 00:17:05.348 END TEST nvmf_fio_target 00:17:05.348 ************************************ 00:17:05.348 01:52:53 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:05.348 01:52:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:05.348 01:52:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:05.348 01:52:53 -- common/autotest_common.sh@10 -- # set +x 00:17:05.348 ************************************ 00:17:05.348 START TEST nvmf_bdevio 00:17:05.348 ************************************ 00:17:05.348 01:52:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:05.348 * Looking for test storage... 00:17:05.348 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:05.348 01:52:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:05.348 01:52:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:05.348 01:52:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:05.348 01:52:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:05.348 01:52:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:05.348 01:52:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:05.348 01:52:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:05.348 01:52:53 -- scripts/common.sh@335 -- # IFS=.-: 00:17:05.348 01:52:53 -- scripts/common.sh@335 -- # read -ra ver1 00:17:05.348 01:52:53 -- scripts/common.sh@336 -- # IFS=.-: 00:17:05.348 01:52:53 -- scripts/common.sh@336 -- # read -ra ver2 00:17:05.348 01:52:53 -- scripts/common.sh@337 -- # local 'op=<' 00:17:05.348 01:52:53 -- scripts/common.sh@339 -- # ver1_l=2 00:17:05.348 01:52:53 -- scripts/common.sh@340 -- # ver2_l=1 00:17:05.348 01:52:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:05.348 01:52:53 -- scripts/common.sh@343 -- # case "$op" in 00:17:05.348 01:52:53 -- scripts/common.sh@344 -- # : 1 00:17:05.348 01:52:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:05.348 01:52:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:05.348 01:52:53 -- scripts/common.sh@364 -- # decimal 1 00:17:05.348 01:52:53 -- scripts/common.sh@352 -- # local d=1 00:17:05.348 01:52:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:05.348 01:52:53 -- scripts/common.sh@354 -- # echo 1 00:17:05.348 01:52:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:05.348 01:52:53 -- scripts/common.sh@365 -- # decimal 2 00:17:05.348 01:52:53 -- scripts/common.sh@352 -- # local d=2 00:17:05.348 01:52:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:05.348 01:52:53 -- scripts/common.sh@354 -- # echo 2 00:17:05.348 01:52:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:05.348 01:52:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:05.348 01:52:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:05.348 01:52:53 -- scripts/common.sh@367 -- # return 0 00:17:05.348 01:52:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:05.348 01:52:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:05.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.348 --rc genhtml_branch_coverage=1 00:17:05.348 --rc genhtml_function_coverage=1 00:17:05.348 --rc genhtml_legend=1 00:17:05.348 --rc geninfo_all_blocks=1 00:17:05.348 --rc geninfo_unexecuted_blocks=1 00:17:05.348 00:17:05.348 ' 00:17:05.348 01:52:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:05.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.348 --rc genhtml_branch_coverage=1 00:17:05.348 --rc genhtml_function_coverage=1 00:17:05.348 --rc genhtml_legend=1 00:17:05.348 --rc geninfo_all_blocks=1 00:17:05.348 --rc geninfo_unexecuted_blocks=1 00:17:05.348 00:17:05.348 ' 00:17:05.348 01:52:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:05.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.348 --rc genhtml_branch_coverage=1 00:17:05.348 --rc genhtml_function_coverage=1 00:17:05.348 --rc genhtml_legend=1 00:17:05.348 --rc geninfo_all_blocks=1 00:17:05.348 --rc geninfo_unexecuted_blocks=1 00:17:05.348 00:17:05.348 ' 00:17:05.348 01:52:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:05.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.348 --rc genhtml_branch_coverage=1 00:17:05.348 --rc genhtml_function_coverage=1 00:17:05.348 --rc genhtml_legend=1 00:17:05.348 --rc geninfo_all_blocks=1 00:17:05.348 --rc geninfo_unexecuted_blocks=1 00:17:05.348 00:17:05.348 ' 00:17:05.348 01:52:53 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:05.348 01:52:53 -- nvmf/common.sh@7 -- # uname -s 00:17:05.348 01:52:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:05.348 01:52:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:05.348 01:52:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:05.348 01:52:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:05.348 01:52:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:05.348 01:52:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:05.348 01:52:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:05.348 01:52:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:05.348 01:52:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:05.348 01:52:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:05.348 01:52:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.348 01:52:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.348 01:52:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:05.348 01:52:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:05.348 01:52:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:05.348 01:52:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:05.348 01:52:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:05.348 01:52:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:05.348 01:52:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:05.348 01:52:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.348 01:52:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.348 01:52:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.348 01:52:53 -- paths/export.sh@5 -- # export PATH 00:17:05.348 01:52:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.348 01:52:53 -- nvmf/common.sh@46 -- # : 0 00:17:05.348 01:52:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:05.348 01:52:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:05.348 01:52:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:05.348 01:52:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:05.348 01:52:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:05.349 01:52:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:05.349 01:52:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:05.349 01:52:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:05.349 01:52:53 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:05.349 01:52:53 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:05.349 01:52:53 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:05.349 01:52:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:05.349 01:52:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:05.349 01:52:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:05.349 01:52:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:05.349 01:52:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:05.349 01:52:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:05.349 01:52:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:05.349 01:52:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:05.349 01:52:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:05.349 01:52:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:05.349 01:52:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:05.349 01:52:53 -- common/autotest_common.sh@10 -- # set +x 00:17:07.253 01:52:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:07.253 01:52:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:07.253 01:52:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:07.253 01:52:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:07.253 01:52:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:07.253 01:52:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:07.253 01:52:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:07.253 01:52:55 -- nvmf/common.sh@294 -- # net_devs=() 00:17:07.253 01:52:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:07.253 01:52:55 -- nvmf/common.sh@295 -- # e810=() 00:17:07.253 01:52:55 -- nvmf/common.sh@295 -- # local -ga e810 00:17:07.253 01:52:55 -- nvmf/common.sh@296 -- # x722=() 00:17:07.253 01:52:55 -- nvmf/common.sh@296 -- # local -ga x722 00:17:07.253 01:52:55 -- nvmf/common.sh@297 -- # mlx=() 00:17:07.253 01:52:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:07.253 01:52:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:07.253 01:52:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:07.253 01:52:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:07.253 01:52:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:07.253 01:52:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:07.253 01:52:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:07.253 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:07.253 01:52:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:07.253 01:52:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:07.253 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:07.253 01:52:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:07.253 01:52:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:07.253 01:52:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.253 01:52:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:07.253 01:52:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.253 01:52:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:07.253 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:07.253 01:52:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.253 01:52:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:07.253 01:52:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.253 01:52:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:07.253 01:52:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.253 01:52:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:07.253 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:07.253 01:52:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.253 01:52:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:07.253 01:52:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:07.253 01:52:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:07.253 01:52:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:07.253 01:52:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:07.253 01:52:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:07.253 01:52:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:07.253 01:52:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:07.253 01:52:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:07.253 01:52:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:07.253 01:52:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:07.253 01:52:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:07.253 01:52:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:07.253 01:52:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:07.253 01:52:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:07.253 01:52:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:07.253 01:52:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:07.253 01:52:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:07.253 01:52:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:07.253 01:52:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:07.253 01:52:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:07.253 01:52:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:07.253 01:52:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:07.253 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:07.253 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:17:07.253 00:17:07.253 --- 10.0.0.2 ping statistics --- 00:17:07.253 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.253 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:17:07.253 01:52:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:07.253 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:07.253 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:17:07.253 00:17:07.253 --- 10.0.0.1 ping statistics --- 00:17:07.253 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.253 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:17:07.253 01:52:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:07.253 01:52:55 -- nvmf/common.sh@410 -- # return 0 00:17:07.253 01:52:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:07.253 01:52:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:07.253 01:52:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:07.253 01:52:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:07.253 01:52:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:07.253 01:52:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:07.253 01:52:55 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:07.253 01:52:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:07.253 01:52:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:07.253 01:52:55 -- common/autotest_common.sh@10 -- # set +x 00:17:07.253 01:52:55 -- nvmf/common.sh@469 -- # nvmfpid=3453843 00:17:07.253 01:52:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:07.254 01:52:55 -- nvmf/common.sh@470 -- # waitforlisten 3453843 00:17:07.254 01:52:55 -- common/autotest_common.sh@829 -- # '[' -z 3453843 ']' 00:17:07.254 01:52:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:07.254 01:52:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:07.254 01:52:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:07.254 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:07.254 01:52:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:07.254 01:52:55 -- common/autotest_common.sh@10 -- # set +x 00:17:07.254 [2024-11-19 01:52:55.798335] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:07.254 [2024-11-19 01:52:55.798413] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:07.512 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.512 [2024-11-19 01:52:55.866308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:07.512 [2024-11-19 01:52:55.981230] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:07.512 [2024-11-19 01:52:55.981367] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:07.512 [2024-11-19 01:52:55.981384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:07.512 [2024-11-19 01:52:55.981397] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:07.512 [2024-11-19 01:52:55.981487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:07.512 [2024-11-19 01:52:55.981555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:07.512 [2024-11-19 01:52:55.981609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:07.512 [2024-11-19 01:52:55.981612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:08.446 01:52:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:08.446 01:52:56 -- common/autotest_common.sh@862 -- # return 0 00:17:08.446 01:52:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:08.446 01:52:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:08.446 01:52:56 -- common/autotest_common.sh@10 -- # set +x 00:17:08.446 01:52:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.446 01:52:56 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:08.446 01:52:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.446 01:52:56 -- common/autotest_common.sh@10 -- # set +x 00:17:08.446 [2024-11-19 01:52:56.861370] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:08.446 01:52:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.446 01:52:56 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:08.446 01:52:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.446 01:52:56 -- common/autotest_common.sh@10 -- # set +x 00:17:08.446 Malloc0 00:17:08.446 01:52:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.446 01:52:56 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:08.446 01:52:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.446 01:52:56 -- common/autotest_common.sh@10 -- # set +x 00:17:08.446 01:52:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.446 01:52:56 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:08.446 01:52:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.446 01:52:56 -- common/autotest_common.sh@10 -- # set +x 00:17:08.446 01:52:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.446 01:52:56 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:08.446 01:52:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.446 01:52:56 -- common/autotest_common.sh@10 -- # set +x 00:17:08.446 [2024-11-19 01:52:56.915203] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:08.446 01:52:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.446 01:52:56 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:08.446 01:52:56 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:08.446 01:52:56 -- nvmf/common.sh@520 -- # config=() 00:17:08.446 01:52:56 -- nvmf/common.sh@520 -- # local subsystem config 00:17:08.446 01:52:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:08.446 01:52:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:08.446 { 00:17:08.446 "params": { 00:17:08.446 "name": "Nvme$subsystem", 00:17:08.446 "trtype": "$TEST_TRANSPORT", 00:17:08.446 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:08.446 "adrfam": "ipv4", 00:17:08.446 "trsvcid": "$NVMF_PORT", 00:17:08.446 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:08.446 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:08.446 "hdgst": ${hdgst:-false}, 00:17:08.446 "ddgst": ${ddgst:-false} 00:17:08.446 }, 00:17:08.446 "method": "bdev_nvme_attach_controller" 00:17:08.446 } 00:17:08.446 EOF 00:17:08.446 )") 00:17:08.446 01:52:56 -- nvmf/common.sh@542 -- # cat 00:17:08.446 01:52:56 -- nvmf/common.sh@544 -- # jq . 00:17:08.446 01:52:56 -- nvmf/common.sh@545 -- # IFS=, 00:17:08.446 01:52:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:08.446 "params": { 00:17:08.446 "name": "Nvme1", 00:17:08.446 "trtype": "tcp", 00:17:08.446 "traddr": "10.0.0.2", 00:17:08.446 "adrfam": "ipv4", 00:17:08.446 "trsvcid": "4420", 00:17:08.446 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:08.446 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:08.446 "hdgst": false, 00:17:08.446 "ddgst": false 00:17:08.446 }, 00:17:08.446 "method": "bdev_nvme_attach_controller" 00:17:08.446 }' 00:17:08.446 [2024-11-19 01:52:56.959502] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:08.446 [2024-11-19 01:52:56.959567] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3454004 ] 00:17:08.446 EAL: No free 2048 kB hugepages reported on node 1 00:17:08.704 [2024-11-19 01:52:57.020863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:08.704 [2024-11-19 01:52:57.132059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:08.704 [2024-11-19 01:52:57.132114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:08.704 [2024-11-19 01:52:57.132117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:08.961 [2024-11-19 01:52:57.468678] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:08.962 [2024-11-19 01:52:57.468725] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:08.962 I/O targets: 00:17:08.962 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:08.962 00:17:08.962 00:17:08.962 CUnit - A unit testing framework for C - Version 2.1-3 00:17:08.962 http://cunit.sourceforge.net/ 00:17:08.962 00:17:08.962 00:17:08.962 Suite: bdevio tests on: Nvme1n1 00:17:09.220 Test: blockdev write read block ...passed 00:17:09.220 Test: blockdev write zeroes read block ...passed 00:17:09.220 Test: blockdev write zeroes read no split ...passed 00:17:09.220 Test: blockdev write zeroes read split ...passed 00:17:09.220 Test: blockdev write zeroes read split partial ...passed 00:17:09.220 Test: blockdev reset ...[2024-11-19 01:52:57.580541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:09.220 [2024-11-19 01:52:57.580654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19a8f20 (9): Bad file descriptor 00:17:09.220 [2024-11-19 01:52:57.637338] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:09.220 passed 00:17:09.220 Test: blockdev write read 8 blocks ...passed 00:17:09.220 Test: blockdev write read size > 128k ...passed 00:17:09.220 Test: blockdev write read invalid size ...passed 00:17:09.220 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:09.220 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:09.220 Test: blockdev write read max offset ...passed 00:17:09.477 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:09.477 Test: blockdev writev readv 8 blocks ...passed 00:17:09.477 Test: blockdev writev readv 30 x 1block ...passed 00:17:09.477 Test: blockdev writev readv block ...passed 00:17:09.477 Test: blockdev writev readv size > 128k ...passed 00:17:09.477 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:09.477 Test: blockdev comparev and writev ...[2024-11-19 01:52:57.888942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.477 [2024-11-19 01:52:57.888979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:09.477 [2024-11-19 01:52:57.889004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.477 [2024-11-19 01:52:57.889022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:09.477 [2024-11-19 01:52:57.889315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.477 [2024-11-19 01:52:57.889340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:09.477 [2024-11-19 01:52:57.889371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.477 [2024-11-19 01:52:57.889389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:09.477 [2024-11-19 01:52:57.889713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.477 [2024-11-19 01:52:57.889737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:09.477 [2024-11-19 01:52:57.889759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.477 [2024-11-19 01:52:57.889776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:09.478 [2024-11-19 01:52:57.890073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.478 [2024-11-19 01:52:57.890097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:09.478 [2024-11-19 01:52:57.890120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.478 [2024-11-19 01:52:57.890137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:09.478 passed 00:17:09.478 Test: blockdev nvme passthru rw ...passed 00:17:09.478 Test: blockdev nvme passthru vendor specific ...[2024-11-19 01:52:57.971895] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.478 [2024-11-19 01:52:57.971923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:09.478 [2024-11-19 01:52:57.972073] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.478 [2024-11-19 01:52:57.972096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:09.478 [2024-11-19 01:52:57.972244] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.478 [2024-11-19 01:52:57.972267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:09.478 [2024-11-19 01:52:57.972417] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.478 [2024-11-19 01:52:57.972439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:09.478 passed 00:17:09.478 Test: blockdev nvme admin passthru ...passed 00:17:09.736 Test: blockdev copy ...passed 00:17:09.736 00:17:09.736 Run Summary: Type Total Ran Passed Failed Inactive 00:17:09.736 suites 1 1 n/a 0 0 00:17:09.736 tests 23 23 23 0 0 00:17:09.736 asserts 152 152 152 0 n/a 00:17:09.736 00:17:09.736 Elapsed time = 1.126 seconds 00:17:09.736 01:52:58 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:09.736 01:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.736 01:52:58 -- common/autotest_common.sh@10 -- # set +x 00:17:09.736 01:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.736 01:52:58 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:09.736 01:52:58 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:09.736 01:52:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:09.736 01:52:58 -- nvmf/common.sh@116 -- # sync 00:17:09.736 01:52:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:09.736 01:52:58 -- nvmf/common.sh@119 -- # set +e 00:17:09.736 01:52:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:09.736 01:52:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:09.994 rmmod nvme_tcp 00:17:09.994 rmmod nvme_fabrics 00:17:09.994 rmmod nvme_keyring 00:17:09.994 01:52:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:09.994 01:52:58 -- nvmf/common.sh@123 -- # set -e 00:17:09.994 01:52:58 -- nvmf/common.sh@124 -- # return 0 00:17:09.994 01:52:58 -- nvmf/common.sh@477 -- # '[' -n 3453843 ']' 00:17:09.994 01:52:58 -- nvmf/common.sh@478 -- # killprocess 3453843 00:17:09.994 01:52:58 -- common/autotest_common.sh@936 -- # '[' -z 3453843 ']' 00:17:09.994 01:52:58 -- common/autotest_common.sh@940 -- # kill -0 3453843 00:17:09.994 01:52:58 -- common/autotest_common.sh@941 -- # uname 00:17:09.994 01:52:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:09.994 01:52:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3453843 00:17:09.994 01:52:58 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:09.994 01:52:58 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:09.994 01:52:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3453843' 00:17:09.994 killing process with pid 3453843 00:17:09.994 01:52:58 -- common/autotest_common.sh@955 -- # kill 3453843 00:17:09.994 01:52:58 -- common/autotest_common.sh@960 -- # wait 3453843 00:17:10.253 01:52:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:10.253 01:52:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:10.253 01:52:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:10.253 01:52:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:10.253 01:52:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:10.253 01:52:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.253 01:52:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.253 01:52:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:12.787 01:53:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:12.787 00:17:12.787 real 0m7.393s 00:17:12.787 user 0m14.270s 00:17:12.787 sys 0m2.132s 00:17:12.787 01:53:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:12.787 01:53:00 -- common/autotest_common.sh@10 -- # set +x 00:17:12.787 ************************************ 00:17:12.787 END TEST nvmf_bdevio 00:17:12.787 ************************************ 00:17:12.787 01:53:00 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:12.787 01:53:00 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:12.787 01:53:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:12.787 01:53:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:12.787 01:53:00 -- common/autotest_common.sh@10 -- # set +x 00:17:12.787 ************************************ 00:17:12.787 START TEST nvmf_bdevio_no_huge 00:17:12.787 ************************************ 00:17:12.787 01:53:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:12.787 * Looking for test storage... 00:17:12.787 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:12.787 01:53:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:12.787 01:53:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:12.787 01:53:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:12.787 01:53:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:12.787 01:53:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:12.787 01:53:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:12.787 01:53:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:12.787 01:53:00 -- scripts/common.sh@335 -- # IFS=.-: 00:17:12.787 01:53:00 -- scripts/common.sh@335 -- # read -ra ver1 00:17:12.787 01:53:00 -- scripts/common.sh@336 -- # IFS=.-: 00:17:12.787 01:53:00 -- scripts/common.sh@336 -- # read -ra ver2 00:17:12.787 01:53:00 -- scripts/common.sh@337 -- # local 'op=<' 00:17:12.787 01:53:00 -- scripts/common.sh@339 -- # ver1_l=2 00:17:12.787 01:53:00 -- scripts/common.sh@340 -- # ver2_l=1 00:17:12.787 01:53:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:12.787 01:53:00 -- scripts/common.sh@343 -- # case "$op" in 00:17:12.787 01:53:00 -- scripts/common.sh@344 -- # : 1 00:17:12.787 01:53:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:12.787 01:53:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:12.787 01:53:00 -- scripts/common.sh@364 -- # decimal 1 00:17:12.787 01:53:00 -- scripts/common.sh@352 -- # local d=1 00:17:12.787 01:53:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:12.787 01:53:00 -- scripts/common.sh@354 -- # echo 1 00:17:12.787 01:53:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:12.787 01:53:00 -- scripts/common.sh@365 -- # decimal 2 00:17:12.787 01:53:00 -- scripts/common.sh@352 -- # local d=2 00:17:12.787 01:53:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:12.787 01:53:00 -- scripts/common.sh@354 -- # echo 2 00:17:12.787 01:53:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:12.787 01:53:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:12.787 01:53:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:12.787 01:53:00 -- scripts/common.sh@367 -- # return 0 00:17:12.787 01:53:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:12.787 01:53:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:12.787 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.787 --rc genhtml_branch_coverage=1 00:17:12.787 --rc genhtml_function_coverage=1 00:17:12.787 --rc genhtml_legend=1 00:17:12.787 --rc geninfo_all_blocks=1 00:17:12.787 --rc geninfo_unexecuted_blocks=1 00:17:12.787 00:17:12.787 ' 00:17:12.787 01:53:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:12.787 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.787 --rc genhtml_branch_coverage=1 00:17:12.787 --rc genhtml_function_coverage=1 00:17:12.787 --rc genhtml_legend=1 00:17:12.787 --rc geninfo_all_blocks=1 00:17:12.787 --rc geninfo_unexecuted_blocks=1 00:17:12.787 00:17:12.787 ' 00:17:12.787 01:53:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:12.787 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.787 --rc genhtml_branch_coverage=1 00:17:12.787 --rc genhtml_function_coverage=1 00:17:12.787 --rc genhtml_legend=1 00:17:12.787 --rc geninfo_all_blocks=1 00:17:12.787 --rc geninfo_unexecuted_blocks=1 00:17:12.787 00:17:12.787 ' 00:17:12.787 01:53:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:12.787 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:12.787 --rc genhtml_branch_coverage=1 00:17:12.787 --rc genhtml_function_coverage=1 00:17:12.787 --rc genhtml_legend=1 00:17:12.787 --rc geninfo_all_blocks=1 00:17:12.787 --rc geninfo_unexecuted_blocks=1 00:17:12.787 00:17:12.787 ' 00:17:12.787 01:53:00 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:12.787 01:53:00 -- nvmf/common.sh@7 -- # uname -s 00:17:12.787 01:53:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:12.787 01:53:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:12.787 01:53:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:12.787 01:53:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:12.787 01:53:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:12.787 01:53:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:12.787 01:53:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:12.787 01:53:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:12.787 01:53:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:12.787 01:53:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:12.787 01:53:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.787 01:53:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.787 01:53:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:12.787 01:53:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:12.787 01:53:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:12.787 01:53:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:12.787 01:53:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:12.787 01:53:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:12.787 01:53:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:12.787 01:53:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.787 01:53:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.787 01:53:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.787 01:53:00 -- paths/export.sh@5 -- # export PATH 00:17:12.787 01:53:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.787 01:53:00 -- nvmf/common.sh@46 -- # : 0 00:17:12.787 01:53:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:12.787 01:53:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:12.787 01:53:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:12.787 01:53:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:12.787 01:53:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:12.787 01:53:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:12.787 01:53:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:12.787 01:53:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:12.787 01:53:00 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:12.787 01:53:00 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:12.787 01:53:00 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:12.787 01:53:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:12.787 01:53:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:12.787 01:53:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:12.787 01:53:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:12.787 01:53:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:12.787 01:53:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:12.787 01:53:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:12.787 01:53:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:12.787 01:53:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:12.787 01:53:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:12.788 01:53:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:12.788 01:53:00 -- common/autotest_common.sh@10 -- # set +x 00:17:14.688 01:53:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:14.688 01:53:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:14.688 01:53:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:14.688 01:53:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:14.688 01:53:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:14.688 01:53:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:14.688 01:53:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:14.688 01:53:02 -- nvmf/common.sh@294 -- # net_devs=() 00:17:14.688 01:53:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:14.688 01:53:02 -- nvmf/common.sh@295 -- # e810=() 00:17:14.688 01:53:02 -- nvmf/common.sh@295 -- # local -ga e810 00:17:14.688 01:53:02 -- nvmf/common.sh@296 -- # x722=() 00:17:14.688 01:53:02 -- nvmf/common.sh@296 -- # local -ga x722 00:17:14.688 01:53:02 -- nvmf/common.sh@297 -- # mlx=() 00:17:14.688 01:53:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:14.688 01:53:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:14.688 01:53:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:14.688 01:53:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:14.688 01:53:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:14.688 01:53:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.688 01:53:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:14.688 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:14.688 01:53:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.688 01:53:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:14.688 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:14.688 01:53:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:14.688 01:53:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.688 01:53:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.688 01:53:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.688 01:53:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.688 01:53:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:14.688 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:14.688 01:53:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.688 01:53:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.688 01:53:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.688 01:53:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.688 01:53:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.688 01:53:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:14.688 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:14.688 01:53:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.688 01:53:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:14.688 01:53:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:14.688 01:53:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:14.688 01:53:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:14.688 01:53:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:14.688 01:53:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:14.688 01:53:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:14.688 01:53:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:14.688 01:53:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:14.688 01:53:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:14.688 01:53:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:14.688 01:53:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:14.689 01:53:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:14.689 01:53:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:14.689 01:53:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:14.689 01:53:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:14.689 01:53:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:14.689 01:53:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:14.689 01:53:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:14.689 01:53:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:14.689 01:53:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:14.689 01:53:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:14.689 01:53:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:14.689 01:53:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:14.689 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:14.689 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:17:14.689 00:17:14.689 --- 10.0.0.2 ping statistics --- 00:17:14.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.689 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:17:14.689 01:53:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:14.689 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:14.689 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:17:14.689 00:17:14.689 --- 10.0.0.1 ping statistics --- 00:17:14.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.689 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:17:14.689 01:53:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:14.689 01:53:03 -- nvmf/common.sh@410 -- # return 0 00:17:14.689 01:53:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:14.689 01:53:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:14.689 01:53:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:14.689 01:53:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:14.689 01:53:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:14.689 01:53:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:14.689 01:53:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:14.689 01:53:03 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:14.689 01:53:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:14.689 01:53:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:14.689 01:53:03 -- common/autotest_common.sh@10 -- # set +x 00:17:14.689 01:53:03 -- nvmf/common.sh@469 -- # nvmfpid=3456151 00:17:14.689 01:53:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:14.689 01:53:03 -- nvmf/common.sh@470 -- # waitforlisten 3456151 00:17:14.689 01:53:03 -- common/autotest_common.sh@829 -- # '[' -z 3456151 ']' 00:17:14.689 01:53:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.689 01:53:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:14.689 01:53:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.689 01:53:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:14.689 01:53:03 -- common/autotest_common.sh@10 -- # set +x 00:17:14.689 [2024-11-19 01:53:03.134751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:14.689 [2024-11-19 01:53:03.134847] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:14.689 [2024-11-19 01:53:03.213150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:14.947 [2024-11-19 01:53:03.333309] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:14.947 [2024-11-19 01:53:03.333495] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:14.947 [2024-11-19 01:53:03.333515] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:14.947 [2024-11-19 01:53:03.333530] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:14.947 [2024-11-19 01:53:03.333624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:14.947 [2024-11-19 01:53:03.333685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:14.947 [2024-11-19 01:53:03.333744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:14.947 [2024-11-19 01:53:03.333748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:15.880 01:53:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:15.880 01:53:04 -- common/autotest_common.sh@862 -- # return 0 00:17:15.880 01:53:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:15.880 01:53:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:15.880 01:53:04 -- common/autotest_common.sh@10 -- # set +x 00:17:15.880 01:53:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:15.880 01:53:04 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:15.880 01:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.880 01:53:04 -- common/autotest_common.sh@10 -- # set +x 00:17:15.880 [2024-11-19 01:53:04.126179] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:15.880 01:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.880 01:53:04 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:15.880 01:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.880 01:53:04 -- common/autotest_common.sh@10 -- # set +x 00:17:15.880 Malloc0 00:17:15.880 01:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.880 01:53:04 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:15.880 01:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.880 01:53:04 -- common/autotest_common.sh@10 -- # set +x 00:17:15.880 01:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.880 01:53:04 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:15.880 01:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.880 01:53:04 -- common/autotest_common.sh@10 -- # set +x 00:17:15.880 01:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.880 01:53:04 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:15.880 01:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.880 01:53:04 -- common/autotest_common.sh@10 -- # set +x 00:17:15.880 [2024-11-19 01:53:04.164398] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:15.880 01:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.880 01:53:04 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:15.880 01:53:04 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:15.880 01:53:04 -- nvmf/common.sh@520 -- # config=() 00:17:15.880 01:53:04 -- nvmf/common.sh@520 -- # local subsystem config 00:17:15.880 01:53:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:15.880 01:53:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:15.880 { 00:17:15.880 "params": { 00:17:15.880 "name": "Nvme$subsystem", 00:17:15.880 "trtype": "$TEST_TRANSPORT", 00:17:15.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:15.880 "adrfam": "ipv4", 00:17:15.880 "trsvcid": "$NVMF_PORT", 00:17:15.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:15.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:15.880 "hdgst": ${hdgst:-false}, 00:17:15.880 "ddgst": ${ddgst:-false} 00:17:15.880 }, 00:17:15.880 "method": "bdev_nvme_attach_controller" 00:17:15.880 } 00:17:15.880 EOF 00:17:15.880 )") 00:17:15.880 01:53:04 -- nvmf/common.sh@542 -- # cat 00:17:15.880 01:53:04 -- nvmf/common.sh@544 -- # jq . 00:17:15.880 01:53:04 -- nvmf/common.sh@545 -- # IFS=, 00:17:15.880 01:53:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:15.880 "params": { 00:17:15.880 "name": "Nvme1", 00:17:15.880 "trtype": "tcp", 00:17:15.880 "traddr": "10.0.0.2", 00:17:15.880 "adrfam": "ipv4", 00:17:15.880 "trsvcid": "4420", 00:17:15.880 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:15.880 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:15.880 "hdgst": false, 00:17:15.880 "ddgst": false 00:17:15.880 }, 00:17:15.880 "method": "bdev_nvme_attach_controller" 00:17:15.880 }' 00:17:15.880 [2024-11-19 01:53:04.209429] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.880 [2024-11-19 01:53:04.209502] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3456274 ] 00:17:15.880 [2024-11-19 01:53:04.278707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:15.880 [2024-11-19 01:53:04.393844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:15.880 [2024-11-19 01:53:04.393894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:15.880 [2024-11-19 01:53:04.393898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:16.139 [2024-11-19 01:53:04.589039] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:16.139 [2024-11-19 01:53:04.589100] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:16.139 I/O targets: 00:17:16.139 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:16.139 00:17:16.139 00:17:16.139 CUnit - A unit testing framework for C - Version 2.1-3 00:17:16.139 http://cunit.sourceforge.net/ 00:17:16.139 00:17:16.139 00:17:16.139 Suite: bdevio tests on: Nvme1n1 00:17:16.139 Test: blockdev write read block ...passed 00:17:16.139 Test: blockdev write zeroes read block ...passed 00:17:16.397 Test: blockdev write zeroes read no split ...passed 00:17:16.397 Test: blockdev write zeroes read split ...passed 00:17:16.397 Test: blockdev write zeroes read split partial ...passed 00:17:16.397 Test: blockdev reset ...[2024-11-19 01:53:04.709312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:16.397 [2024-11-19 01:53:04.709417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b7d0 (9): Bad file descriptor 00:17:16.397 [2024-11-19 01:53:04.818700] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:16.397 passed 00:17:16.397 Test: blockdev write read 8 blocks ...passed 00:17:16.397 Test: blockdev write read size > 128k ...passed 00:17:16.397 Test: blockdev write read invalid size ...passed 00:17:16.397 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:16.397 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:16.397 Test: blockdev write read max offset ...passed 00:17:16.655 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:16.655 Test: blockdev writev readv 8 blocks ...passed 00:17:16.655 Test: blockdev writev readv 30 x 1block ...passed 00:17:16.655 Test: blockdev writev readv block ...passed 00:17:16.655 Test: blockdev writev readv size > 128k ...passed 00:17:16.655 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:16.655 Test: blockdev comparev and writev ...[2024-11-19 01:53:05.115775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.115811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.115841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.115858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.116198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.116231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.116255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.116272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.116612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.116649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.116673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.116690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.117024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.117049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.117070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:16.655 [2024-11-19 01:53:05.117093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:16.655 passed 00:17:16.655 Test: blockdev nvme passthru rw ...passed 00:17:16.655 Test: blockdev nvme passthru vendor specific ...[2024-11-19 01:53:05.199928] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.655 [2024-11-19 01:53:05.199957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:16.655 [2024-11-19 01:53:05.200108] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.655 [2024-11-19 01:53:05.200132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:16.656 [2024-11-19 01:53:05.200289] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.656 [2024-11-19 01:53:05.200313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:16.656 [2024-11-19 01:53:05.200456] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:16.656 [2024-11-19 01:53:05.200480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:16.656 passed 00:17:16.914 Test: blockdev nvme admin passthru ...passed 00:17:16.914 Test: blockdev copy ...passed 00:17:16.914 00:17:16.914 Run Summary: Type Total Ran Passed Failed Inactive 00:17:16.914 suites 1 1 n/a 0 0 00:17:16.914 tests 23 23 23 0 0 00:17:16.914 asserts 152 152 152 0 n/a 00:17:16.914 00:17:16.914 Elapsed time = 1.325 seconds 00:17:17.173 01:53:05 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:17.173 01:53:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.173 01:53:05 -- common/autotest_common.sh@10 -- # set +x 00:17:17.173 01:53:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.173 01:53:05 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:17.173 01:53:05 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:17.173 01:53:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:17.173 01:53:05 -- nvmf/common.sh@116 -- # sync 00:17:17.173 01:53:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:17.173 01:53:05 -- nvmf/common.sh@119 -- # set +e 00:17:17.173 01:53:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:17.173 01:53:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:17.173 rmmod nvme_tcp 00:17:17.173 rmmod nvme_fabrics 00:17:17.173 rmmod nvme_keyring 00:17:17.173 01:53:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:17.173 01:53:05 -- nvmf/common.sh@123 -- # set -e 00:17:17.173 01:53:05 -- nvmf/common.sh@124 -- # return 0 00:17:17.173 01:53:05 -- nvmf/common.sh@477 -- # '[' -n 3456151 ']' 00:17:17.173 01:53:05 -- nvmf/common.sh@478 -- # killprocess 3456151 00:17:17.173 01:53:05 -- common/autotest_common.sh@936 -- # '[' -z 3456151 ']' 00:17:17.173 01:53:05 -- common/autotest_common.sh@940 -- # kill -0 3456151 00:17:17.173 01:53:05 -- common/autotest_common.sh@941 -- # uname 00:17:17.173 01:53:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:17.173 01:53:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3456151 00:17:17.431 01:53:05 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:17.431 01:53:05 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:17.431 01:53:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3456151' 00:17:17.431 killing process with pid 3456151 00:17:17.431 01:53:05 -- common/autotest_common.sh@955 -- # kill 3456151 00:17:17.431 01:53:05 -- common/autotest_common.sh@960 -- # wait 3456151 00:17:17.689 01:53:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:17.689 01:53:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:17.689 01:53:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:17.689 01:53:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:17.689 01:53:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:17.689 01:53:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:17.689 01:53:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:17.689 01:53:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:20.222 01:53:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:20.222 00:17:20.222 real 0m7.501s 00:17:20.222 user 0m14.289s 00:17:20.222 sys 0m2.664s 00:17:20.222 01:53:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:20.222 01:53:08 -- common/autotest_common.sh@10 -- # set +x 00:17:20.222 ************************************ 00:17:20.222 END TEST nvmf_bdevio_no_huge 00:17:20.222 ************************************ 00:17:20.222 01:53:08 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:20.222 01:53:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:20.222 01:53:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:20.222 01:53:08 -- common/autotest_common.sh@10 -- # set +x 00:17:20.222 ************************************ 00:17:20.222 START TEST nvmf_tls 00:17:20.222 ************************************ 00:17:20.222 01:53:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:20.222 * Looking for test storage... 00:17:20.222 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:20.222 01:53:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:20.222 01:53:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:20.222 01:53:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:20.222 01:53:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:20.222 01:53:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:20.222 01:53:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:20.222 01:53:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:20.222 01:53:08 -- scripts/common.sh@335 -- # IFS=.-: 00:17:20.222 01:53:08 -- scripts/common.sh@335 -- # read -ra ver1 00:17:20.222 01:53:08 -- scripts/common.sh@336 -- # IFS=.-: 00:17:20.222 01:53:08 -- scripts/common.sh@336 -- # read -ra ver2 00:17:20.222 01:53:08 -- scripts/common.sh@337 -- # local 'op=<' 00:17:20.222 01:53:08 -- scripts/common.sh@339 -- # ver1_l=2 00:17:20.222 01:53:08 -- scripts/common.sh@340 -- # ver2_l=1 00:17:20.222 01:53:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:20.222 01:53:08 -- scripts/common.sh@343 -- # case "$op" in 00:17:20.222 01:53:08 -- scripts/common.sh@344 -- # : 1 00:17:20.222 01:53:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:20.222 01:53:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:20.222 01:53:08 -- scripts/common.sh@364 -- # decimal 1 00:17:20.222 01:53:08 -- scripts/common.sh@352 -- # local d=1 00:17:20.222 01:53:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:20.222 01:53:08 -- scripts/common.sh@354 -- # echo 1 00:17:20.222 01:53:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:20.222 01:53:08 -- scripts/common.sh@365 -- # decimal 2 00:17:20.222 01:53:08 -- scripts/common.sh@352 -- # local d=2 00:17:20.222 01:53:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:20.222 01:53:08 -- scripts/common.sh@354 -- # echo 2 00:17:20.222 01:53:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:20.222 01:53:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:20.222 01:53:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:20.222 01:53:08 -- scripts/common.sh@367 -- # return 0 00:17:20.222 01:53:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:20.222 01:53:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:20.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.222 --rc genhtml_branch_coverage=1 00:17:20.222 --rc genhtml_function_coverage=1 00:17:20.222 --rc genhtml_legend=1 00:17:20.222 --rc geninfo_all_blocks=1 00:17:20.222 --rc geninfo_unexecuted_blocks=1 00:17:20.222 00:17:20.222 ' 00:17:20.222 01:53:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:20.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.222 --rc genhtml_branch_coverage=1 00:17:20.222 --rc genhtml_function_coverage=1 00:17:20.222 --rc genhtml_legend=1 00:17:20.222 --rc geninfo_all_blocks=1 00:17:20.222 --rc geninfo_unexecuted_blocks=1 00:17:20.222 00:17:20.222 ' 00:17:20.222 01:53:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:20.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.222 --rc genhtml_branch_coverage=1 00:17:20.222 --rc genhtml_function_coverage=1 00:17:20.222 --rc genhtml_legend=1 00:17:20.222 --rc geninfo_all_blocks=1 00:17:20.222 --rc geninfo_unexecuted_blocks=1 00:17:20.222 00:17:20.222 ' 00:17:20.222 01:53:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:20.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.222 --rc genhtml_branch_coverage=1 00:17:20.222 --rc genhtml_function_coverage=1 00:17:20.222 --rc genhtml_legend=1 00:17:20.222 --rc geninfo_all_blocks=1 00:17:20.222 --rc geninfo_unexecuted_blocks=1 00:17:20.222 00:17:20.222 ' 00:17:20.222 01:53:08 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:20.222 01:53:08 -- nvmf/common.sh@7 -- # uname -s 00:17:20.222 01:53:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:20.222 01:53:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:20.222 01:53:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:20.222 01:53:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:20.222 01:53:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:20.222 01:53:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:20.222 01:53:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:20.222 01:53:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:20.222 01:53:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:20.222 01:53:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:20.222 01:53:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:20.222 01:53:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:20.222 01:53:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:20.222 01:53:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:20.222 01:53:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:20.222 01:53:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:20.222 01:53:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:20.222 01:53:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:20.222 01:53:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:20.222 01:53:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.223 01:53:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.223 01:53:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.223 01:53:08 -- paths/export.sh@5 -- # export PATH 00:17:20.223 01:53:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.223 01:53:08 -- nvmf/common.sh@46 -- # : 0 00:17:20.223 01:53:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:20.223 01:53:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:20.223 01:53:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:20.223 01:53:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:20.223 01:53:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:20.223 01:53:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:20.223 01:53:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:20.223 01:53:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:20.223 01:53:08 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:20.223 01:53:08 -- target/tls.sh@71 -- # nvmftestinit 00:17:20.223 01:53:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:20.223 01:53:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:20.223 01:53:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:20.223 01:53:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:20.223 01:53:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:20.223 01:53:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:20.223 01:53:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:20.223 01:53:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:20.223 01:53:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:20.223 01:53:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:20.223 01:53:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:20.223 01:53:08 -- common/autotest_common.sh@10 -- # set +x 00:17:22.127 01:53:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:22.127 01:53:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:22.127 01:53:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:22.127 01:53:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:22.127 01:53:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:22.127 01:53:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:22.127 01:53:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:22.127 01:53:10 -- nvmf/common.sh@294 -- # net_devs=() 00:17:22.127 01:53:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:22.127 01:53:10 -- nvmf/common.sh@295 -- # e810=() 00:17:22.127 01:53:10 -- nvmf/common.sh@295 -- # local -ga e810 00:17:22.127 01:53:10 -- nvmf/common.sh@296 -- # x722=() 00:17:22.127 01:53:10 -- nvmf/common.sh@296 -- # local -ga x722 00:17:22.127 01:53:10 -- nvmf/common.sh@297 -- # mlx=() 00:17:22.127 01:53:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:22.127 01:53:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:22.127 01:53:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:22.127 01:53:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:22.127 01:53:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:22.127 01:53:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:22.127 01:53:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:22.127 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:22.127 01:53:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:22.127 01:53:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:22.127 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:22.127 01:53:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:22.127 01:53:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:22.127 01:53:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:22.127 01:53:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:22.127 01:53:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:22.127 01:53:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:22.127 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:22.127 01:53:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:22.127 01:53:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:22.127 01:53:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:22.127 01:53:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:22.127 01:53:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:22.127 01:53:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:22.127 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:22.127 01:53:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:22.127 01:53:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:22.127 01:53:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:22.127 01:53:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:22.127 01:53:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:22.127 01:53:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:22.127 01:53:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:22.127 01:53:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:22.127 01:53:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:22.127 01:53:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:22.127 01:53:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:22.127 01:53:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:22.127 01:53:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:22.127 01:53:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:22.127 01:53:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:22.127 01:53:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:22.127 01:53:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:22.127 01:53:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:22.127 01:53:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:22.127 01:53:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:22.127 01:53:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:22.127 01:53:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:22.127 01:53:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:22.127 01:53:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:22.127 01:53:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:22.127 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:22.127 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:17:22.127 00:17:22.127 --- 10.0.0.2 ping statistics --- 00:17:22.127 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.127 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:17:22.128 01:53:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:22.128 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:22.128 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:17:22.128 00:17:22.128 --- 10.0.0.1 ping statistics --- 00:17:22.128 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.128 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:17:22.128 01:53:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:22.128 01:53:10 -- nvmf/common.sh@410 -- # return 0 00:17:22.128 01:53:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:22.128 01:53:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:22.128 01:53:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:22.128 01:53:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:22.128 01:53:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:22.128 01:53:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:22.128 01:53:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:22.128 01:53:10 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:22.128 01:53:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:22.128 01:53:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:22.128 01:53:10 -- common/autotest_common.sh@10 -- # set +x 00:17:22.128 01:53:10 -- nvmf/common.sh@469 -- # nvmfpid=3458480 00:17:22.128 01:53:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:22.128 01:53:10 -- nvmf/common.sh@470 -- # waitforlisten 3458480 00:17:22.128 01:53:10 -- common/autotest_common.sh@829 -- # '[' -z 3458480 ']' 00:17:22.128 01:53:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:22.128 01:53:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:22.128 01:53:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:22.128 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:22.128 01:53:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:22.128 01:53:10 -- common/autotest_common.sh@10 -- # set +x 00:17:22.128 [2024-11-19 01:53:10.620625] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.128 [2024-11-19 01:53:10.620718] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:22.128 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.386 [2024-11-19 01:53:10.688582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.386 [2024-11-19 01:53:10.804922] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:22.386 [2024-11-19 01:53:10.805065] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:22.386 [2024-11-19 01:53:10.805086] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:22.386 [2024-11-19 01:53:10.805101] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:22.386 [2024-11-19 01:53:10.805139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:22.386 01:53:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.386 01:53:10 -- common/autotest_common.sh@862 -- # return 0 00:17:22.386 01:53:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:22.386 01:53:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:22.386 01:53:10 -- common/autotest_common.sh@10 -- # set +x 00:17:22.386 01:53:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:22.386 01:53:10 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:22.386 01:53:10 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:22.644 true 00:17:22.644 01:53:11 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:22.644 01:53:11 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:22.902 01:53:11 -- target/tls.sh@82 -- # version=0 00:17:22.902 01:53:11 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:22.902 01:53:11 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:23.468 01:53:11 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.468 01:53:11 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:23.468 01:53:11 -- target/tls.sh@90 -- # version=13 00:17:23.468 01:53:11 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:23.468 01:53:11 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:23.726 01:53:12 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.726 01:53:12 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:24.292 01:53:12 -- target/tls.sh@98 -- # version=7 00:17:24.292 01:53:12 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:24.292 01:53:12 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.292 01:53:12 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:24.292 01:53:12 -- target/tls.sh@105 -- # ktls=false 00:17:24.292 01:53:12 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:24.292 01:53:12 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:24.859 01:53:13 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.859 01:53:13 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:24.859 01:53:13 -- target/tls.sh@113 -- # ktls=true 00:17:24.859 01:53:13 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:24.859 01:53:13 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:25.117 01:53:13 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:25.117 01:53:13 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:25.375 01:53:13 -- target/tls.sh@121 -- # ktls=false 00:17:25.375 01:53:13 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:25.375 01:53:13 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:25.375 01:53:13 -- target/tls.sh@49 -- # local key hash crc 00:17:25.375 01:53:13 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:25.375 01:53:13 -- target/tls.sh@51 -- # hash=01 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # tail -c8 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # head -c 4 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # crc='p$H�' 00:17:25.375 01:53:13 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.375 01:53:13 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:25.375 01:53:13 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.375 01:53:13 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.375 01:53:13 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:25.375 01:53:13 -- target/tls.sh@49 -- # local key hash crc 00:17:25.375 01:53:13 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:25.375 01:53:13 -- target/tls.sh@51 -- # hash=01 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # tail -c8 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # head -c 4 00:17:25.375 01:53:13 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:25.375 01:53:13 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.375 01:53:13 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:25.633 01:53:13 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.633 01:53:13 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.633 01:53:13 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.633 01:53:13 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:25.633 01:53:13 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.633 01:53:13 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.633 01:53:13 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.633 01:53:13 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:25.633 01:53:13 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:25.891 01:53:14 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:26.149 01:53:14 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.150 01:53:14 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.150 01:53:14 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:26.407 [2024-11-19 01:53:14.833025] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:26.408 01:53:14 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:26.665 01:53:15 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:26.923 [2024-11-19 01:53:15.310285] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:26.923 [2024-11-19 01:53:15.310529] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:26.923 01:53:15 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:27.181 malloc0 00:17:27.181 01:53:15 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:27.439 01:53:15 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.697 01:53:16 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.697 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.741 Initializing NVMe Controllers 00:17:37.741 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:37.741 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:37.741 Initialization complete. Launching workers. 00:17:37.741 ======================================================== 00:17:37.741 Latency(us) 00:17:37.741 Device Information : IOPS MiB/s Average min max 00:17:37.741 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7765.79 30.34 8243.81 1178.04 10642.42 00:17:37.741 ======================================================== 00:17:37.741 Total : 7765.79 30.34 8243.81 1178.04 10642.42 00:17:37.741 00:17:37.741 01:53:26 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.741 01:53:26 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:37.741 01:53:26 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:37.741 01:53:26 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:37.741 01:53:26 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:37.741 01:53:26 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:37.741 01:53:26 -- target/tls.sh@28 -- # bdevperf_pid=3460443 00:17:37.741 01:53:26 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:37.741 01:53:26 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:37.741 01:53:26 -- target/tls.sh@31 -- # waitforlisten 3460443 /var/tmp/bdevperf.sock 00:17:37.741 01:53:26 -- common/autotest_common.sh@829 -- # '[' -z 3460443 ']' 00:17:37.741 01:53:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.741 01:53:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.741 01:53:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.741 01:53:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.741 01:53:26 -- common/autotest_common.sh@10 -- # set +x 00:17:37.741 [2024-11-19 01:53:26.235156] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.741 [2024-11-19 01:53:26.235235] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3460443 ] 00:17:37.741 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.000 [2024-11-19 01:53:26.293445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.000 [2024-11-19 01:53:26.396722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.933 01:53:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.933 01:53:27 -- common/autotest_common.sh@862 -- # return 0 00:17:38.933 01:53:27 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.933 [2024-11-19 01:53:27.410128] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:39.189 TLSTESTn1 00:17:39.189 01:53:27 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:39.189 Running I/O for 10 seconds... 00:17:49.154 00:17:49.155 Latency(us) 00:17:49.155 [2024-11-19T00:53:37.698Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.155 [2024-11-19T00:53:37.698Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:49.155 Verification LBA range: start 0x0 length 0x2000 00:17:49.155 TLSTESTn1 : 10.02 4716.61 18.42 0.00 0.00 27093.69 4684.61 42913.94 00:17:49.155 [2024-11-19T00:53:37.698Z] =================================================================================================================== 00:17:49.155 [2024-11-19T00:53:37.698Z] Total : 4716.61 18.42 0.00 0.00 27093.69 4684.61 42913.94 00:17:49.155 0 00:17:49.155 01:53:37 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:49.155 01:53:37 -- target/tls.sh@45 -- # killprocess 3460443 00:17:49.155 01:53:37 -- common/autotest_common.sh@936 -- # '[' -z 3460443 ']' 00:17:49.155 01:53:37 -- common/autotest_common.sh@940 -- # kill -0 3460443 00:17:49.155 01:53:37 -- common/autotest_common.sh@941 -- # uname 00:17:49.155 01:53:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.155 01:53:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3460443 00:17:49.412 01:53:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:49.412 01:53:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:49.412 01:53:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3460443' 00:17:49.412 killing process with pid 3460443 00:17:49.412 01:53:37 -- common/autotest_common.sh@955 -- # kill 3460443 00:17:49.413 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.413 00:17:49.413 Latency(us) 00:17:49.413 [2024-11-19T00:53:37.956Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.413 [2024-11-19T00:53:37.956Z] =================================================================================================================== 00:17:49.413 [2024-11-19T00:53:37.956Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:49.413 01:53:37 -- common/autotest_common.sh@960 -- # wait 3460443 00:17:49.670 01:53:37 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:49.670 01:53:37 -- common/autotest_common.sh@650 -- # local es=0 00:17:49.670 01:53:37 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:49.670 01:53:37 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:49.670 01:53:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.670 01:53:37 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:49.670 01:53:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.670 01:53:37 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:49.670 01:53:37 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:49.670 01:53:37 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:49.671 01:53:37 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:49.671 01:53:37 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:49.671 01:53:37 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:49.671 01:53:37 -- target/tls.sh@28 -- # bdevperf_pid=3461816 00:17:49.671 01:53:37 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:49.671 01:53:37 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:49.671 01:53:37 -- target/tls.sh@31 -- # waitforlisten 3461816 /var/tmp/bdevperf.sock 00:17:49.671 01:53:37 -- common/autotest_common.sh@829 -- # '[' -z 3461816 ']' 00:17:49.671 01:53:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:49.671 01:53:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:49.671 01:53:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:49.671 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:49.671 01:53:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:49.671 01:53:37 -- common/autotest_common.sh@10 -- # set +x 00:17:49.671 [2024-11-19 01:53:38.028546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:49.671 [2024-11-19 01:53:38.028646] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3461816 ] 00:17:49.671 EAL: No free 2048 kB hugepages reported on node 1 00:17:49.671 [2024-11-19 01:53:38.085024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:49.671 [2024-11-19 01:53:38.190426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:50.604 01:53:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:50.604 01:53:38 -- common/autotest_common.sh@862 -- # return 0 00:17:50.604 01:53:38 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:50.862 [2024-11-19 01:53:39.226784] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:50.862 [2024-11-19 01:53:39.237419] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:50.862 [2024-11-19 01:53:39.237646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d551f0 (107): Transport endpoint is not connected 00:17:50.862 [2024-11-19 01:53:39.238608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d551f0 (9): Bad file descriptor 00:17:50.862 [2024-11-19 01:53:39.239607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:50.862 [2024-11-19 01:53:39.239650] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:50.862 [2024-11-19 01:53:39.239665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:50.862 request: 00:17:50.862 { 00:17:50.862 "name": "TLSTEST", 00:17:50.862 "trtype": "tcp", 00:17:50.862 "traddr": "10.0.0.2", 00:17:50.862 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:50.862 "adrfam": "ipv4", 00:17:50.862 "trsvcid": "4420", 00:17:50.862 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:50.862 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:50.862 "method": "bdev_nvme_attach_controller", 00:17:50.862 "req_id": 1 00:17:50.862 } 00:17:50.862 Got JSON-RPC error response 00:17:50.862 response: 00:17:50.862 { 00:17:50.862 "code": -32602, 00:17:50.862 "message": "Invalid parameters" 00:17:50.862 } 00:17:50.862 01:53:39 -- target/tls.sh@36 -- # killprocess 3461816 00:17:50.862 01:53:39 -- common/autotest_common.sh@936 -- # '[' -z 3461816 ']' 00:17:50.862 01:53:39 -- common/autotest_common.sh@940 -- # kill -0 3461816 00:17:50.862 01:53:39 -- common/autotest_common.sh@941 -- # uname 00:17:50.862 01:53:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:50.862 01:53:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3461816 00:17:50.862 01:53:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:50.862 01:53:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:50.862 01:53:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3461816' 00:17:50.862 killing process with pid 3461816 00:17:50.862 01:53:39 -- common/autotest_common.sh@955 -- # kill 3461816 00:17:50.862 Received shutdown signal, test time was about 10.000000 seconds 00:17:50.862 00:17:50.862 Latency(us) 00:17:50.862 [2024-11-19T00:53:39.405Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.862 [2024-11-19T00:53:39.405Z] =================================================================================================================== 00:17:50.862 [2024-11-19T00:53:39.405Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:50.862 01:53:39 -- common/autotest_common.sh@960 -- # wait 3461816 00:17:51.120 01:53:39 -- target/tls.sh@37 -- # return 1 00:17:51.120 01:53:39 -- common/autotest_common.sh@653 -- # es=1 00:17:51.120 01:53:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:51.120 01:53:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:51.120 01:53:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:51.120 01:53:39 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.120 01:53:39 -- common/autotest_common.sh@650 -- # local es=0 00:17:51.120 01:53:39 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.120 01:53:39 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:51.120 01:53:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.120 01:53:39 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:51.120 01:53:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.120 01:53:39 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.120 01:53:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:51.120 01:53:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:51.120 01:53:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:51.120 01:53:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:51.120 01:53:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:51.120 01:53:39 -- target/tls.sh@28 -- # bdevperf_pid=3462084 00:17:51.120 01:53:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:51.120 01:53:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:51.120 01:53:39 -- target/tls.sh@31 -- # waitforlisten 3462084 /var/tmp/bdevperf.sock 00:17:51.120 01:53:39 -- common/autotest_common.sh@829 -- # '[' -z 3462084 ']' 00:17:51.120 01:53:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:51.120 01:53:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:51.120 01:53:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:51.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:51.120 01:53:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:51.120 01:53:39 -- common/autotest_common.sh@10 -- # set +x 00:17:51.120 [2024-11-19 01:53:39.584435] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:51.120 [2024-11-19 01:53:39.584523] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3462084 ] 00:17:51.120 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.120 [2024-11-19 01:53:39.643677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.378 [2024-11-19 01:53:39.749391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:52.312 01:53:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:52.312 01:53:40 -- common/autotest_common.sh@862 -- # return 0 00:17:52.312 01:53:40 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.312 [2024-11-19 01:53:40.814521] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:52.312 [2024-11-19 01:53:40.821399] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:52.312 [2024-11-19 01:53:40.821430] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:52.312 [2024-11-19 01:53:40.821468] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:52.312 [2024-11-19 01:53:40.822322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6e01f0 (107): Transport endpoint is not connected 00:17:52.312 [2024-11-19 01:53:40.823315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6e01f0 (9): Bad file descriptor 00:17:52.312 [2024-11-19 01:53:40.824314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:52.312 [2024-11-19 01:53:40.824333] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:52.312 [2024-11-19 01:53:40.824346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:52.312 request: 00:17:52.312 { 00:17:52.312 "name": "TLSTEST", 00:17:52.312 "trtype": "tcp", 00:17:52.312 "traddr": "10.0.0.2", 00:17:52.312 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:52.312 "adrfam": "ipv4", 00:17:52.312 "trsvcid": "4420", 00:17:52.312 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:52.312 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:52.312 "method": "bdev_nvme_attach_controller", 00:17:52.312 "req_id": 1 00:17:52.312 } 00:17:52.312 Got JSON-RPC error response 00:17:52.312 response: 00:17:52.312 { 00:17:52.312 "code": -32602, 00:17:52.312 "message": "Invalid parameters" 00:17:52.312 } 00:17:52.312 01:53:40 -- target/tls.sh@36 -- # killprocess 3462084 00:17:52.312 01:53:40 -- common/autotest_common.sh@936 -- # '[' -z 3462084 ']' 00:17:52.312 01:53:40 -- common/autotest_common.sh@940 -- # kill -0 3462084 00:17:52.312 01:53:40 -- common/autotest_common.sh@941 -- # uname 00:17:52.312 01:53:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:52.312 01:53:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3462084 00:17:52.570 01:53:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:52.570 01:53:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:52.570 01:53:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3462084' 00:17:52.570 killing process with pid 3462084 00:17:52.570 01:53:40 -- common/autotest_common.sh@955 -- # kill 3462084 00:17:52.570 Received shutdown signal, test time was about 10.000000 seconds 00:17:52.570 00:17:52.570 Latency(us) 00:17:52.570 [2024-11-19T00:53:41.113Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:52.570 [2024-11-19T00:53:41.113Z] =================================================================================================================== 00:17:52.570 [2024-11-19T00:53:41.113Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:52.570 01:53:40 -- common/autotest_common.sh@960 -- # wait 3462084 00:17:52.829 01:53:41 -- target/tls.sh@37 -- # return 1 00:17:52.829 01:53:41 -- common/autotest_common.sh@653 -- # es=1 00:17:52.829 01:53:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:52.829 01:53:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:52.829 01:53:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:52.829 01:53:41 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.829 01:53:41 -- common/autotest_common.sh@650 -- # local es=0 00:17:52.829 01:53:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.829 01:53:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:52.829 01:53:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:52.829 01:53:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:52.829 01:53:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:52.829 01:53:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.829 01:53:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:52.829 01:53:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:52.829 01:53:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:52.829 01:53:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:52.829 01:53:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:52.829 01:53:41 -- target/tls.sh@28 -- # bdevperf_pid=3462241 00:17:52.829 01:53:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:52.829 01:53:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:52.829 01:53:41 -- target/tls.sh@31 -- # waitforlisten 3462241 /var/tmp/bdevperf.sock 00:17:52.829 01:53:41 -- common/autotest_common.sh@829 -- # '[' -z 3462241 ']' 00:17:52.829 01:53:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:52.829 01:53:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:52.829 01:53:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:52.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:52.829 01:53:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:52.829 01:53:41 -- common/autotest_common.sh@10 -- # set +x 00:17:52.829 [2024-11-19 01:53:41.186284] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:52.829 [2024-11-19 01:53:41.186375] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3462241 ] 00:17:52.829 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.829 [2024-11-19 01:53:41.242769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.829 [2024-11-19 01:53:41.343184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:53.763 01:53:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:53.763 01:53:42 -- common/autotest_common.sh@862 -- # return 0 00:17:53.763 01:53:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:54.021 [2024-11-19 01:53:42.364277] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:54.021 [2024-11-19 01:53:42.375411] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:54.021 [2024-11-19 01:53:42.375441] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:54.021 [2024-11-19 01:53:42.375501] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:54.021 [2024-11-19 01:53:42.376021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd91f0 (107): Transport endpoint is not connected 00:17:54.021 [2024-11-19 01:53:42.377012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd91f0 (9): Bad file descriptor 00:17:54.021 [2024-11-19 01:53:42.378011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:54.021 [2024-11-19 01:53:42.378030] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:54.021 [2024-11-19 01:53:42.378042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:54.021 request: 00:17:54.021 { 00:17:54.021 "name": "TLSTEST", 00:17:54.021 "trtype": "tcp", 00:17:54.021 "traddr": "10.0.0.2", 00:17:54.021 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:54.021 "adrfam": "ipv4", 00:17:54.021 "trsvcid": "4420", 00:17:54.021 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:54.021 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:54.021 "method": "bdev_nvme_attach_controller", 00:17:54.021 "req_id": 1 00:17:54.021 } 00:17:54.021 Got JSON-RPC error response 00:17:54.021 response: 00:17:54.021 { 00:17:54.021 "code": -32602, 00:17:54.021 "message": "Invalid parameters" 00:17:54.021 } 00:17:54.021 01:53:42 -- target/tls.sh@36 -- # killprocess 3462241 00:17:54.021 01:53:42 -- common/autotest_common.sh@936 -- # '[' -z 3462241 ']' 00:17:54.021 01:53:42 -- common/autotest_common.sh@940 -- # kill -0 3462241 00:17:54.021 01:53:42 -- common/autotest_common.sh@941 -- # uname 00:17:54.021 01:53:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.021 01:53:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3462241 00:17:54.021 01:53:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:54.021 01:53:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:54.022 01:53:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3462241' 00:17:54.022 killing process with pid 3462241 00:17:54.022 01:53:42 -- common/autotest_common.sh@955 -- # kill 3462241 00:17:54.022 Received shutdown signal, test time was about 10.000000 seconds 00:17:54.022 00:17:54.022 Latency(us) 00:17:54.022 [2024-11-19T00:53:42.565Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.022 [2024-11-19T00:53:42.565Z] =================================================================================================================== 00:17:54.022 [2024-11-19T00:53:42.565Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:54.022 01:53:42 -- common/autotest_common.sh@960 -- # wait 3462241 00:17:54.280 01:53:42 -- target/tls.sh@37 -- # return 1 00:17:54.280 01:53:42 -- common/autotest_common.sh@653 -- # es=1 00:17:54.280 01:53:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:54.280 01:53:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:54.280 01:53:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:54.280 01:53:42 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:54.280 01:53:42 -- common/autotest_common.sh@650 -- # local es=0 00:17:54.280 01:53:42 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:54.280 01:53:42 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:54.280 01:53:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:54.280 01:53:42 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:54.280 01:53:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:54.280 01:53:42 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:54.280 01:53:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:54.280 01:53:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:54.280 01:53:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:54.280 01:53:42 -- target/tls.sh@23 -- # psk= 00:17:54.280 01:53:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:54.280 01:53:42 -- target/tls.sh@28 -- # bdevperf_pid=3462476 00:17:54.280 01:53:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:54.280 01:53:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:54.280 01:53:42 -- target/tls.sh@31 -- # waitforlisten 3462476 /var/tmp/bdevperf.sock 00:17:54.280 01:53:42 -- common/autotest_common.sh@829 -- # '[' -z 3462476 ']' 00:17:54.280 01:53:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:54.280 01:53:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:54.280 01:53:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:54.280 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:54.280 01:53:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:54.280 01:53:42 -- common/autotest_common.sh@10 -- # set +x 00:17:54.280 [2024-11-19 01:53:42.738129] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:54.280 [2024-11-19 01:53:42.738219] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3462476 ] 00:17:54.280 EAL: No free 2048 kB hugepages reported on node 1 00:17:54.280 [2024-11-19 01:53:42.805943] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:54.539 [2024-11-19 01:53:42.917596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:55.473 01:53:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:55.473 01:53:43 -- common/autotest_common.sh@862 -- # return 0 00:17:55.473 01:53:43 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:55.473 [2024-11-19 01:53:43.959572] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:55.473 [2024-11-19 01:53:43.960834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xae9050 (9): Bad file descriptor 00:17:55.473 [2024-11-19 01:53:43.961829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:55.473 [2024-11-19 01:53:43.961851] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:55.473 [2024-11-19 01:53:43.961865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:55.473 request: 00:17:55.473 { 00:17:55.473 "name": "TLSTEST", 00:17:55.473 "trtype": "tcp", 00:17:55.473 "traddr": "10.0.0.2", 00:17:55.473 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:55.473 "adrfam": "ipv4", 00:17:55.473 "trsvcid": "4420", 00:17:55.473 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:55.473 "method": "bdev_nvme_attach_controller", 00:17:55.473 "req_id": 1 00:17:55.473 } 00:17:55.473 Got JSON-RPC error response 00:17:55.473 response: 00:17:55.473 { 00:17:55.473 "code": -32602, 00:17:55.473 "message": "Invalid parameters" 00:17:55.473 } 00:17:55.473 01:53:43 -- target/tls.sh@36 -- # killprocess 3462476 00:17:55.473 01:53:43 -- common/autotest_common.sh@936 -- # '[' -z 3462476 ']' 00:17:55.473 01:53:43 -- common/autotest_common.sh@940 -- # kill -0 3462476 00:17:55.473 01:53:43 -- common/autotest_common.sh@941 -- # uname 00:17:55.473 01:53:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:55.473 01:53:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3462476 00:17:55.732 01:53:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:55.732 01:53:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:55.732 01:53:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3462476' 00:17:55.732 killing process with pid 3462476 00:17:55.732 01:53:44 -- common/autotest_common.sh@955 -- # kill 3462476 00:17:55.732 Received shutdown signal, test time was about 10.000000 seconds 00:17:55.732 00:17:55.732 Latency(us) 00:17:55.732 [2024-11-19T00:53:44.275Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:55.732 [2024-11-19T00:53:44.275Z] =================================================================================================================== 00:17:55.732 [2024-11-19T00:53:44.275Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:55.732 01:53:44 -- common/autotest_common.sh@960 -- # wait 3462476 00:17:55.732 01:53:44 -- target/tls.sh@37 -- # return 1 00:17:55.732 01:53:44 -- common/autotest_common.sh@653 -- # es=1 00:17:55.732 01:53:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:55.732 01:53:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:55.732 01:53:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:55.732 01:53:44 -- target/tls.sh@167 -- # killprocess 3458480 00:17:55.732 01:53:44 -- common/autotest_common.sh@936 -- # '[' -z 3458480 ']' 00:17:55.732 01:53:44 -- common/autotest_common.sh@940 -- # kill -0 3458480 00:17:55.732 01:53:44 -- common/autotest_common.sh@941 -- # uname 00:17:55.990 01:53:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:55.990 01:53:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3458480 00:17:55.990 01:53:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:55.990 01:53:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:55.990 01:53:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3458480' 00:17:55.990 killing process with pid 3458480 00:17:55.990 01:53:44 -- common/autotest_common.sh@955 -- # kill 3458480 00:17:55.990 01:53:44 -- common/autotest_common.sh@960 -- # wait 3458480 00:17:56.248 01:53:44 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:56.248 01:53:44 -- target/tls.sh@49 -- # local key hash crc 00:17:56.248 01:53:44 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:56.248 01:53:44 -- target/tls.sh@51 -- # hash=02 00:17:56.248 01:53:44 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:56.248 01:53:44 -- target/tls.sh@52 -- # gzip -1 -c 00:17:56.248 01:53:44 -- target/tls.sh@52 -- # tail -c8 00:17:56.248 01:53:44 -- target/tls.sh@52 -- # head -c 4 00:17:56.248 01:53:44 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:56.248 01:53:44 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:56.248 01:53:44 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:56.248 01:53:44 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.248 01:53:44 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.248 01:53:44 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.248 01:53:44 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.248 01:53:44 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.248 01:53:44 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:56.248 01:53:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:56.248 01:53:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:56.248 01:53:44 -- common/autotest_common.sh@10 -- # set +x 00:17:56.248 01:53:44 -- nvmf/common.sh@469 -- # nvmfpid=3462680 00:17:56.248 01:53:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:56.248 01:53:44 -- nvmf/common.sh@470 -- # waitforlisten 3462680 00:17:56.248 01:53:44 -- common/autotest_common.sh@829 -- # '[' -z 3462680 ']' 00:17:56.248 01:53:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:56.248 01:53:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:56.248 01:53:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:56.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:56.248 01:53:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:56.248 01:53:44 -- common/autotest_common.sh@10 -- # set +x 00:17:56.248 [2024-11-19 01:53:44.675880] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:56.248 [2024-11-19 01:53:44.675972] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:56.248 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.248 [2024-11-19 01:53:44.749355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.506 [2024-11-19 01:53:44.868126] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:56.506 [2024-11-19 01:53:44.868260] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:56.506 [2024-11-19 01:53:44.868278] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:56.506 [2024-11-19 01:53:44.868291] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:56.506 [2024-11-19 01:53:44.868318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:57.439 01:53:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:57.439 01:53:45 -- common/autotest_common.sh@862 -- # return 0 00:17:57.439 01:53:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:57.439 01:53:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:57.439 01:53:45 -- common/autotest_common.sh@10 -- # set +x 00:17:57.439 01:53:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:57.439 01:53:45 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.439 01:53:45 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.439 01:53:45 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:57.697 [2024-11-19 01:53:46.035294] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:57.697 01:53:46 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:57.954 01:53:46 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:58.212 [2024-11-19 01:53:46.580813] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:58.212 [2024-11-19 01:53:46.581081] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:58.212 01:53:46 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:58.470 malloc0 00:17:58.470 01:53:46 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:58.729 01:53:47 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.987 01:53:47 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.987 01:53:47 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:58.987 01:53:47 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:58.987 01:53:47 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:58.987 01:53:47 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:58.987 01:53:47 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:58.987 01:53:47 -- target/tls.sh@28 -- # bdevperf_pid=3463104 00:17:58.987 01:53:47 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:58.987 01:53:47 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:58.987 01:53:47 -- target/tls.sh@31 -- # waitforlisten 3463104 /var/tmp/bdevperf.sock 00:17:58.987 01:53:47 -- common/autotest_common.sh@829 -- # '[' -z 3463104 ']' 00:17:58.987 01:53:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:58.987 01:53:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:58.987 01:53:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:58.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:58.987 01:53:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:58.987 01:53:47 -- common/autotest_common.sh@10 -- # set +x 00:17:58.987 [2024-11-19 01:53:47.377193] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:58.987 [2024-11-19 01:53:47.377278] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3463104 ] 00:17:58.987 EAL: No free 2048 kB hugepages reported on node 1 00:17:58.987 [2024-11-19 01:53:47.433687] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.244 [2024-11-19 01:53:47.537274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:59.808 01:53:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:59.809 01:53:48 -- common/autotest_common.sh@862 -- # return 0 00:17:59.809 01:53:48 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:00.066 [2024-11-19 01:53:48.559189] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:00.324 TLSTESTn1 00:18:00.324 01:53:48 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:00.324 Running I/O for 10 seconds... 00:18:10.291 00:18:10.291 Latency(us) 00:18:10.291 [2024-11-19T00:53:58.834Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.291 [2024-11-19T00:53:58.834Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:10.291 Verification LBA range: start 0x0 length 0x2000 00:18:10.291 TLSTESTn1 : 10.01 4743.90 18.53 0.00 0.00 26945.82 4174.89 44661.57 00:18:10.291 [2024-11-19T00:53:58.834Z] =================================================================================================================== 00:18:10.291 [2024-11-19T00:53:58.834Z] Total : 4743.90 18.53 0.00 0.00 26945.82 4174.89 44661.57 00:18:10.291 0 00:18:10.291 01:53:58 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:10.291 01:53:58 -- target/tls.sh@45 -- # killprocess 3463104 00:18:10.291 01:53:58 -- common/autotest_common.sh@936 -- # '[' -z 3463104 ']' 00:18:10.291 01:53:58 -- common/autotest_common.sh@940 -- # kill -0 3463104 00:18:10.291 01:53:58 -- common/autotest_common.sh@941 -- # uname 00:18:10.291 01:53:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:10.291 01:53:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3463104 00:18:10.291 01:53:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:10.291 01:53:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:10.291 01:53:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3463104' 00:18:10.291 killing process with pid 3463104 00:18:10.291 01:53:58 -- common/autotest_common.sh@955 -- # kill 3463104 00:18:10.291 Received shutdown signal, test time was about 10.000000 seconds 00:18:10.291 00:18:10.292 Latency(us) 00:18:10.292 [2024-11-19T00:53:58.835Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.292 [2024-11-19T00:53:58.835Z] =================================================================================================================== 00:18:10.292 [2024-11-19T00:53:58.835Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:10.292 01:53:58 -- common/autotest_common.sh@960 -- # wait 3463104 00:18:10.550 01:53:59 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.550 01:53:59 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.550 01:53:59 -- common/autotest_common.sh@650 -- # local es=0 00:18:10.550 01:53:59 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.550 01:53:59 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:10.550 01:53:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.550 01:53:59 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:10.550 01:53:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.550 01:53:59 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.550 01:53:59 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:10.550 01:53:59 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:10.550 01:53:59 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:10.550 01:53:59 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:10.550 01:53:59 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:10.550 01:53:59 -- target/tls.sh@28 -- # bdevperf_pid=3464478 00:18:10.550 01:53:59 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:10.550 01:53:59 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:10.550 01:53:59 -- target/tls.sh@31 -- # waitforlisten 3464478 /var/tmp/bdevperf.sock 00:18:10.550 01:53:59 -- common/autotest_common.sh@829 -- # '[' -z 3464478 ']' 00:18:10.550 01:53:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:10.550 01:53:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:10.550 01:53:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:10.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:10.550 01:53:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:10.550 01:53:59 -- common/autotest_common.sh@10 -- # set +x 00:18:10.813 [2024-11-19 01:53:59.116948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:10.813 [2024-11-19 01:53:59.117018] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3464478 ] 00:18:10.813 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.813 [2024-11-19 01:53:59.175750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:10.813 [2024-11-19 01:53:59.279591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:11.751 01:54:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:11.752 01:54:00 -- common/autotest_common.sh@862 -- # return 0 00:18:11.752 01:54:00 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.010 [2024-11-19 01:54:00.417881] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:12.010 [2024-11-19 01:54:00.417929] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:12.010 request: 00:18:12.010 { 00:18:12.010 "name": "TLSTEST", 00:18:12.010 "trtype": "tcp", 00:18:12.010 "traddr": "10.0.0.2", 00:18:12.010 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:12.010 "adrfam": "ipv4", 00:18:12.010 "trsvcid": "4420", 00:18:12.010 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:12.010 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:12.010 "method": "bdev_nvme_attach_controller", 00:18:12.010 "req_id": 1 00:18:12.010 } 00:18:12.010 Got JSON-RPC error response 00:18:12.010 response: 00:18:12.010 { 00:18:12.010 "code": -22, 00:18:12.010 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:12.010 } 00:18:12.010 01:54:00 -- target/tls.sh@36 -- # killprocess 3464478 00:18:12.010 01:54:00 -- common/autotest_common.sh@936 -- # '[' -z 3464478 ']' 00:18:12.010 01:54:00 -- common/autotest_common.sh@940 -- # kill -0 3464478 00:18:12.010 01:54:00 -- common/autotest_common.sh@941 -- # uname 00:18:12.010 01:54:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.010 01:54:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3464478 00:18:12.010 01:54:00 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:12.010 01:54:00 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:12.010 01:54:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3464478' 00:18:12.010 killing process with pid 3464478 00:18:12.010 01:54:00 -- common/autotest_common.sh@955 -- # kill 3464478 00:18:12.010 Received shutdown signal, test time was about 10.000000 seconds 00:18:12.010 00:18:12.010 Latency(us) 00:18:12.010 [2024-11-19T00:54:00.553Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.010 [2024-11-19T00:54:00.553Z] =================================================================================================================== 00:18:12.010 [2024-11-19T00:54:00.553Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:12.010 01:54:00 -- common/autotest_common.sh@960 -- # wait 3464478 00:18:12.268 01:54:00 -- target/tls.sh@37 -- # return 1 00:18:12.268 01:54:00 -- common/autotest_common.sh@653 -- # es=1 00:18:12.268 01:54:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:12.268 01:54:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:12.268 01:54:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:12.268 01:54:00 -- target/tls.sh@183 -- # killprocess 3462680 00:18:12.268 01:54:00 -- common/autotest_common.sh@936 -- # '[' -z 3462680 ']' 00:18:12.268 01:54:00 -- common/autotest_common.sh@940 -- # kill -0 3462680 00:18:12.268 01:54:00 -- common/autotest_common.sh@941 -- # uname 00:18:12.268 01:54:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.268 01:54:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3462680 00:18:12.268 01:54:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:12.268 01:54:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:12.268 01:54:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3462680' 00:18:12.268 killing process with pid 3462680 00:18:12.268 01:54:00 -- common/autotest_common.sh@955 -- # kill 3462680 00:18:12.268 01:54:00 -- common/autotest_common.sh@960 -- # wait 3462680 00:18:12.526 01:54:01 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:12.526 01:54:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:12.526 01:54:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:12.526 01:54:01 -- common/autotest_common.sh@10 -- # set +x 00:18:12.526 01:54:01 -- nvmf/common.sh@469 -- # nvmfpid=3464824 00:18:12.526 01:54:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:12.526 01:54:01 -- nvmf/common.sh@470 -- # waitforlisten 3464824 00:18:12.526 01:54:01 -- common/autotest_common.sh@829 -- # '[' -z 3464824 ']' 00:18:12.526 01:54:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:12.526 01:54:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:12.526 01:54:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:12.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:12.526 01:54:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:12.526 01:54:01 -- common/autotest_common.sh@10 -- # set +x 00:18:12.784 [2024-11-19 01:54:01.097751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:12.784 [2024-11-19 01:54:01.097832] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:12.784 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.784 [2024-11-19 01:54:01.163857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:12.784 [2024-11-19 01:54:01.280270] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:12.784 [2024-11-19 01:54:01.280404] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:12.784 [2024-11-19 01:54:01.280421] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:12.784 [2024-11-19 01:54:01.280440] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:12.784 [2024-11-19 01:54:01.280466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:13.716 01:54:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:13.716 01:54:02 -- common/autotest_common.sh@862 -- # return 0 00:18:13.716 01:54:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:13.716 01:54:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:13.716 01:54:02 -- common/autotest_common.sh@10 -- # set +x 00:18:13.716 01:54:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:13.716 01:54:02 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.716 01:54:02 -- common/autotest_common.sh@650 -- # local es=0 00:18:13.716 01:54:02 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.716 01:54:02 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:13.716 01:54:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:13.716 01:54:02 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:13.716 01:54:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:13.716 01:54:02 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.716 01:54:02 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.716 01:54:02 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:13.974 [2024-11-19 01:54:02.320440] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:13.974 01:54:02 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:14.231 01:54:02 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:14.489 [2024-11-19 01:54:02.825797] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:14.489 [2024-11-19 01:54:02.826028] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:14.489 01:54:02 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:14.748 malloc0 00:18:14.748 01:54:03 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:15.005 01:54:03 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.263 [2024-11-19 01:54:03.600471] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:15.264 [2024-11-19 01:54:03.600512] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:15.264 [2024-11-19 01:54:03.600537] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:15.264 request: 00:18:15.264 { 00:18:15.264 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.264 "host": "nqn.2016-06.io.spdk:host1", 00:18:15.264 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:15.264 "method": "nvmf_subsystem_add_host", 00:18:15.264 "req_id": 1 00:18:15.264 } 00:18:15.264 Got JSON-RPC error response 00:18:15.264 response: 00:18:15.264 { 00:18:15.264 "code": -32603, 00:18:15.264 "message": "Internal error" 00:18:15.264 } 00:18:15.264 01:54:03 -- common/autotest_common.sh@653 -- # es=1 00:18:15.264 01:54:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:15.264 01:54:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:15.264 01:54:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:15.264 01:54:03 -- target/tls.sh@189 -- # killprocess 3464824 00:18:15.264 01:54:03 -- common/autotest_common.sh@936 -- # '[' -z 3464824 ']' 00:18:15.264 01:54:03 -- common/autotest_common.sh@940 -- # kill -0 3464824 00:18:15.264 01:54:03 -- common/autotest_common.sh@941 -- # uname 00:18:15.264 01:54:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.264 01:54:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3464824 00:18:15.264 01:54:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:15.264 01:54:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:15.264 01:54:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3464824' 00:18:15.264 killing process with pid 3464824 00:18:15.264 01:54:03 -- common/autotest_common.sh@955 -- # kill 3464824 00:18:15.264 01:54:03 -- common/autotest_common.sh@960 -- # wait 3464824 00:18:15.522 01:54:03 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.522 01:54:03 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:15.522 01:54:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:15.522 01:54:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:15.522 01:54:03 -- common/autotest_common.sh@10 -- # set +x 00:18:15.522 01:54:03 -- nvmf/common.sh@469 -- # nvmfpid=3465190 00:18:15.522 01:54:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:15.522 01:54:03 -- nvmf/common.sh@470 -- # waitforlisten 3465190 00:18:15.522 01:54:03 -- common/autotest_common.sh@829 -- # '[' -z 3465190 ']' 00:18:15.522 01:54:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:15.522 01:54:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:15.522 01:54:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:15.522 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:15.522 01:54:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:15.522 01:54:03 -- common/autotest_common.sh@10 -- # set +x 00:18:15.522 [2024-11-19 01:54:03.981772] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:15.522 [2024-11-19 01:54:03.981859] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:15.522 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.522 [2024-11-19 01:54:04.054671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.781 [2024-11-19 01:54:04.174402] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:15.781 [2024-11-19 01:54:04.174555] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:15.781 [2024-11-19 01:54:04.174575] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:15.781 [2024-11-19 01:54:04.174590] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:15.781 [2024-11-19 01:54:04.174647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:16.714 01:54:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:16.714 01:54:04 -- common/autotest_common.sh@862 -- # return 0 00:18:16.714 01:54:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:16.715 01:54:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:16.715 01:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:16.715 01:54:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:16.715 01:54:04 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.715 01:54:04 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.715 01:54:04 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:16.715 [2024-11-19 01:54:05.227485] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:16.715 01:54:05 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:17.281 01:54:05 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:17.281 [2024-11-19 01:54:05.776964] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:17.281 [2024-11-19 01:54:05.777216] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:17.281 01:54:05 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:17.847 malloc0 00:18:17.847 01:54:06 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:17.847 01:54:06 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:18.469 01:54:06 -- target/tls.sh@197 -- # bdevperf_pid=3465608 00:18:18.469 01:54:06 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:18.469 01:54:06 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:18.469 01:54:06 -- target/tls.sh@200 -- # waitforlisten 3465608 /var/tmp/bdevperf.sock 00:18:18.469 01:54:06 -- common/autotest_common.sh@829 -- # '[' -z 3465608 ']' 00:18:18.469 01:54:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:18.469 01:54:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.469 01:54:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:18.469 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:18.469 01:54:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.469 01:54:06 -- common/autotest_common.sh@10 -- # set +x 00:18:18.469 [2024-11-19 01:54:06.732048] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.469 [2024-11-19 01:54:06.732127] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3465608 ] 00:18:18.469 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.469 [2024-11-19 01:54:06.798580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.469 [2024-11-19 01:54:06.917112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:19.431 01:54:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:19.431 01:54:07 -- common/autotest_common.sh@862 -- # return 0 00:18:19.431 01:54:07 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:19.431 [2024-11-19 01:54:07.960465] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:19.689 TLSTESTn1 00:18:19.689 01:54:08 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:19.947 01:54:08 -- target/tls.sh@205 -- # tgtconf='{ 00:18:19.947 "subsystems": [ 00:18:19.947 { 00:18:19.947 "subsystem": "iobuf", 00:18:19.947 "config": [ 00:18:19.947 { 00:18:19.947 "method": "iobuf_set_options", 00:18:19.947 "params": { 00:18:19.947 "small_pool_count": 8192, 00:18:19.947 "large_pool_count": 1024, 00:18:19.947 "small_bufsize": 8192, 00:18:19.947 "large_bufsize": 135168 00:18:19.947 } 00:18:19.947 } 00:18:19.947 ] 00:18:19.947 }, 00:18:19.947 { 00:18:19.947 "subsystem": "sock", 00:18:19.947 "config": [ 00:18:19.947 { 00:18:19.947 "method": "sock_impl_set_options", 00:18:19.947 "params": { 00:18:19.947 "impl_name": "posix", 00:18:19.947 "recv_buf_size": 2097152, 00:18:19.947 "send_buf_size": 2097152, 00:18:19.947 "enable_recv_pipe": true, 00:18:19.947 "enable_quickack": false, 00:18:19.947 "enable_placement_id": 0, 00:18:19.948 "enable_zerocopy_send_server": true, 00:18:19.948 "enable_zerocopy_send_client": false, 00:18:19.948 "zerocopy_threshold": 0, 00:18:19.948 "tls_version": 0, 00:18:19.948 "enable_ktls": false 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "sock_impl_set_options", 00:18:19.948 "params": { 00:18:19.948 "impl_name": "ssl", 00:18:19.948 "recv_buf_size": 4096, 00:18:19.948 "send_buf_size": 4096, 00:18:19.948 "enable_recv_pipe": true, 00:18:19.948 "enable_quickack": false, 00:18:19.948 "enable_placement_id": 0, 00:18:19.948 "enable_zerocopy_send_server": true, 00:18:19.948 "enable_zerocopy_send_client": false, 00:18:19.948 "zerocopy_threshold": 0, 00:18:19.948 "tls_version": 0, 00:18:19.948 "enable_ktls": false 00:18:19.948 } 00:18:19.948 } 00:18:19.948 ] 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "subsystem": "vmd", 00:18:19.948 "config": [] 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "subsystem": "accel", 00:18:19.948 "config": [ 00:18:19.948 { 00:18:19.948 "method": "accel_set_options", 00:18:19.948 "params": { 00:18:19.948 "small_cache_size": 128, 00:18:19.948 "large_cache_size": 16, 00:18:19.948 "task_count": 2048, 00:18:19.948 "sequence_count": 2048, 00:18:19.948 "buf_count": 2048 00:18:19.948 } 00:18:19.948 } 00:18:19.948 ] 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "subsystem": "bdev", 00:18:19.948 "config": [ 00:18:19.948 { 00:18:19.948 "method": "bdev_set_options", 00:18:19.948 "params": { 00:18:19.948 "bdev_io_pool_size": 65535, 00:18:19.948 "bdev_io_cache_size": 256, 00:18:19.948 "bdev_auto_examine": true, 00:18:19.948 "iobuf_small_cache_size": 128, 00:18:19.948 "iobuf_large_cache_size": 16 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "bdev_raid_set_options", 00:18:19.948 "params": { 00:18:19.948 "process_window_size_kb": 1024 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "bdev_iscsi_set_options", 00:18:19.948 "params": { 00:18:19.948 "timeout_sec": 30 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "bdev_nvme_set_options", 00:18:19.948 "params": { 00:18:19.948 "action_on_timeout": "none", 00:18:19.948 "timeout_us": 0, 00:18:19.948 "timeout_admin_us": 0, 00:18:19.948 "keep_alive_timeout_ms": 10000, 00:18:19.948 "transport_retry_count": 4, 00:18:19.948 "arbitration_burst": 0, 00:18:19.948 "low_priority_weight": 0, 00:18:19.948 "medium_priority_weight": 0, 00:18:19.948 "high_priority_weight": 0, 00:18:19.948 "nvme_adminq_poll_period_us": 10000, 00:18:19.948 "nvme_ioq_poll_period_us": 0, 00:18:19.948 "io_queue_requests": 0, 00:18:19.948 "delay_cmd_submit": true, 00:18:19.948 "bdev_retry_count": 3, 00:18:19.948 "transport_ack_timeout": 0, 00:18:19.948 "ctrlr_loss_timeout_sec": 0, 00:18:19.948 "reconnect_delay_sec": 0, 00:18:19.948 "fast_io_fail_timeout_sec": 0, 00:18:19.948 "generate_uuids": false, 00:18:19.948 "transport_tos": 0, 00:18:19.948 "io_path_stat": false, 00:18:19.948 "allow_accel_sequence": false 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "bdev_nvme_set_hotplug", 00:18:19.948 "params": { 00:18:19.948 "period_us": 100000, 00:18:19.948 "enable": false 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "bdev_malloc_create", 00:18:19.948 "params": { 00:18:19.948 "name": "malloc0", 00:18:19.948 "num_blocks": 8192, 00:18:19.948 "block_size": 4096, 00:18:19.948 "physical_block_size": 4096, 00:18:19.948 "uuid": "6eb58f19-21c3-47eb-9160-2644dae8b7c6", 00:18:19.948 "optimal_io_boundary": 0 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "bdev_wait_for_examine" 00:18:19.948 } 00:18:19.948 ] 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "subsystem": "nbd", 00:18:19.948 "config": [] 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "subsystem": "scheduler", 00:18:19.948 "config": [ 00:18:19.948 { 00:18:19.948 "method": "framework_set_scheduler", 00:18:19.948 "params": { 00:18:19.948 "name": "static" 00:18:19.948 } 00:18:19.948 } 00:18:19.948 ] 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "subsystem": "nvmf", 00:18:19.948 "config": [ 00:18:19.948 { 00:18:19.948 "method": "nvmf_set_config", 00:18:19.948 "params": { 00:18:19.948 "discovery_filter": "match_any", 00:18:19.948 "admin_cmd_passthru": { 00:18:19.948 "identify_ctrlr": false 00:18:19.948 } 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "nvmf_set_max_subsystems", 00:18:19.948 "params": { 00:18:19.948 "max_subsystems": 1024 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "nvmf_set_crdt", 00:18:19.948 "params": { 00:18:19.948 "crdt1": 0, 00:18:19.948 "crdt2": 0, 00:18:19.948 "crdt3": 0 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "nvmf_create_transport", 00:18:19.948 "params": { 00:18:19.948 "trtype": "TCP", 00:18:19.948 "max_queue_depth": 128, 00:18:19.948 "max_io_qpairs_per_ctrlr": 127, 00:18:19.948 "in_capsule_data_size": 4096, 00:18:19.948 "max_io_size": 131072, 00:18:19.948 "io_unit_size": 131072, 00:18:19.948 "max_aq_depth": 128, 00:18:19.948 "num_shared_buffers": 511, 00:18:19.948 "buf_cache_size": 4294967295, 00:18:19.948 "dif_insert_or_strip": false, 00:18:19.948 "zcopy": false, 00:18:19.948 "c2h_success": false, 00:18:19.948 "sock_priority": 0, 00:18:19.948 "abort_timeout_sec": 1 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "nvmf_create_subsystem", 00:18:19.948 "params": { 00:18:19.948 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.948 "allow_any_host": false, 00:18:19.948 "serial_number": "SPDK00000000000001", 00:18:19.948 "model_number": "SPDK bdev Controller", 00:18:19.948 "max_namespaces": 10, 00:18:19.948 "min_cntlid": 1, 00:18:19.948 "max_cntlid": 65519, 00:18:19.948 "ana_reporting": false 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "nvmf_subsystem_add_host", 00:18:19.948 "params": { 00:18:19.948 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.948 "host": "nqn.2016-06.io.spdk:host1", 00:18:19.948 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:19.948 } 00:18:19.948 }, 00:18:19.948 { 00:18:19.948 "method": "nvmf_subsystem_add_ns", 00:18:19.948 "params": { 00:18:19.948 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.948 "namespace": { 00:18:19.948 "nsid": 1, 00:18:19.948 "bdev_name": "malloc0", 00:18:19.949 "nguid": "6EB58F1921C347EB91602644DAE8B7C6", 00:18:19.949 "uuid": "6eb58f19-21c3-47eb-9160-2644dae8b7c6" 00:18:19.949 } 00:18:19.949 } 00:18:19.949 }, 00:18:19.949 { 00:18:19.949 "method": "nvmf_subsystem_add_listener", 00:18:19.949 "params": { 00:18:19.949 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.949 "listen_address": { 00:18:19.949 "trtype": "TCP", 00:18:19.949 "adrfam": "IPv4", 00:18:19.949 "traddr": "10.0.0.2", 00:18:19.949 "trsvcid": "4420" 00:18:19.949 }, 00:18:19.949 "secure_channel": true 00:18:19.949 } 00:18:19.949 } 00:18:19.949 ] 00:18:19.949 } 00:18:19.949 ] 00:18:19.949 }' 00:18:19.949 01:54:08 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:20.207 01:54:08 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:20.207 "subsystems": [ 00:18:20.207 { 00:18:20.207 "subsystem": "iobuf", 00:18:20.207 "config": [ 00:18:20.207 { 00:18:20.207 "method": "iobuf_set_options", 00:18:20.207 "params": { 00:18:20.207 "small_pool_count": 8192, 00:18:20.207 "large_pool_count": 1024, 00:18:20.207 "small_bufsize": 8192, 00:18:20.207 "large_bufsize": 135168 00:18:20.207 } 00:18:20.207 } 00:18:20.207 ] 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "subsystem": "sock", 00:18:20.207 "config": [ 00:18:20.207 { 00:18:20.207 "method": "sock_impl_set_options", 00:18:20.207 "params": { 00:18:20.207 "impl_name": "posix", 00:18:20.207 "recv_buf_size": 2097152, 00:18:20.207 "send_buf_size": 2097152, 00:18:20.207 "enable_recv_pipe": true, 00:18:20.207 "enable_quickack": false, 00:18:20.207 "enable_placement_id": 0, 00:18:20.207 "enable_zerocopy_send_server": true, 00:18:20.207 "enable_zerocopy_send_client": false, 00:18:20.207 "zerocopy_threshold": 0, 00:18:20.207 "tls_version": 0, 00:18:20.207 "enable_ktls": false 00:18:20.207 } 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "method": "sock_impl_set_options", 00:18:20.207 "params": { 00:18:20.207 "impl_name": "ssl", 00:18:20.207 "recv_buf_size": 4096, 00:18:20.207 "send_buf_size": 4096, 00:18:20.207 "enable_recv_pipe": true, 00:18:20.207 "enable_quickack": false, 00:18:20.207 "enable_placement_id": 0, 00:18:20.207 "enable_zerocopy_send_server": true, 00:18:20.207 "enable_zerocopy_send_client": false, 00:18:20.207 "zerocopy_threshold": 0, 00:18:20.207 "tls_version": 0, 00:18:20.207 "enable_ktls": false 00:18:20.207 } 00:18:20.207 } 00:18:20.207 ] 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "subsystem": "vmd", 00:18:20.207 "config": [] 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "subsystem": "accel", 00:18:20.207 "config": [ 00:18:20.207 { 00:18:20.207 "method": "accel_set_options", 00:18:20.207 "params": { 00:18:20.207 "small_cache_size": 128, 00:18:20.207 "large_cache_size": 16, 00:18:20.207 "task_count": 2048, 00:18:20.207 "sequence_count": 2048, 00:18:20.207 "buf_count": 2048 00:18:20.207 } 00:18:20.207 } 00:18:20.207 ] 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "subsystem": "bdev", 00:18:20.207 "config": [ 00:18:20.207 { 00:18:20.207 "method": "bdev_set_options", 00:18:20.207 "params": { 00:18:20.207 "bdev_io_pool_size": 65535, 00:18:20.207 "bdev_io_cache_size": 256, 00:18:20.207 "bdev_auto_examine": true, 00:18:20.207 "iobuf_small_cache_size": 128, 00:18:20.207 "iobuf_large_cache_size": 16 00:18:20.207 } 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "method": "bdev_raid_set_options", 00:18:20.207 "params": { 00:18:20.207 "process_window_size_kb": 1024 00:18:20.207 } 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "method": "bdev_iscsi_set_options", 00:18:20.207 "params": { 00:18:20.207 "timeout_sec": 30 00:18:20.207 } 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "method": "bdev_nvme_set_options", 00:18:20.207 "params": { 00:18:20.207 "action_on_timeout": "none", 00:18:20.207 "timeout_us": 0, 00:18:20.207 "timeout_admin_us": 0, 00:18:20.207 "keep_alive_timeout_ms": 10000, 00:18:20.207 "transport_retry_count": 4, 00:18:20.207 "arbitration_burst": 0, 00:18:20.207 "low_priority_weight": 0, 00:18:20.207 "medium_priority_weight": 0, 00:18:20.207 "high_priority_weight": 0, 00:18:20.207 "nvme_adminq_poll_period_us": 10000, 00:18:20.207 "nvme_ioq_poll_period_us": 0, 00:18:20.207 "io_queue_requests": 512, 00:18:20.207 "delay_cmd_submit": true, 00:18:20.207 "bdev_retry_count": 3, 00:18:20.207 "transport_ack_timeout": 0, 00:18:20.207 "ctrlr_loss_timeout_sec": 0, 00:18:20.207 "reconnect_delay_sec": 0, 00:18:20.207 "fast_io_fail_timeout_sec": 0, 00:18:20.207 "generate_uuids": false, 00:18:20.207 "transport_tos": 0, 00:18:20.207 "io_path_stat": false, 00:18:20.207 "allow_accel_sequence": false 00:18:20.207 } 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "method": "bdev_nvme_attach_controller", 00:18:20.207 "params": { 00:18:20.207 "name": "TLSTEST", 00:18:20.207 "trtype": "TCP", 00:18:20.207 "adrfam": "IPv4", 00:18:20.207 "traddr": "10.0.0.2", 00:18:20.207 "trsvcid": "4420", 00:18:20.207 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.207 "prchk_reftag": false, 00:18:20.207 "prchk_guard": false, 00:18:20.207 "ctrlr_loss_timeout_sec": 0, 00:18:20.207 "reconnect_delay_sec": 0, 00:18:20.207 "fast_io_fail_timeout_sec": 0, 00:18:20.207 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:20.207 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:20.207 "hdgst": false, 00:18:20.207 "ddgst": false 00:18:20.207 } 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "method": "bdev_nvme_set_hotplug", 00:18:20.207 "params": { 00:18:20.207 "period_us": 100000, 00:18:20.207 "enable": false 00:18:20.207 } 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "method": "bdev_wait_for_examine" 00:18:20.207 } 00:18:20.207 ] 00:18:20.207 }, 00:18:20.207 { 00:18:20.207 "subsystem": "nbd", 00:18:20.207 "config": [] 00:18:20.207 } 00:18:20.207 ] 00:18:20.207 }' 00:18:20.207 01:54:08 -- target/tls.sh@208 -- # killprocess 3465608 00:18:20.207 01:54:08 -- common/autotest_common.sh@936 -- # '[' -z 3465608 ']' 00:18:20.207 01:54:08 -- common/autotest_common.sh@940 -- # kill -0 3465608 00:18:20.207 01:54:08 -- common/autotest_common.sh@941 -- # uname 00:18:20.207 01:54:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.207 01:54:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3465608 00:18:20.207 01:54:08 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:20.207 01:54:08 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:20.207 01:54:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3465608' 00:18:20.207 killing process with pid 3465608 00:18:20.208 01:54:08 -- common/autotest_common.sh@955 -- # kill 3465608 00:18:20.208 Received shutdown signal, test time was about 10.000000 seconds 00:18:20.208 00:18:20.208 Latency(us) 00:18:20.208 [2024-11-19T00:54:08.751Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.208 [2024-11-19T00:54:08.751Z] =================================================================================================================== 00:18:20.208 [2024-11-19T00:54:08.751Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:20.208 01:54:08 -- common/autotest_common.sh@960 -- # wait 3465608 00:18:20.466 01:54:08 -- target/tls.sh@209 -- # killprocess 3465190 00:18:20.466 01:54:08 -- common/autotest_common.sh@936 -- # '[' -z 3465190 ']' 00:18:20.466 01:54:08 -- common/autotest_common.sh@940 -- # kill -0 3465190 00:18:20.466 01:54:08 -- common/autotest_common.sh@941 -- # uname 00:18:20.466 01:54:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.466 01:54:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3465190 00:18:20.466 01:54:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:20.466 01:54:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:20.466 01:54:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3465190' 00:18:20.466 killing process with pid 3465190 00:18:20.466 01:54:08 -- common/autotest_common.sh@955 -- # kill 3465190 00:18:20.466 01:54:09 -- common/autotest_common.sh@960 -- # wait 3465190 00:18:21.033 01:54:09 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:21.033 01:54:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:21.033 01:54:09 -- target/tls.sh@212 -- # echo '{ 00:18:21.033 "subsystems": [ 00:18:21.033 { 00:18:21.033 "subsystem": "iobuf", 00:18:21.033 "config": [ 00:18:21.033 { 00:18:21.033 "method": "iobuf_set_options", 00:18:21.033 "params": { 00:18:21.033 "small_pool_count": 8192, 00:18:21.033 "large_pool_count": 1024, 00:18:21.033 "small_bufsize": 8192, 00:18:21.033 "large_bufsize": 135168 00:18:21.033 } 00:18:21.033 } 00:18:21.033 ] 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "subsystem": "sock", 00:18:21.033 "config": [ 00:18:21.033 { 00:18:21.033 "method": "sock_impl_set_options", 00:18:21.033 "params": { 00:18:21.033 "impl_name": "posix", 00:18:21.033 "recv_buf_size": 2097152, 00:18:21.033 "send_buf_size": 2097152, 00:18:21.033 "enable_recv_pipe": true, 00:18:21.033 "enable_quickack": false, 00:18:21.033 "enable_placement_id": 0, 00:18:21.033 "enable_zerocopy_send_server": true, 00:18:21.033 "enable_zerocopy_send_client": false, 00:18:21.033 "zerocopy_threshold": 0, 00:18:21.033 "tls_version": 0, 00:18:21.033 "enable_ktls": false 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "sock_impl_set_options", 00:18:21.033 "params": { 00:18:21.033 "impl_name": "ssl", 00:18:21.033 "recv_buf_size": 4096, 00:18:21.033 "send_buf_size": 4096, 00:18:21.033 "enable_recv_pipe": true, 00:18:21.033 "enable_quickack": false, 00:18:21.033 "enable_placement_id": 0, 00:18:21.033 "enable_zerocopy_send_server": true, 00:18:21.033 "enable_zerocopy_send_client": false, 00:18:21.033 "zerocopy_threshold": 0, 00:18:21.033 "tls_version": 0, 00:18:21.033 "enable_ktls": false 00:18:21.033 } 00:18:21.033 } 00:18:21.033 ] 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "subsystem": "vmd", 00:18:21.033 "config": [] 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "subsystem": "accel", 00:18:21.033 "config": [ 00:18:21.033 { 00:18:21.033 "method": "accel_set_options", 00:18:21.033 "params": { 00:18:21.033 "small_cache_size": 128, 00:18:21.033 "large_cache_size": 16, 00:18:21.033 "task_count": 2048, 00:18:21.033 "sequence_count": 2048, 00:18:21.033 "buf_count": 2048 00:18:21.033 } 00:18:21.033 } 00:18:21.033 ] 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "subsystem": "bdev", 00:18:21.033 "config": [ 00:18:21.033 { 00:18:21.033 "method": "bdev_set_options", 00:18:21.033 "params": { 00:18:21.033 "bdev_io_pool_size": 65535, 00:18:21.033 "bdev_io_cache_size": 256, 00:18:21.033 "bdev_auto_examine": true, 00:18:21.033 "iobuf_small_cache_size": 128, 00:18:21.033 "iobuf_large_cache_size": 16 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "bdev_raid_set_options", 00:18:21.033 "params": { 00:18:21.033 "process_window_size_kb": 1024 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "bdev_iscsi_set_options", 00:18:21.033 "params": { 00:18:21.033 "timeout_sec": 30 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "bdev_nvme_set_options", 00:18:21.033 "params": { 00:18:21.033 "action_on_timeout": "none", 00:18:21.033 "timeout_us": 0, 00:18:21.033 "timeout_admin_us": 0, 00:18:21.033 "keep_alive_timeout_ms": 10000, 00:18:21.033 "transport_retry_count": 4, 00:18:21.033 "arbitration_burst": 0, 00:18:21.033 "low_priority_weight": 0, 00:18:21.033 "medium_priority_weight": 0, 00:18:21.033 "high_priority_weight": 0, 00:18:21.033 "nvme_adminq_poll_period_us": 10000, 00:18:21.033 "nvme_ioq_poll_period_us": 0, 00:18:21.033 "io_queue_requests": 0, 00:18:21.033 "delay_cmd_submit": true, 00:18:21.033 "bdev_retry_count": 3, 00:18:21.033 "transport_ack_timeout": 0, 00:18:21.033 "ctrlr_loss_timeout_sec": 0, 00:18:21.033 "reconnect_delay_sec": 0, 00:18:21.033 "fast_io_fail_timeout_sec": 0, 00:18:21.033 "generate_uuids": false, 00:18:21.033 "transport_tos": 0, 00:18:21.033 "io_path_stat": false, 00:18:21.033 "allow_accel_sequence": false 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "bdev_nvme_set_hotplug", 00:18:21.033 "params": { 00:18:21.033 "period_us": 100000, 00:18:21.033 "enable": false 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "bdev_malloc_create", 00:18:21.033 "params": { 00:18:21.033 "name": "malloc0", 00:18:21.033 "num_blocks": 8192, 00:18:21.033 "block_size": 4096, 00:18:21.033 "physical_block_size": 4096, 00:18:21.033 "uuid": "6eb58f19-21c3-47eb-9160-2644dae8b7c6", 00:18:21.033 "optimal_io_boundary": 0 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "bdev_wait_for_examine" 00:18:21.033 } 00:18:21.033 ] 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "subsystem": "nbd", 00:18:21.033 "config": [] 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "subsystem": "scheduler", 00:18:21.033 "config": [ 00:18:21.033 { 00:18:21.033 "method": "framework_set_scheduler", 00:18:21.033 "params": { 00:18:21.033 "name": "static" 00:18:21.033 } 00:18:21.033 } 00:18:21.033 ] 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "subsystem": "nvmf", 00:18:21.033 "config": [ 00:18:21.033 { 00:18:21.033 "method": "nvmf_set_config", 00:18:21.033 "params": { 00:18:21.033 "discovery_filter": "match_any", 00:18:21.033 "admin_cmd_passthru": { 00:18:21.033 "identify_ctrlr": false 00:18:21.033 } 00:18:21.033 } 00:18:21.033 }, 00:18:21.033 { 00:18:21.033 "method": "nvmf_set_max_subsystems", 00:18:21.034 "params": { 00:18:21.034 "max_subsystems": 1024 00:18:21.034 } 00:18:21.034 }, 00:18:21.034 { 00:18:21.034 "method": "nvmf_set_crdt", 00:18:21.034 "params": { 00:18:21.034 "crdt1": 0, 00:18:21.034 "crdt2": 0, 00:18:21.034 "crdt3": 0 00:18:21.034 } 00:18:21.034 }, 00:18:21.034 { 00:18:21.034 "method": "nvmf_create_transport", 00:18:21.034 "params": { 00:18:21.034 "trtype": "TCP", 00:18:21.034 "max_queue_depth": 128, 00:18:21.034 "max_io_qpairs_per_ctrlr": 127, 00:18:21.034 "in_capsule_data_size": 4096, 00:18:21.034 "max_io_size": 131072, 00:18:21.034 "io_unit_size": 131072, 00:18:21.034 "max_aq_depth": 128, 00:18:21.034 "num_shared_buffers": 511, 00:18:21.034 "buf_cache_size": 4294967295, 00:18:21.034 "dif_insert_or_strip": false, 00:18:21.034 "zcopy": false, 00:18:21.034 "c2h_success": false, 00:18:21.034 "sock_priority": 0, 00:18:21.034 "abort_timeout_sec": 1 00:18:21.034 } 00:18:21.034 }, 00:18:21.034 { 00:18:21.034 "method": "nvmf_create_subsystem", 00:18:21.034 "params": { 00:18:21.034 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.034 "allow_any_host": false, 00:18:21.034 "serial_number": "SPDK00000000000001", 00:18:21.034 "model_number": "SPDK bdev Controller", 00:18:21.034 "max_namespaces": 10, 00:18:21.034 "min_cntlid": 1, 00:18:21.034 "max_cntlid": 65519, 00:18:21.034 "ana_reporting": false 00:18:21.034 } 00:18:21.034 }, 00:18:21.034 { 00:18:21.034 "method": "nvmf_subsystem_add_host", 00:18:21.034 "params": { 00:18:21.034 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.034 "host": "nqn.2016-06.io.spdk:host1", 00:18:21.034 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:21.034 } 00:18:21.034 }, 00:18:21.034 { 00:18:21.034 "method": "nvmf_subsystem_add_ns", 00:18:21.034 "params": { 00:18:21.034 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.034 "namespace": { 00:18:21.034 "nsid": 1, 00:18:21.034 "bdev_name": "malloc0", 00:18:21.034 "nguid": "6EB58F1921C347EB91602644DAE8B7C6", 00:18:21.034 "uuid": "6eb58f19-21c3-47eb-9160-2644dae8b7c6" 00:18:21.034 } 00:18:21.034 } 00:18:21.034 }, 00:18:21.034 { 00:18:21.034 "method": "nvmf_subsystem_add_listener", 00:18:21.034 "params": { 00:18:21.034 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.034 "listen_address": { 00:18:21.034 "trtype": "TCP", 00:18:21.034 "adrfam": "IPv4", 00:18:21.034 "traddr": "10.0.0.2", 00:18:21.034 "trsvcid": "4420" 00:18:21.034 }, 00:18:21.034 "secure_channel": true 00:18:21.034 } 00:18:21.034 } 00:18:21.034 ] 00:18:21.034 } 00:18:21.034 ] 00:18:21.034 }' 00:18:21.034 01:54:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:21.034 01:54:09 -- common/autotest_common.sh@10 -- # set +x 00:18:21.034 01:54:09 -- nvmf/common.sh@469 -- # nvmfpid=3466410 00:18:21.034 01:54:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:21.034 01:54:09 -- nvmf/common.sh@470 -- # waitforlisten 3466410 00:18:21.034 01:54:09 -- common/autotest_common.sh@829 -- # '[' -z 3466410 ']' 00:18:21.034 01:54:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:21.034 01:54:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.034 01:54:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:21.034 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:21.034 01:54:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.034 01:54:09 -- common/autotest_common.sh@10 -- # set +x 00:18:21.034 [2024-11-19 01:54:09.322974] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:21.034 [2024-11-19 01:54:09.323065] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:21.034 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.034 [2024-11-19 01:54:09.385858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.034 [2024-11-19 01:54:09.494199] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:21.034 [2024-11-19 01:54:09.494352] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:21.034 [2024-11-19 01:54:09.494370] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:21.034 [2024-11-19 01:54:09.494382] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:21.034 [2024-11-19 01:54:09.494424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:21.292 [2024-11-19 01:54:09.720075] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:21.292 [2024-11-19 01:54:09.752084] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:21.292 [2024-11-19 01:54:09.752360] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:21.857 01:54:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:21.857 01:54:10 -- common/autotest_common.sh@862 -- # return 0 00:18:21.857 01:54:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:21.857 01:54:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:21.857 01:54:10 -- common/autotest_common.sh@10 -- # set +x 00:18:21.857 01:54:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:21.857 01:54:10 -- target/tls.sh@216 -- # bdevperf_pid=3466570 00:18:21.857 01:54:10 -- target/tls.sh@217 -- # waitforlisten 3466570 /var/tmp/bdevperf.sock 00:18:21.857 01:54:10 -- common/autotest_common.sh@829 -- # '[' -z 3466570 ']' 00:18:21.857 01:54:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:21.857 01:54:10 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:21.857 01:54:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.857 01:54:10 -- target/tls.sh@213 -- # echo '{ 00:18:21.857 "subsystems": [ 00:18:21.857 { 00:18:21.857 "subsystem": "iobuf", 00:18:21.857 "config": [ 00:18:21.857 { 00:18:21.857 "method": "iobuf_set_options", 00:18:21.857 "params": { 00:18:21.857 "small_pool_count": 8192, 00:18:21.857 "large_pool_count": 1024, 00:18:21.857 "small_bufsize": 8192, 00:18:21.857 "large_bufsize": 135168 00:18:21.857 } 00:18:21.857 } 00:18:21.857 ] 00:18:21.857 }, 00:18:21.857 { 00:18:21.857 "subsystem": "sock", 00:18:21.857 "config": [ 00:18:21.857 { 00:18:21.857 "method": "sock_impl_set_options", 00:18:21.857 "params": { 00:18:21.857 "impl_name": "posix", 00:18:21.857 "recv_buf_size": 2097152, 00:18:21.857 "send_buf_size": 2097152, 00:18:21.857 "enable_recv_pipe": true, 00:18:21.857 "enable_quickack": false, 00:18:21.857 "enable_placement_id": 0, 00:18:21.857 "enable_zerocopy_send_server": true, 00:18:21.857 "enable_zerocopy_send_client": false, 00:18:21.857 "zerocopy_threshold": 0, 00:18:21.857 "tls_version": 0, 00:18:21.857 "enable_ktls": false 00:18:21.857 } 00:18:21.857 }, 00:18:21.857 { 00:18:21.857 "method": "sock_impl_set_options", 00:18:21.857 "params": { 00:18:21.857 "impl_name": "ssl", 00:18:21.857 "recv_buf_size": 4096, 00:18:21.857 "send_buf_size": 4096, 00:18:21.857 "enable_recv_pipe": true, 00:18:21.857 "enable_quickack": false, 00:18:21.857 "enable_placement_id": 0, 00:18:21.857 "enable_zerocopy_send_server": true, 00:18:21.858 "enable_zerocopy_send_client": false, 00:18:21.858 "zerocopy_threshold": 0, 00:18:21.858 "tls_version": 0, 00:18:21.858 "enable_ktls": false 00:18:21.858 } 00:18:21.858 } 00:18:21.858 ] 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "subsystem": "vmd", 00:18:21.858 "config": [] 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "subsystem": "accel", 00:18:21.858 "config": [ 00:18:21.858 { 00:18:21.858 "method": "accel_set_options", 00:18:21.858 "params": { 00:18:21.858 "small_cache_size": 128, 00:18:21.858 "large_cache_size": 16, 00:18:21.858 "task_count": 2048, 00:18:21.858 "sequence_count": 2048, 00:18:21.858 "buf_count": 2048 00:18:21.858 } 00:18:21.858 } 00:18:21.858 ] 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "subsystem": "bdev", 00:18:21.858 "config": [ 00:18:21.858 { 00:18:21.858 "method": "bdev_set_options", 00:18:21.858 "params": { 00:18:21.858 "bdev_io_pool_size": 65535, 00:18:21.858 "bdev_io_cache_size": 256, 00:18:21.858 "bdev_auto_examine": true, 00:18:21.858 "iobuf_small_cache_size": 128, 00:18:21.858 "iobuf_large_cache_size": 16 00:18:21.858 } 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "method": "bdev_raid_set_options", 00:18:21.858 "params": { 00:18:21.858 "process_window_size_kb": 1024 00:18:21.858 } 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "method": "bdev_iscsi_set_options", 00:18:21.858 "params": { 00:18:21.858 "timeout_sec": 30 00:18:21.858 } 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "method": "bdev_nvme_set_options", 00:18:21.858 "params": { 00:18:21.858 "action_on_timeout": "none", 00:18:21.858 "timeout_us": 0, 00:18:21.858 "timeout_admin_us": 0, 00:18:21.858 "keep_alive_timeout_ms": 10000, 00:18:21.858 "transport_retry_count": 4, 00:18:21.858 "arbitration_burst": 0, 00:18:21.858 "low_priority_weight": 0, 00:18:21.858 "medium_priority_weight": 0, 00:18:21.858 "high_priority_weight": 0, 00:18:21.858 "nvme_adminq_poll_period_us": 10000, 00:18:21.858 "nvme_ioq_poll_period_us": 0, 00:18:21.858 "io_queue_requests": 512, 00:18:21.858 "delay_cmd_submit": true, 00:18:21.858 "bdev_retry_count": 3, 00:18:21.858 "transport_ack_timeout": 0, 00:18:21.858 "ctrlr_loss_timeout_sec": 0, 00:18:21.858 "reconnect_delay_sec": 0, 00:18:21.858 "fast_io_fail_timeout_sec": 0, 00:18:21.858 "generate_uuids": false, 00:18:21.858 "transport_tos": 0, 00:18:21.858 "io_path_stat": false, 00:18:21.858 "allow_accel_sequence": false 00:18:21.858 } 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "method": "bdev_nvme_attach_controller", 00:18:21.858 "params": { 00:18:21.858 "name": "TLSTEST", 00:18:21.858 "trtype": "TCP", 00:18:21.858 "adrfam": "IPv4", 00:18:21.858 "traddr": "10.0.0.2", 00:18:21.858 "trsvcid": "4420", 00:18:21.858 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.858 "prchk_reftag": false, 00:18:21.858 "prchk_guard": false, 00:18:21.858 "ctrlr_loss_timeout_sec": 0, 00:18:21.858 "reconnect_delay_sec": 0, 00:18:21.858 "fast_io_fail_timeout_sec": 0, 00:18:21.858 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:21.858 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:21.858 "hdgst": false, 00:18:21.858 "ddgst": false 00:18:21.858 } 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "method": "bdev_nvme_set_hotplug", 00:18:21.858 "params": { 00:18:21.858 "period_us": 100000, 00:18:21.858 "enable": false 00:18:21.858 } 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "method": "bdev_wait_for_examine" 00:18:21.858 } 00:18:21.858 ] 00:18:21.858 }, 00:18:21.858 { 00:18:21.858 "subsystem": "nbd", 00:18:21.858 "config": [] 00:18:21.858 } 00:18:21.858 ] 00:18:21.858 }' 00:18:21.858 01:54:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:21.858 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:21.858 01:54:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.858 01:54:10 -- common/autotest_common.sh@10 -- # set +x 00:18:21.858 [2024-11-19 01:54:10.356369] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:21.858 [2024-11-19 01:54:10.356448] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3466570 ] 00:18:21.858 EAL: No free 2048 kB hugepages reported on node 1 00:18:22.116 [2024-11-19 01:54:10.417632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:22.116 [2024-11-19 01:54:10.535966] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:22.375 [2024-11-19 01:54:10.702954] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:22.939 01:54:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:22.939 01:54:11 -- common/autotest_common.sh@862 -- # return 0 00:18:22.939 01:54:11 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:22.939 Running I/O for 10 seconds... 00:18:35.130 00:18:35.130 Latency(us) 00:18:35.130 [2024-11-19T00:54:23.673Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:35.130 [2024-11-19T00:54:23.673Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:35.130 Verification LBA range: start 0x0 length 0x2000 00:18:35.130 TLSTESTn1 : 10.02 4613.47 18.02 0.00 0.00 27707.18 5267.15 66409.81 00:18:35.131 [2024-11-19T00:54:23.674Z] =================================================================================================================== 00:18:35.131 [2024-11-19T00:54:23.674Z] Total : 4613.47 18.02 0.00 0.00 27707.18 5267.15 66409.81 00:18:35.131 0 00:18:35.131 01:54:21 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:35.131 01:54:21 -- target/tls.sh@223 -- # killprocess 3466570 00:18:35.131 01:54:21 -- common/autotest_common.sh@936 -- # '[' -z 3466570 ']' 00:18:35.131 01:54:21 -- common/autotest_common.sh@940 -- # kill -0 3466570 00:18:35.131 01:54:21 -- common/autotest_common.sh@941 -- # uname 00:18:35.131 01:54:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:35.131 01:54:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3466570 00:18:35.131 01:54:21 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:35.131 01:54:21 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:35.131 01:54:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3466570' 00:18:35.131 killing process with pid 3466570 00:18:35.131 01:54:21 -- common/autotest_common.sh@955 -- # kill 3466570 00:18:35.131 Received shutdown signal, test time was about 10.000000 seconds 00:18:35.131 00:18:35.131 Latency(us) 00:18:35.131 [2024-11-19T00:54:23.674Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:35.131 [2024-11-19T00:54:23.674Z] =================================================================================================================== 00:18:35.131 [2024-11-19T00:54:23.674Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:35.131 01:54:21 -- common/autotest_common.sh@960 -- # wait 3466570 00:18:35.131 01:54:21 -- target/tls.sh@224 -- # killprocess 3466410 00:18:35.131 01:54:21 -- common/autotest_common.sh@936 -- # '[' -z 3466410 ']' 00:18:35.131 01:54:21 -- common/autotest_common.sh@940 -- # kill -0 3466410 00:18:35.131 01:54:21 -- common/autotest_common.sh@941 -- # uname 00:18:35.131 01:54:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:35.131 01:54:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3466410 00:18:35.131 01:54:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:35.131 01:54:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:35.131 01:54:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3466410' 00:18:35.131 killing process with pid 3466410 00:18:35.131 01:54:21 -- common/autotest_common.sh@955 -- # kill 3466410 00:18:35.131 01:54:21 -- common/autotest_common.sh@960 -- # wait 3466410 00:18:35.131 01:54:22 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:35.131 01:54:22 -- target/tls.sh@227 -- # cleanup 00:18:35.131 01:54:22 -- target/tls.sh@15 -- # process_shm --id 0 00:18:35.131 01:54:22 -- common/autotest_common.sh@806 -- # type=--id 00:18:35.131 01:54:22 -- common/autotest_common.sh@807 -- # id=0 00:18:35.131 01:54:22 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:35.131 01:54:22 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:35.131 01:54:22 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:35.131 01:54:22 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:35.131 01:54:22 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:35.131 01:54:22 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:35.131 nvmf_trace.0 00:18:35.131 01:54:22 -- common/autotest_common.sh@821 -- # return 0 00:18:35.131 01:54:22 -- target/tls.sh@16 -- # killprocess 3466570 00:18:35.131 01:54:22 -- common/autotest_common.sh@936 -- # '[' -z 3466570 ']' 00:18:35.131 01:54:22 -- common/autotest_common.sh@940 -- # kill -0 3466570 00:18:35.131 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3466570) - No such process 00:18:35.131 01:54:22 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3466570 is not found' 00:18:35.131 Process with pid 3466570 is not found 00:18:35.131 01:54:22 -- target/tls.sh@17 -- # nvmftestfini 00:18:35.131 01:54:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:35.131 01:54:22 -- nvmf/common.sh@116 -- # sync 00:18:35.131 01:54:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:35.131 01:54:22 -- nvmf/common.sh@119 -- # set +e 00:18:35.131 01:54:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:35.131 01:54:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:35.131 rmmod nvme_tcp 00:18:35.131 rmmod nvme_fabrics 00:18:35.131 rmmod nvme_keyring 00:18:35.131 01:54:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:35.131 01:54:22 -- nvmf/common.sh@123 -- # set -e 00:18:35.131 01:54:22 -- nvmf/common.sh@124 -- # return 0 00:18:35.131 01:54:22 -- nvmf/common.sh@477 -- # '[' -n 3466410 ']' 00:18:35.131 01:54:22 -- nvmf/common.sh@478 -- # killprocess 3466410 00:18:35.131 01:54:22 -- common/autotest_common.sh@936 -- # '[' -z 3466410 ']' 00:18:35.131 01:54:22 -- common/autotest_common.sh@940 -- # kill -0 3466410 00:18:35.131 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3466410) - No such process 00:18:35.131 01:54:22 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3466410 is not found' 00:18:35.131 Process with pid 3466410 is not found 00:18:35.131 01:54:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:35.131 01:54:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:35.131 01:54:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:35.131 01:54:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:35.131 01:54:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:35.131 01:54:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:35.131 01:54:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:35.131 01:54:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.069 01:54:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:36.069 01:54:24 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:36.069 00:18:36.069 real 1m16.002s 00:18:36.069 user 2m4.194s 00:18:36.069 sys 0m22.520s 00:18:36.069 01:54:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:36.069 01:54:24 -- common/autotest_common.sh@10 -- # set +x 00:18:36.069 ************************************ 00:18:36.069 END TEST nvmf_tls 00:18:36.069 ************************************ 00:18:36.069 01:54:24 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:36.069 01:54:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:36.069 01:54:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:36.069 01:54:24 -- common/autotest_common.sh@10 -- # set +x 00:18:36.069 ************************************ 00:18:36.069 START TEST nvmf_fips 00:18:36.069 ************************************ 00:18:36.069 01:54:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:36.069 * Looking for test storage... 00:18:36.069 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:36.069 01:54:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:36.069 01:54:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:36.069 01:54:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:36.069 01:54:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:36.069 01:54:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:36.069 01:54:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:36.069 01:54:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:36.069 01:54:24 -- scripts/common.sh@335 -- # IFS=.-: 00:18:36.069 01:54:24 -- scripts/common.sh@335 -- # read -ra ver1 00:18:36.069 01:54:24 -- scripts/common.sh@336 -- # IFS=.-: 00:18:36.069 01:54:24 -- scripts/common.sh@336 -- # read -ra ver2 00:18:36.069 01:54:24 -- scripts/common.sh@337 -- # local 'op=<' 00:18:36.069 01:54:24 -- scripts/common.sh@339 -- # ver1_l=2 00:18:36.069 01:54:24 -- scripts/common.sh@340 -- # ver2_l=1 00:18:36.069 01:54:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:36.069 01:54:24 -- scripts/common.sh@343 -- # case "$op" in 00:18:36.069 01:54:24 -- scripts/common.sh@344 -- # : 1 00:18:36.069 01:54:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:36.069 01:54:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.069 01:54:24 -- scripts/common.sh@364 -- # decimal 1 00:18:36.069 01:54:24 -- scripts/common.sh@352 -- # local d=1 00:18:36.069 01:54:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:36.069 01:54:24 -- scripts/common.sh@354 -- # echo 1 00:18:36.069 01:54:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:36.069 01:54:24 -- scripts/common.sh@365 -- # decimal 2 00:18:36.069 01:54:24 -- scripts/common.sh@352 -- # local d=2 00:18:36.069 01:54:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:36.069 01:54:24 -- scripts/common.sh@354 -- # echo 2 00:18:36.069 01:54:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:36.069 01:54:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.069 01:54:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:36.069 01:54:24 -- scripts/common.sh@367 -- # return 0 00:18:36.069 01:54:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:36.069 01:54:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:36.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.069 --rc genhtml_branch_coverage=1 00:18:36.069 --rc genhtml_function_coverage=1 00:18:36.069 --rc genhtml_legend=1 00:18:36.069 --rc geninfo_all_blocks=1 00:18:36.069 --rc geninfo_unexecuted_blocks=1 00:18:36.069 00:18:36.069 ' 00:18:36.069 01:54:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:36.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.069 --rc genhtml_branch_coverage=1 00:18:36.069 --rc genhtml_function_coverage=1 00:18:36.069 --rc genhtml_legend=1 00:18:36.069 --rc geninfo_all_blocks=1 00:18:36.069 --rc geninfo_unexecuted_blocks=1 00:18:36.069 00:18:36.069 ' 00:18:36.069 01:54:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:36.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.069 --rc genhtml_branch_coverage=1 00:18:36.069 --rc genhtml_function_coverage=1 00:18:36.069 --rc genhtml_legend=1 00:18:36.069 --rc geninfo_all_blocks=1 00:18:36.069 --rc geninfo_unexecuted_blocks=1 00:18:36.069 00:18:36.069 ' 00:18:36.069 01:54:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:36.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.069 --rc genhtml_branch_coverage=1 00:18:36.069 --rc genhtml_function_coverage=1 00:18:36.069 --rc genhtml_legend=1 00:18:36.069 --rc geninfo_all_blocks=1 00:18:36.069 --rc geninfo_unexecuted_blocks=1 00:18:36.069 00:18:36.069 ' 00:18:36.069 01:54:24 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:36.069 01:54:24 -- nvmf/common.sh@7 -- # uname -s 00:18:36.069 01:54:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:36.069 01:54:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:36.069 01:54:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:36.069 01:54:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:36.069 01:54:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:36.069 01:54:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:36.069 01:54:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:36.069 01:54:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:36.069 01:54:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:36.069 01:54:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:36.069 01:54:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.069 01:54:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.069 01:54:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:36.069 01:54:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:36.069 01:54:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:36.069 01:54:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:36.069 01:54:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:36.069 01:54:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:36.069 01:54:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:36.069 01:54:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.069 01:54:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.069 01:54:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.069 01:54:24 -- paths/export.sh@5 -- # export PATH 00:18:36.069 01:54:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.069 01:54:24 -- nvmf/common.sh@46 -- # : 0 00:18:36.069 01:54:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:36.069 01:54:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:36.069 01:54:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:36.069 01:54:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:36.069 01:54:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:36.069 01:54:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:36.069 01:54:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:36.069 01:54:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:36.069 01:54:24 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:36.069 01:54:24 -- fips/fips.sh@89 -- # check_openssl_version 00:18:36.069 01:54:24 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:36.069 01:54:24 -- fips/fips.sh@85 -- # openssl version 00:18:36.069 01:54:24 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:36.070 01:54:24 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:36.070 01:54:24 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:36.070 01:54:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:36.070 01:54:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:36.070 01:54:24 -- scripts/common.sh@335 -- # IFS=.-: 00:18:36.070 01:54:24 -- scripts/common.sh@335 -- # read -ra ver1 00:18:36.070 01:54:24 -- scripts/common.sh@336 -- # IFS=.-: 00:18:36.070 01:54:24 -- scripts/common.sh@336 -- # read -ra ver2 00:18:36.070 01:54:24 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:36.070 01:54:24 -- scripts/common.sh@339 -- # ver1_l=3 00:18:36.070 01:54:24 -- scripts/common.sh@340 -- # ver2_l=3 00:18:36.070 01:54:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:36.070 01:54:24 -- scripts/common.sh@343 -- # case "$op" in 00:18:36.070 01:54:24 -- scripts/common.sh@347 -- # : 1 00:18:36.070 01:54:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:36.070 01:54:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.070 01:54:24 -- scripts/common.sh@364 -- # decimal 3 00:18:36.070 01:54:24 -- scripts/common.sh@352 -- # local d=3 00:18:36.070 01:54:24 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:36.070 01:54:24 -- scripts/common.sh@354 -- # echo 3 00:18:36.070 01:54:24 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:36.070 01:54:24 -- scripts/common.sh@365 -- # decimal 3 00:18:36.070 01:54:24 -- scripts/common.sh@352 -- # local d=3 00:18:36.070 01:54:24 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:36.070 01:54:24 -- scripts/common.sh@354 -- # echo 3 00:18:36.070 01:54:24 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:36.070 01:54:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.070 01:54:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:36.070 01:54:24 -- scripts/common.sh@363 -- # (( v++ )) 00:18:36.070 01:54:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.070 01:54:24 -- scripts/common.sh@364 -- # decimal 1 00:18:36.070 01:54:24 -- scripts/common.sh@352 -- # local d=1 00:18:36.070 01:54:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:36.070 01:54:24 -- scripts/common.sh@354 -- # echo 1 00:18:36.070 01:54:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:36.070 01:54:24 -- scripts/common.sh@365 -- # decimal 0 00:18:36.070 01:54:24 -- scripts/common.sh@352 -- # local d=0 00:18:36.070 01:54:24 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:36.070 01:54:24 -- scripts/common.sh@354 -- # echo 0 00:18:36.070 01:54:24 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:36.070 01:54:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.070 01:54:24 -- scripts/common.sh@366 -- # return 0 00:18:36.070 01:54:24 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:36.070 01:54:24 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:36.070 01:54:24 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:36.070 01:54:24 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:36.070 01:54:24 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:36.070 01:54:24 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:36.070 01:54:24 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:36.070 01:54:24 -- fips/fips.sh@113 -- # build_openssl_config 00:18:36.070 01:54:24 -- fips/fips.sh@37 -- # cat 00:18:36.070 01:54:24 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:36.070 01:54:24 -- fips/fips.sh@58 -- # cat - 00:18:36.070 01:54:24 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:36.070 01:54:24 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:36.070 01:54:24 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:36.070 01:54:24 -- fips/fips.sh@116 -- # openssl list -providers 00:18:36.070 01:54:24 -- fips/fips.sh@116 -- # grep name 00:18:36.070 01:54:24 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:36.070 01:54:24 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:36.070 01:54:24 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:36.070 01:54:24 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:36.070 01:54:24 -- fips/fips.sh@127 -- # : 00:18:36.070 01:54:24 -- common/autotest_common.sh@650 -- # local es=0 00:18:36.070 01:54:24 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:36.070 01:54:24 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:36.070 01:54:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:36.070 01:54:24 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:36.070 01:54:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:36.070 01:54:24 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:36.070 01:54:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:36.070 01:54:24 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:36.070 01:54:24 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:36.070 01:54:24 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:36.070 Error setting digest 00:18:36.070 4052A750357F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:36.070 4052A750357F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:36.070 01:54:24 -- common/autotest_common.sh@653 -- # es=1 00:18:36.070 01:54:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:36.070 01:54:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:36.070 01:54:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:36.070 01:54:24 -- fips/fips.sh@130 -- # nvmftestinit 00:18:36.070 01:54:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:36.070 01:54:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:36.070 01:54:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:36.070 01:54:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:36.070 01:54:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:36.070 01:54:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:36.070 01:54:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:36.070 01:54:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.070 01:54:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:36.070 01:54:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:36.070 01:54:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:36.070 01:54:24 -- common/autotest_common.sh@10 -- # set +x 00:18:38.603 01:54:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:38.603 01:54:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:38.603 01:54:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:38.603 01:54:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:38.603 01:54:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:38.603 01:54:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:38.603 01:54:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:38.603 01:54:26 -- nvmf/common.sh@294 -- # net_devs=() 00:18:38.603 01:54:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:38.603 01:54:26 -- nvmf/common.sh@295 -- # e810=() 00:18:38.603 01:54:26 -- nvmf/common.sh@295 -- # local -ga e810 00:18:38.603 01:54:26 -- nvmf/common.sh@296 -- # x722=() 00:18:38.603 01:54:26 -- nvmf/common.sh@296 -- # local -ga x722 00:18:38.603 01:54:26 -- nvmf/common.sh@297 -- # mlx=() 00:18:38.603 01:54:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:38.603 01:54:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:38.603 01:54:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:38.604 01:54:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:38.604 01:54:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:38.604 01:54:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:38.604 01:54:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.604 01:54:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:38.604 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:38.604 01:54:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.604 01:54:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:38.604 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:38.604 01:54:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:38.604 01:54:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.604 01:54:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.604 01:54:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.604 01:54:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.604 01:54:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:38.604 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:38.604 01:54:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.604 01:54:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.604 01:54:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.604 01:54:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.604 01:54:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.604 01:54:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:38.604 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:38.604 01:54:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.604 01:54:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:38.604 01:54:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:38.604 01:54:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:38.604 01:54:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:38.604 01:54:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:38.604 01:54:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:38.604 01:54:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:38.604 01:54:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:38.604 01:54:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:38.604 01:54:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:38.604 01:54:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:38.604 01:54:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:38.604 01:54:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:38.604 01:54:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:38.604 01:54:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:38.604 01:54:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:38.604 01:54:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:38.604 01:54:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:38.604 01:54:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:38.604 01:54:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:38.604 01:54:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:38.604 01:54:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:38.604 01:54:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:38.604 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:38.604 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:18:38.604 00:18:38.604 --- 10.0.0.2 ping statistics --- 00:18:38.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.604 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:18:38.604 01:54:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:38.604 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:38.604 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:18:38.604 00:18:38.604 --- 10.0.0.1 ping statistics --- 00:18:38.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.604 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:18:38.604 01:54:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:38.604 01:54:26 -- nvmf/common.sh@410 -- # return 0 00:18:38.604 01:54:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:38.604 01:54:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:38.604 01:54:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:38.604 01:54:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:38.604 01:54:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:38.604 01:54:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:38.604 01:54:26 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:38.604 01:54:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:38.604 01:54:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:38.604 01:54:26 -- common/autotest_common.sh@10 -- # set +x 00:18:38.604 01:54:26 -- nvmf/common.sh@469 -- # nvmfpid=3470032 00:18:38.604 01:54:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:38.604 01:54:26 -- nvmf/common.sh@470 -- # waitforlisten 3470032 00:18:38.604 01:54:26 -- common/autotest_common.sh@829 -- # '[' -z 3470032 ']' 00:18:38.604 01:54:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:38.604 01:54:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:38.604 01:54:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:38.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:38.604 01:54:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:38.604 01:54:26 -- common/autotest_common.sh@10 -- # set +x 00:18:38.604 [2024-11-19 01:54:26.962585] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:38.604 [2024-11-19 01:54:26.962684] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:38.604 EAL: No free 2048 kB hugepages reported on node 1 00:18:38.604 [2024-11-19 01:54:27.028208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:38.604 [2024-11-19 01:54:27.145528] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:38.604 [2024-11-19 01:54:27.145713] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:38.604 [2024-11-19 01:54:27.145745] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:38.604 [2024-11-19 01:54:27.145767] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:38.604 [2024-11-19 01:54:27.145809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:39.539 01:54:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:39.539 01:54:27 -- common/autotest_common.sh@862 -- # return 0 00:18:39.539 01:54:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:39.539 01:54:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:39.539 01:54:27 -- common/autotest_common.sh@10 -- # set +x 00:18:39.539 01:54:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:39.539 01:54:27 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:39.539 01:54:27 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:39.539 01:54:27 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.539 01:54:27 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:39.539 01:54:27 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.539 01:54:27 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.539 01:54:27 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:39.539 01:54:27 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:39.798 [2024-11-19 01:54:28.191426] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:39.798 [2024-11-19 01:54:28.207423] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:39.798 [2024-11-19 01:54:28.207693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:39.798 malloc0 00:18:39.798 01:54:28 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:39.798 01:54:28 -- fips/fips.sh@147 -- # bdevperf_pid=3470194 00:18:39.798 01:54:28 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:39.798 01:54:28 -- fips/fips.sh@148 -- # waitforlisten 3470194 /var/tmp/bdevperf.sock 00:18:39.798 01:54:28 -- common/autotest_common.sh@829 -- # '[' -z 3470194 ']' 00:18:39.798 01:54:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:39.798 01:54:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:39.798 01:54:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:39.798 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:39.798 01:54:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:39.798 01:54:28 -- common/autotest_common.sh@10 -- # set +x 00:18:39.798 [2024-11-19 01:54:28.329890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:39.798 [2024-11-19 01:54:28.329995] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3470194 ] 00:18:40.057 EAL: No free 2048 kB hugepages reported on node 1 00:18:40.057 [2024-11-19 01:54:28.392569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:40.057 [2024-11-19 01:54:28.511975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:40.989 01:54:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:40.989 01:54:29 -- common/autotest_common.sh@862 -- # return 0 00:18:40.989 01:54:29 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.990 [2024-11-19 01:54:29.507933] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:41.247 TLSTESTn1 00:18:41.247 01:54:29 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:41.247 Running I/O for 10 seconds... 00:18:53.442 00:18:53.442 Latency(us) 00:18:53.442 [2024-11-19T00:54:41.985Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:53.442 [2024-11-19T00:54:41.985Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:53.442 Verification LBA range: start 0x0 length 0x2000 00:18:53.442 TLSTESTn1 : 10.02 4654.81 18.18 0.00 0.00 27463.08 5437.06 48156.82 00:18:53.442 [2024-11-19T00:54:41.985Z] =================================================================================================================== 00:18:53.442 [2024-11-19T00:54:41.985Z] Total : 4654.81 18.18 0.00 0.00 27463.08 5437.06 48156.82 00:18:53.442 0 00:18:53.442 01:54:39 -- fips/fips.sh@1 -- # cleanup 00:18:53.442 01:54:39 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:53.442 01:54:39 -- common/autotest_common.sh@806 -- # type=--id 00:18:53.442 01:54:39 -- common/autotest_common.sh@807 -- # id=0 00:18:53.442 01:54:39 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:53.442 01:54:39 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:53.442 01:54:39 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:53.442 01:54:39 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:53.442 01:54:39 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:53.442 01:54:39 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:53.442 nvmf_trace.0 00:18:53.442 01:54:39 -- common/autotest_common.sh@821 -- # return 0 00:18:53.442 01:54:39 -- fips/fips.sh@16 -- # killprocess 3470194 00:18:53.442 01:54:39 -- common/autotest_common.sh@936 -- # '[' -z 3470194 ']' 00:18:53.442 01:54:39 -- common/autotest_common.sh@940 -- # kill -0 3470194 00:18:53.442 01:54:39 -- common/autotest_common.sh@941 -- # uname 00:18:53.442 01:54:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:53.442 01:54:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3470194 00:18:53.442 01:54:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:53.442 01:54:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:53.442 01:54:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3470194' 00:18:53.442 killing process with pid 3470194 00:18:53.442 01:54:39 -- common/autotest_common.sh@955 -- # kill 3470194 00:18:53.442 Received shutdown signal, test time was about 10.000000 seconds 00:18:53.442 00:18:53.442 Latency(us) 00:18:53.442 [2024-11-19T00:54:41.985Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:53.442 [2024-11-19T00:54:41.985Z] =================================================================================================================== 00:18:53.442 [2024-11-19T00:54:41.985Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:53.442 01:54:39 -- common/autotest_common.sh@960 -- # wait 3470194 00:18:53.442 01:54:40 -- fips/fips.sh@17 -- # nvmftestfini 00:18:53.442 01:54:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:53.442 01:54:40 -- nvmf/common.sh@116 -- # sync 00:18:53.442 01:54:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:53.442 01:54:40 -- nvmf/common.sh@119 -- # set +e 00:18:53.442 01:54:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:53.442 01:54:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:53.442 rmmod nvme_tcp 00:18:53.442 rmmod nvme_fabrics 00:18:53.442 rmmod nvme_keyring 00:18:53.442 01:54:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:53.442 01:54:40 -- nvmf/common.sh@123 -- # set -e 00:18:53.442 01:54:40 -- nvmf/common.sh@124 -- # return 0 00:18:53.442 01:54:40 -- nvmf/common.sh@477 -- # '[' -n 3470032 ']' 00:18:53.442 01:54:40 -- nvmf/common.sh@478 -- # killprocess 3470032 00:18:53.442 01:54:40 -- common/autotest_common.sh@936 -- # '[' -z 3470032 ']' 00:18:53.442 01:54:40 -- common/autotest_common.sh@940 -- # kill -0 3470032 00:18:53.442 01:54:40 -- common/autotest_common.sh@941 -- # uname 00:18:53.442 01:54:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:53.443 01:54:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3470032 00:18:53.443 01:54:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:53.443 01:54:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:53.443 01:54:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3470032' 00:18:53.443 killing process with pid 3470032 00:18:53.443 01:54:40 -- common/autotest_common.sh@955 -- # kill 3470032 00:18:53.443 01:54:40 -- common/autotest_common.sh@960 -- # wait 3470032 00:18:53.443 01:54:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:53.443 01:54:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:53.443 01:54:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:53.443 01:54:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:53.443 01:54:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:53.443 01:54:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.443 01:54:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.443 01:54:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:54.378 01:54:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:54.378 01:54:42 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:54.378 00:18:54.378 real 0m18.289s 00:18:54.378 user 0m24.139s 00:18:54.378 sys 0m5.747s 00:18:54.378 01:54:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:54.378 01:54:42 -- common/autotest_common.sh@10 -- # set +x 00:18:54.378 ************************************ 00:18:54.378 END TEST nvmf_fips 00:18:54.378 ************************************ 00:18:54.378 01:54:42 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:54.378 01:54:42 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:54.378 01:54:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:54.378 01:54:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:54.378 01:54:42 -- common/autotest_common.sh@10 -- # set +x 00:18:54.379 ************************************ 00:18:54.379 START TEST nvmf_fuzz 00:18:54.379 ************************************ 00:18:54.379 01:54:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:54.379 * Looking for test storage... 00:18:54.379 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:54.379 01:54:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:54.379 01:54:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:54.379 01:54:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:54.379 01:54:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:54.379 01:54:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:54.379 01:54:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:54.379 01:54:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:54.379 01:54:42 -- scripts/common.sh@335 -- # IFS=.-: 00:18:54.379 01:54:42 -- scripts/common.sh@335 -- # read -ra ver1 00:18:54.379 01:54:42 -- scripts/common.sh@336 -- # IFS=.-: 00:18:54.379 01:54:42 -- scripts/common.sh@336 -- # read -ra ver2 00:18:54.379 01:54:42 -- scripts/common.sh@337 -- # local 'op=<' 00:18:54.379 01:54:42 -- scripts/common.sh@339 -- # ver1_l=2 00:18:54.379 01:54:42 -- scripts/common.sh@340 -- # ver2_l=1 00:18:54.379 01:54:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:54.379 01:54:42 -- scripts/common.sh@343 -- # case "$op" in 00:18:54.379 01:54:42 -- scripts/common.sh@344 -- # : 1 00:18:54.379 01:54:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:54.379 01:54:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:54.379 01:54:42 -- scripts/common.sh@364 -- # decimal 1 00:18:54.379 01:54:42 -- scripts/common.sh@352 -- # local d=1 00:18:54.379 01:54:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:54.379 01:54:42 -- scripts/common.sh@354 -- # echo 1 00:18:54.379 01:54:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:54.379 01:54:42 -- scripts/common.sh@365 -- # decimal 2 00:18:54.379 01:54:42 -- scripts/common.sh@352 -- # local d=2 00:18:54.379 01:54:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:54.379 01:54:42 -- scripts/common.sh@354 -- # echo 2 00:18:54.379 01:54:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:54.379 01:54:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:54.379 01:54:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:54.379 01:54:42 -- scripts/common.sh@367 -- # return 0 00:18:54.379 01:54:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:54.379 01:54:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:54.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.379 --rc genhtml_branch_coverage=1 00:18:54.379 --rc genhtml_function_coverage=1 00:18:54.379 --rc genhtml_legend=1 00:18:54.379 --rc geninfo_all_blocks=1 00:18:54.379 --rc geninfo_unexecuted_blocks=1 00:18:54.379 00:18:54.379 ' 00:18:54.379 01:54:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:54.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.379 --rc genhtml_branch_coverage=1 00:18:54.379 --rc genhtml_function_coverage=1 00:18:54.379 --rc genhtml_legend=1 00:18:54.379 --rc geninfo_all_blocks=1 00:18:54.379 --rc geninfo_unexecuted_blocks=1 00:18:54.379 00:18:54.379 ' 00:18:54.379 01:54:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:54.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.379 --rc genhtml_branch_coverage=1 00:18:54.379 --rc genhtml_function_coverage=1 00:18:54.379 --rc genhtml_legend=1 00:18:54.379 --rc geninfo_all_blocks=1 00:18:54.379 --rc geninfo_unexecuted_blocks=1 00:18:54.379 00:18:54.379 ' 00:18:54.379 01:54:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:54.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:54.379 --rc genhtml_branch_coverage=1 00:18:54.379 --rc genhtml_function_coverage=1 00:18:54.379 --rc genhtml_legend=1 00:18:54.379 --rc geninfo_all_blocks=1 00:18:54.379 --rc geninfo_unexecuted_blocks=1 00:18:54.379 00:18:54.379 ' 00:18:54.379 01:54:42 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:54.379 01:54:42 -- nvmf/common.sh@7 -- # uname -s 00:18:54.379 01:54:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:54.379 01:54:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:54.379 01:54:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:54.379 01:54:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:54.379 01:54:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:54.379 01:54:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:54.379 01:54:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:54.379 01:54:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:54.379 01:54:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:54.379 01:54:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:54.379 01:54:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:54.379 01:54:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:54.379 01:54:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:54.379 01:54:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:54.379 01:54:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:54.379 01:54:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:54.379 01:54:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:54.379 01:54:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:54.379 01:54:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:54.379 01:54:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.379 01:54:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.379 01:54:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.379 01:54:42 -- paths/export.sh@5 -- # export PATH 00:18:54.379 01:54:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.379 01:54:42 -- nvmf/common.sh@46 -- # : 0 00:18:54.379 01:54:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:54.379 01:54:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:54.379 01:54:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:54.379 01:54:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:54.379 01:54:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:54.379 01:54:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:54.379 01:54:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:54.379 01:54:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:54.379 01:54:42 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:54.379 01:54:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:54.379 01:54:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:54.379 01:54:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:54.379 01:54:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:54.379 01:54:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:54.379 01:54:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:54.379 01:54:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:54.379 01:54:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:54.379 01:54:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:54.379 01:54:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:54.379 01:54:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:54.379 01:54:42 -- common/autotest_common.sh@10 -- # set +x 00:18:56.280 01:54:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:56.280 01:54:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:56.280 01:54:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:56.280 01:54:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:56.280 01:54:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:56.280 01:54:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:56.280 01:54:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:56.280 01:54:44 -- nvmf/common.sh@294 -- # net_devs=() 00:18:56.280 01:54:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:56.280 01:54:44 -- nvmf/common.sh@295 -- # e810=() 00:18:56.280 01:54:44 -- nvmf/common.sh@295 -- # local -ga e810 00:18:56.280 01:54:44 -- nvmf/common.sh@296 -- # x722=() 00:18:56.280 01:54:44 -- nvmf/common.sh@296 -- # local -ga x722 00:18:56.280 01:54:44 -- nvmf/common.sh@297 -- # mlx=() 00:18:56.280 01:54:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:56.280 01:54:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:56.280 01:54:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:56.280 01:54:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:56.280 01:54:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:56.281 01:54:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:56.281 01:54:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.281 01:54:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:56.281 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:56.281 01:54:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.281 01:54:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:56.281 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:56.281 01:54:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:56.281 01:54:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.281 01:54:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.281 01:54:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.281 01:54:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.281 01:54:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:56.281 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:56.281 01:54:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.281 01:54:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.281 01:54:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.281 01:54:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.281 01:54:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.281 01:54:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:56.281 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:56.281 01:54:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.281 01:54:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:56.281 01:54:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:56.281 01:54:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:56.281 01:54:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:56.281 01:54:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:56.281 01:54:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:56.281 01:54:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:56.281 01:54:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:56.281 01:54:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:56.281 01:54:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:56.281 01:54:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:56.281 01:54:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:56.281 01:54:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:56.281 01:54:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:56.281 01:54:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:56.281 01:54:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:56.281 01:54:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:56.281 01:54:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:56.281 01:54:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:56.281 01:54:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:56.281 01:54:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:56.281 01:54:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:56.281 01:54:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:56.281 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:56.281 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:18:56.281 00:18:56.281 --- 10.0.0.2 ping statistics --- 00:18:56.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.281 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:18:56.281 01:54:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:56.281 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:56.281 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:18:56.281 00:18:56.281 --- 10.0.0.1 ping statistics --- 00:18:56.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.281 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:18:56.281 01:54:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:56.281 01:54:44 -- nvmf/common.sh@410 -- # return 0 00:18:56.281 01:54:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:56.281 01:54:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:56.281 01:54:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:56.281 01:54:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:56.281 01:54:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:56.281 01:54:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:56.281 01:54:44 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3473508 00:18:56.281 01:54:44 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:56.281 01:54:44 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:56.281 01:54:44 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3473508 00:18:56.281 01:54:44 -- common/autotest_common.sh@829 -- # '[' -z 3473508 ']' 00:18:56.281 01:54:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:56.281 01:54:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:56.281 01:54:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:56.281 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:56.281 01:54:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:56.281 01:54:44 -- common/autotest_common.sh@10 -- # set +x 00:18:57.656 01:54:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:57.656 01:54:45 -- common/autotest_common.sh@862 -- # return 0 00:18:57.656 01:54:45 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:57.656 01:54:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.656 01:54:45 -- common/autotest_common.sh@10 -- # set +x 00:18:57.656 01:54:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.656 01:54:45 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:57.656 01:54:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.656 01:54:45 -- common/autotest_common.sh@10 -- # set +x 00:18:57.656 Malloc0 00:18:57.656 01:54:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.656 01:54:45 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:57.656 01:54:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.656 01:54:45 -- common/autotest_common.sh@10 -- # set +x 00:18:57.656 01:54:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.656 01:54:45 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:57.656 01:54:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.656 01:54:45 -- common/autotest_common.sh@10 -- # set +x 00:18:57.656 01:54:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.656 01:54:45 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:57.656 01:54:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.656 01:54:45 -- common/autotest_common.sh@10 -- # set +x 00:18:57.656 01:54:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.656 01:54:45 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:57.656 01:54:45 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:29.722 Fuzzing completed. Shutting down the fuzz application 00:19:29.722 00:19:29.722 Dumping successful admin opcodes: 00:19:29.722 8, 9, 10, 24, 00:19:29.722 Dumping successful io opcodes: 00:19:29.722 0, 9, 00:19:29.722 NS: 0x200003aeff00 I/O qp, Total commands completed: 484001, total successful commands: 2790, random_seed: 226250880 00:19:29.722 NS: 0x200003aeff00 admin qp, Total commands completed: 57680, total successful commands: 462, random_seed: 2377485888 00:19:29.722 01:55:16 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:29.722 Fuzzing completed. Shutting down the fuzz application 00:19:29.722 00:19:29.722 Dumping successful admin opcodes: 00:19:29.722 24, 00:19:29.722 Dumping successful io opcodes: 00:19:29.722 00:19:29.722 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1160958859 00:19:29.722 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1161103747 00:19:29.722 01:55:17 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:29.722 01:55:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.722 01:55:17 -- common/autotest_common.sh@10 -- # set +x 00:19:29.722 01:55:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.722 01:55:17 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:29.722 01:55:17 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:29.722 01:55:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:29.722 01:55:17 -- nvmf/common.sh@116 -- # sync 00:19:29.722 01:55:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:29.722 01:55:17 -- nvmf/common.sh@119 -- # set +e 00:19:29.722 01:55:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:29.722 01:55:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:29.722 rmmod nvme_tcp 00:19:29.722 rmmod nvme_fabrics 00:19:29.722 rmmod nvme_keyring 00:19:29.722 01:55:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:29.722 01:55:17 -- nvmf/common.sh@123 -- # set -e 00:19:29.722 01:55:17 -- nvmf/common.sh@124 -- # return 0 00:19:29.722 01:55:17 -- nvmf/common.sh@477 -- # '[' -n 3473508 ']' 00:19:29.722 01:55:17 -- nvmf/common.sh@478 -- # killprocess 3473508 00:19:29.722 01:55:17 -- common/autotest_common.sh@936 -- # '[' -z 3473508 ']' 00:19:29.722 01:55:17 -- common/autotest_common.sh@940 -- # kill -0 3473508 00:19:29.722 01:55:17 -- common/autotest_common.sh@941 -- # uname 00:19:29.722 01:55:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:29.722 01:55:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3473508 00:19:29.722 01:55:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:29.722 01:55:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:29.722 01:55:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3473508' 00:19:29.722 killing process with pid 3473508 00:19:29.722 01:55:17 -- common/autotest_common.sh@955 -- # kill 3473508 00:19:29.722 01:55:17 -- common/autotest_common.sh@960 -- # wait 3473508 00:19:29.722 01:55:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:29.722 01:55:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:29.722 01:55:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:29.722 01:55:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:29.722 01:55:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:29.722 01:55:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:29.722 01:55:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:29.722 01:55:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.260 01:55:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:32.260 01:55:20 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:32.260 00:19:32.260 real 0m37.643s 00:19:32.260 user 0m52.859s 00:19:32.260 sys 0m14.759s 00:19:32.260 01:55:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:32.260 01:55:20 -- common/autotest_common.sh@10 -- # set +x 00:19:32.260 ************************************ 00:19:32.260 END TEST nvmf_fuzz 00:19:32.260 ************************************ 00:19:32.260 01:55:20 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:32.260 01:55:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:32.260 01:55:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:32.260 01:55:20 -- common/autotest_common.sh@10 -- # set +x 00:19:32.260 ************************************ 00:19:32.260 START TEST nvmf_multiconnection 00:19:32.260 ************************************ 00:19:32.260 01:55:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:32.260 * Looking for test storage... 00:19:32.260 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:32.260 01:55:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:32.260 01:55:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:32.260 01:55:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:32.260 01:55:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:32.260 01:55:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:32.260 01:55:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:32.260 01:55:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:32.260 01:55:20 -- scripts/common.sh@335 -- # IFS=.-: 00:19:32.260 01:55:20 -- scripts/common.sh@335 -- # read -ra ver1 00:19:32.260 01:55:20 -- scripts/common.sh@336 -- # IFS=.-: 00:19:32.260 01:55:20 -- scripts/common.sh@336 -- # read -ra ver2 00:19:32.260 01:55:20 -- scripts/common.sh@337 -- # local 'op=<' 00:19:32.260 01:55:20 -- scripts/common.sh@339 -- # ver1_l=2 00:19:32.260 01:55:20 -- scripts/common.sh@340 -- # ver2_l=1 00:19:32.260 01:55:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:32.260 01:55:20 -- scripts/common.sh@343 -- # case "$op" in 00:19:32.260 01:55:20 -- scripts/common.sh@344 -- # : 1 00:19:32.260 01:55:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:32.260 01:55:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:32.260 01:55:20 -- scripts/common.sh@364 -- # decimal 1 00:19:32.260 01:55:20 -- scripts/common.sh@352 -- # local d=1 00:19:32.260 01:55:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:32.260 01:55:20 -- scripts/common.sh@354 -- # echo 1 00:19:32.260 01:55:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:32.260 01:55:20 -- scripts/common.sh@365 -- # decimal 2 00:19:32.260 01:55:20 -- scripts/common.sh@352 -- # local d=2 00:19:32.260 01:55:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:32.260 01:55:20 -- scripts/common.sh@354 -- # echo 2 00:19:32.260 01:55:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:32.260 01:55:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:32.260 01:55:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:32.260 01:55:20 -- scripts/common.sh@367 -- # return 0 00:19:32.260 01:55:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:32.260 01:55:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:32.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.260 --rc genhtml_branch_coverage=1 00:19:32.260 --rc genhtml_function_coverage=1 00:19:32.260 --rc genhtml_legend=1 00:19:32.260 --rc geninfo_all_blocks=1 00:19:32.260 --rc geninfo_unexecuted_blocks=1 00:19:32.260 00:19:32.260 ' 00:19:32.260 01:55:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:32.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.260 --rc genhtml_branch_coverage=1 00:19:32.260 --rc genhtml_function_coverage=1 00:19:32.260 --rc genhtml_legend=1 00:19:32.260 --rc geninfo_all_blocks=1 00:19:32.260 --rc geninfo_unexecuted_blocks=1 00:19:32.260 00:19:32.260 ' 00:19:32.260 01:55:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:32.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.260 --rc genhtml_branch_coverage=1 00:19:32.260 --rc genhtml_function_coverage=1 00:19:32.260 --rc genhtml_legend=1 00:19:32.260 --rc geninfo_all_blocks=1 00:19:32.260 --rc geninfo_unexecuted_blocks=1 00:19:32.260 00:19:32.260 ' 00:19:32.260 01:55:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:32.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.260 --rc genhtml_branch_coverage=1 00:19:32.260 --rc genhtml_function_coverage=1 00:19:32.260 --rc genhtml_legend=1 00:19:32.260 --rc geninfo_all_blocks=1 00:19:32.261 --rc geninfo_unexecuted_blocks=1 00:19:32.261 00:19:32.261 ' 00:19:32.261 01:55:20 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:32.261 01:55:20 -- nvmf/common.sh@7 -- # uname -s 00:19:32.261 01:55:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.261 01:55:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.261 01:55:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.261 01:55:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.261 01:55:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.261 01:55:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.261 01:55:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.261 01:55:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.261 01:55:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.261 01:55:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.261 01:55:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.261 01:55:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.261 01:55:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.261 01:55:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.261 01:55:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:32.261 01:55:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:32.261 01:55:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.261 01:55:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.261 01:55:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.261 01:55:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.261 01:55:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.261 01:55:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.261 01:55:20 -- paths/export.sh@5 -- # export PATH 00:19:32.261 01:55:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.261 01:55:20 -- nvmf/common.sh@46 -- # : 0 00:19:32.261 01:55:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:32.261 01:55:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:32.261 01:55:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:32.261 01:55:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.261 01:55:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.261 01:55:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:32.261 01:55:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:32.261 01:55:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:32.261 01:55:20 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:32.261 01:55:20 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:32.261 01:55:20 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:32.261 01:55:20 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:32.261 01:55:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:32.261 01:55:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.261 01:55:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:32.261 01:55:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:32.261 01:55:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:32.261 01:55:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.261 01:55:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:32.261 01:55:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.261 01:55:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:32.261 01:55:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:32.261 01:55:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:32.261 01:55:20 -- common/autotest_common.sh@10 -- # set +x 00:19:34.165 01:55:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:34.165 01:55:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:34.165 01:55:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:34.165 01:55:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:34.165 01:55:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:34.165 01:55:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:34.165 01:55:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:34.165 01:55:22 -- nvmf/common.sh@294 -- # net_devs=() 00:19:34.165 01:55:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:34.165 01:55:22 -- nvmf/common.sh@295 -- # e810=() 00:19:34.165 01:55:22 -- nvmf/common.sh@295 -- # local -ga e810 00:19:34.165 01:55:22 -- nvmf/common.sh@296 -- # x722=() 00:19:34.165 01:55:22 -- nvmf/common.sh@296 -- # local -ga x722 00:19:34.165 01:55:22 -- nvmf/common.sh@297 -- # mlx=() 00:19:34.165 01:55:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:34.165 01:55:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:34.165 01:55:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:34.165 01:55:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:34.165 01:55:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:34.165 01:55:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.165 01:55:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:34.165 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:34.165 01:55:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.165 01:55:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:34.165 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:34.165 01:55:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:34.165 01:55:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.165 01:55:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.165 01:55:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.165 01:55:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.165 01:55:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:34.165 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:34.165 01:55:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.165 01:55:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.165 01:55:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.165 01:55:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.165 01:55:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.165 01:55:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:34.165 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:34.165 01:55:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.165 01:55:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:34.165 01:55:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:34.165 01:55:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:34.165 01:55:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:34.165 01:55:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:34.165 01:55:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:34.165 01:55:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:34.165 01:55:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:34.165 01:55:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:34.165 01:55:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:34.165 01:55:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:34.165 01:55:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:34.165 01:55:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:34.165 01:55:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:34.165 01:55:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:34.165 01:55:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:34.165 01:55:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:34.165 01:55:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:34.165 01:55:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:34.165 01:55:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:34.165 01:55:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:34.165 01:55:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:34.165 01:55:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:34.165 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:34.165 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:19:34.165 00:19:34.165 --- 10.0.0.2 ping statistics --- 00:19:34.165 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.165 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:19:34.165 01:55:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:34.165 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:34.165 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:19:34.165 00:19:34.165 --- 10.0.0.1 ping statistics --- 00:19:34.165 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.165 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:19:34.165 01:55:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:34.165 01:55:22 -- nvmf/common.sh@410 -- # return 0 00:19:34.165 01:55:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:34.165 01:55:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:34.165 01:55:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:34.165 01:55:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:34.165 01:55:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:34.165 01:55:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:34.165 01:55:22 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:34.165 01:55:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:34.165 01:55:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:34.165 01:55:22 -- common/autotest_common.sh@10 -- # set +x 00:19:34.165 01:55:22 -- nvmf/common.sh@469 -- # nvmfpid=3479525 00:19:34.165 01:55:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:34.165 01:55:22 -- nvmf/common.sh@470 -- # waitforlisten 3479525 00:19:34.165 01:55:22 -- common/autotest_common.sh@829 -- # '[' -z 3479525 ']' 00:19:34.165 01:55:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:34.165 01:55:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:34.165 01:55:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:34.165 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:34.165 01:55:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:34.165 01:55:22 -- common/autotest_common.sh@10 -- # set +x 00:19:34.425 [2024-11-19 01:55:22.721084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:34.425 [2024-11-19 01:55:22.721176] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:34.425 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.425 [2024-11-19 01:55:22.791841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:34.425 [2024-11-19 01:55:22.912560] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:34.425 [2024-11-19 01:55:22.912732] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:34.425 [2024-11-19 01:55:22.912754] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:34.425 [2024-11-19 01:55:22.912769] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:34.425 [2024-11-19 01:55:22.912826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:34.425 [2024-11-19 01:55:22.912884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:34.425 [2024-11-19 01:55:22.912947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:34.425 [2024-11-19 01:55:22.912951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:35.362 01:55:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:35.362 01:55:23 -- common/autotest_common.sh@862 -- # return 0 00:19:35.362 01:55:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:35.362 01:55:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 01:55:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:35.362 01:55:23 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 [2024-11-19 01:55:23.706136] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:35.362 01:55:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.362 01:55:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 Malloc1 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 [2024-11-19 01:55:23.763330] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.362 01:55:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 Malloc2 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.362 01:55:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:35.362 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.362 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.362 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.363 01:55:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.363 Malloc3 00:19:35.363 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.363 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.363 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.363 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.363 01:55:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.363 Malloc4 00:19:35.363 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.363 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.363 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.363 01:55:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:35.363 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.363 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.676 01:55:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:35.676 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 Malloc5 00:19:35.676 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:35.676 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:35.676 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:23 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:35.676 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:23 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.676 01:55:23 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:35.676 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 Malloc6 00:19:35.676 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:23 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:35.676 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:23 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:35.676 01:55:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:23 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.676 01:55:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 Malloc7 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.676 01:55:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 Malloc8 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.676 01:55:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 Malloc9 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.676 01:55:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 Malloc10 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.676 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.676 01:55:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:35.676 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.676 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.959 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.959 01:55:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:35.959 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.959 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.959 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.959 01:55:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.959 01:55:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:35.959 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.959 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.959 Malloc11 00:19:35.959 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.959 01:55:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:35.959 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.959 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.959 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.959 01:55:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:35.959 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.959 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.959 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.960 01:55:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:35.960 01:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.960 01:55:24 -- common/autotest_common.sh@10 -- # set +x 00:19:35.960 01:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.960 01:55:24 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:35.960 01:55:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.960 01:55:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:36.524 01:55:24 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:36.524 01:55:24 -- common/autotest_common.sh@1187 -- # local i=0 00:19:36.524 01:55:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:36.524 01:55:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:36.524 01:55:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:38.421 01:55:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:38.421 01:55:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:38.421 01:55:26 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:38.421 01:55:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:38.421 01:55:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:38.421 01:55:26 -- common/autotest_common.sh@1197 -- # return 0 00:19:38.421 01:55:26 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:38.421 01:55:26 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:38.987 01:55:27 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:38.987 01:55:27 -- common/autotest_common.sh@1187 -- # local i=0 00:19:38.987 01:55:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:38.987 01:55:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:38.987 01:55:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:41.513 01:55:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:41.513 01:55:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:41.513 01:55:29 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:41.513 01:55:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:41.513 01:55:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:41.513 01:55:29 -- common/autotest_common.sh@1197 -- # return 0 00:19:41.513 01:55:29 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:41.513 01:55:29 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:41.771 01:55:30 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:41.771 01:55:30 -- common/autotest_common.sh@1187 -- # local i=0 00:19:41.771 01:55:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.771 01:55:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:41.771 01:55:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:44.298 01:55:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:44.298 01:55:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:44.298 01:55:32 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:44.298 01:55:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:44.298 01:55:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:44.298 01:55:32 -- common/autotest_common.sh@1197 -- # return 0 00:19:44.298 01:55:32 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:44.298 01:55:32 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:44.556 01:55:32 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:44.556 01:55:32 -- common/autotest_common.sh@1187 -- # local i=0 00:19:44.556 01:55:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:44.556 01:55:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:44.556 01:55:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:46.455 01:55:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:46.455 01:55:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:46.455 01:55:34 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:46.455 01:55:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:46.455 01:55:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:46.455 01:55:34 -- common/autotest_common.sh@1197 -- # return 0 00:19:46.455 01:55:34 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:46.455 01:55:34 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:47.388 01:55:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:47.388 01:55:35 -- common/autotest_common.sh@1187 -- # local i=0 00:19:47.388 01:55:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:47.388 01:55:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:47.388 01:55:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:49.286 01:55:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:49.286 01:55:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:49.286 01:55:37 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:49.286 01:55:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:49.286 01:55:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:49.286 01:55:37 -- common/autotest_common.sh@1197 -- # return 0 00:19:49.286 01:55:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.286 01:55:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:50.220 01:55:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:50.220 01:55:38 -- common/autotest_common.sh@1187 -- # local i=0 00:19:50.220 01:55:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:50.220 01:55:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:50.220 01:55:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:52.123 01:55:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:52.123 01:55:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:52.123 01:55:40 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:52.123 01:55:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:52.123 01:55:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:52.123 01:55:40 -- common/autotest_common.sh@1197 -- # return 0 00:19:52.123 01:55:40 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.123 01:55:40 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:53.057 01:55:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:53.057 01:55:41 -- common/autotest_common.sh@1187 -- # local i=0 00:19:53.057 01:55:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:53.057 01:55:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:53.057 01:55:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:54.955 01:55:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:54.955 01:55:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:54.955 01:55:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:54.955 01:55:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:54.955 01:55:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:54.955 01:55:43 -- common/autotest_common.sh@1197 -- # return 0 00:19:54.955 01:55:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.955 01:55:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:55.889 01:55:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:55.889 01:55:44 -- common/autotest_common.sh@1187 -- # local i=0 00:19:55.889 01:55:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:55.889 01:55:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:55.889 01:55:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:57.787 01:55:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:57.787 01:55:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:57.787 01:55:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:57.787 01:55:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:57.787 01:55:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:57.787 01:55:46 -- common/autotest_common.sh@1197 -- # return 0 00:19:57.787 01:55:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.787 01:55:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:58.720 01:55:46 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:58.720 01:55:46 -- common/autotest_common.sh@1187 -- # local i=0 00:19:58.721 01:55:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:58.721 01:55:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:58.721 01:55:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:00.617 01:55:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:00.617 01:55:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:00.617 01:55:48 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:20:00.617 01:55:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:00.617 01:55:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:00.617 01:55:48 -- common/autotest_common.sh@1197 -- # return 0 00:20:00.617 01:55:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:00.617 01:55:48 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:20:01.551 01:55:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:01.551 01:55:49 -- common/autotest_common.sh@1187 -- # local i=0 00:20:01.551 01:55:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:01.551 01:55:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:01.551 01:55:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:03.449 01:55:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:03.449 01:55:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:03.449 01:55:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:20:03.449 01:55:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:03.449 01:55:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:03.449 01:55:51 -- common/autotest_common.sh@1197 -- # return 0 00:20:03.449 01:55:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:03.449 01:55:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:04.383 01:55:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:04.383 01:55:52 -- common/autotest_common.sh@1187 -- # local i=0 00:20:04.383 01:55:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:04.383 01:55:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:04.383 01:55:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:06.282 01:55:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:06.282 01:55:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:06.282 01:55:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:06.282 01:55:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:06.282 01:55:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:06.282 01:55:54 -- common/autotest_common.sh@1197 -- # return 0 00:20:06.282 01:55:54 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:06.282 [global] 00:20:06.282 thread=1 00:20:06.282 invalidate=1 00:20:06.282 rw=read 00:20:06.282 time_based=1 00:20:06.282 runtime=10 00:20:06.282 ioengine=libaio 00:20:06.282 direct=1 00:20:06.282 bs=262144 00:20:06.282 iodepth=64 00:20:06.282 norandommap=1 00:20:06.282 numjobs=1 00:20:06.282 00:20:06.282 [job0] 00:20:06.282 filename=/dev/nvme0n1 00:20:06.282 [job1] 00:20:06.282 filename=/dev/nvme10n1 00:20:06.282 [job2] 00:20:06.282 filename=/dev/nvme1n1 00:20:06.282 [job3] 00:20:06.282 filename=/dev/nvme2n1 00:20:06.282 [job4] 00:20:06.282 filename=/dev/nvme3n1 00:20:06.282 [job5] 00:20:06.282 filename=/dev/nvme4n1 00:20:06.282 [job6] 00:20:06.282 filename=/dev/nvme5n1 00:20:06.282 [job7] 00:20:06.282 filename=/dev/nvme6n1 00:20:06.282 [job8] 00:20:06.282 filename=/dev/nvme7n1 00:20:06.282 [job9] 00:20:06.282 filename=/dev/nvme8n1 00:20:06.282 [job10] 00:20:06.282 filename=/dev/nvme9n1 00:20:06.540 Could not set queue depth (nvme0n1) 00:20:06.540 Could not set queue depth (nvme10n1) 00:20:06.540 Could not set queue depth (nvme1n1) 00:20:06.540 Could not set queue depth (nvme2n1) 00:20:06.540 Could not set queue depth (nvme3n1) 00:20:06.540 Could not set queue depth (nvme4n1) 00:20:06.540 Could not set queue depth (nvme5n1) 00:20:06.540 Could not set queue depth (nvme6n1) 00:20:06.540 Could not set queue depth (nvme7n1) 00:20:06.540 Could not set queue depth (nvme8n1) 00:20:06.540 Could not set queue depth (nvme9n1) 00:20:06.540 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.540 fio-3.35 00:20:06.540 Starting 11 threads 00:20:18.744 00:20:18.744 job0: (groupid=0, jobs=1): err= 0: pid=3483902: Tue Nov 19 01:56:05 2024 00:20:18.744 read: IOPS=591, BW=148MiB/s (155MB/s)(1492MiB/10093msec) 00:20:18.744 slat (usec): min=8, max=112138, avg=961.18, stdev=4467.62 00:20:18.744 clat (msec): min=2, max=311, avg=107.22, stdev=51.91 00:20:18.744 lat (msec): min=2, max=311, avg=108.18, stdev=52.51 00:20:18.744 clat percentiles (msec): 00:20:18.744 | 1.00th=[ 8], 5.00th=[ 23], 10.00th=[ 38], 20.00th=[ 57], 00:20:18.744 | 30.00th=[ 68], 40.00th=[ 92], 50.00th=[ 113], 60.00th=[ 128], 00:20:18.744 | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 176], 95.00th=[ 192], 00:20:18.744 | 99.00th=[ 211], 99.50th=[ 215], 99.90th=[ 230], 99.95th=[ 313], 00:20:18.744 | 99.99th=[ 313] 00:20:18.744 bw ( KiB/s): min=94720, max=284672, per=7.79%, avg=151091.00, stdev=45278.00, samples=20 00:20:18.744 iops : min= 370, max= 1112, avg=590.15, stdev=176.89, samples=20 00:20:18.744 lat (msec) : 4=0.37%, 10=1.32%, 20=2.41%, 50=10.37%, 100=28.14% 00:20:18.744 lat (msec) : 250=57.30%, 500=0.08% 00:20:18.744 cpu : usr=0.29%, sys=1.63%, ctx=1253, majf=0, minf=3724 00:20:18.744 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:18.744 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.744 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.744 issued rwts: total=5967,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.744 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.744 job1: (groupid=0, jobs=1): err= 0: pid=3483903: Tue Nov 19 01:56:05 2024 00:20:18.744 read: IOPS=1210, BW=303MiB/s (317MB/s)(3050MiB/10082msec) 00:20:18.744 slat (usec): min=8, max=41006, avg=757.55, stdev=2546.75 00:20:18.744 clat (msec): min=5, max=188, avg=52.09, stdev=25.63 00:20:18.744 lat (msec): min=6, max=202, avg=52.85, stdev=25.99 00:20:18.744 clat percentiles (msec): 00:20:18.744 | 1.00th=[ 17], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 33], 00:20:18.744 | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 44], 60.00th=[ 51], 00:20:18.744 | 70.00th=[ 58], 80.00th=[ 69], 90.00th=[ 92], 95.00th=[ 107], 00:20:18.744 | 99.00th=[ 136], 99.50th=[ 142], 99.90th=[ 180], 99.95th=[ 180], 00:20:18.744 | 99.99th=[ 188] 00:20:18.744 bw ( KiB/s): min=154624, max=457728, per=16.01%, avg=310633.55, stdev=102407.07, samples=20 00:20:18.744 iops : min= 604, max= 1788, avg=1213.35, stdev=400.08, samples=20 00:20:18.744 lat (msec) : 10=0.24%, 20=1.36%, 50=58.43%, 100=33.25%, 250=6.73% 00:20:18.744 cpu : usr=0.79%, sys=3.88%, ctx=1528, majf=0, minf=4097 00:20:18.744 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:20:18.744 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.744 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.744 issued rwts: total=12200,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.744 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.744 job2: (groupid=0, jobs=1): err= 0: pid=3483904: Tue Nov 19 01:56:05 2024 00:20:18.744 read: IOPS=849, BW=212MiB/s (223MB/s)(2126MiB/10012msec) 00:20:18.744 slat (usec): min=12, max=49174, avg=1153.39, stdev=3624.46 00:20:18.744 clat (msec): min=6, max=182, avg=74.13, stdev=40.58 00:20:18.744 lat (msec): min=14, max=184, avg=75.29, stdev=41.20 00:20:18.744 clat percentiles (msec): 00:20:18.744 | 1.00th=[ 27], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 33], 00:20:18.744 | 30.00th=[ 37], 40.00th=[ 49], 50.00th=[ 62], 60.00th=[ 90], 00:20:18.744 | 70.00th=[ 106], 80.00th=[ 117], 90.00th=[ 131], 95.00th=[ 142], 00:20:18.744 | 99.00th=[ 159], 99.50th=[ 165], 99.90th=[ 178], 99.95th=[ 182], 00:20:18.744 | 99.99th=[ 184] 00:20:18.744 bw ( KiB/s): min=112640, max=516096, per=10.81%, avg=209699.53, stdev=126693.14, samples=19 00:20:18.744 iops : min= 440, max= 2016, avg=819.05, stdev=494.94, samples=19 00:20:18.744 lat (msec) : 10=0.01%, 20=0.22%, 50=40.87%, 100=24.97%, 250=33.92% 00:20:18.744 cpu : usr=0.59%, sys=2.87%, ctx=1364, majf=0, minf=4098 00:20:18.744 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:18.744 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.744 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.744 issued rwts: total=8505,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.744 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.744 job3: (groupid=0, jobs=1): err= 0: pid=3483905: Tue Nov 19 01:56:05 2024 00:20:18.744 read: IOPS=557, BW=139MiB/s (146MB/s)(1395MiB/10010msec) 00:20:18.744 slat (usec): min=9, max=95932, avg=1412.49, stdev=5787.03 00:20:18.744 clat (usec): min=876, max=286705, avg=113361.43, stdev=59972.67 00:20:18.744 lat (usec): min=936, max=307370, avg=114773.93, stdev=60920.19 00:20:18.744 clat percentiles (msec): 00:20:18.744 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 18], 20.00th=[ 30], 00:20:18.744 | 30.00th=[ 95], 40.00th=[ 120], 50.00th=[ 132], 60.00th=[ 140], 00:20:18.744 | 70.00th=[ 148], 80.00th=[ 163], 90.00th=[ 182], 95.00th=[ 197], 00:20:18.744 | 99.00th=[ 215], 99.50th=[ 220], 99.90th=[ 247], 99.95th=[ 284], 00:20:18.744 | 99.99th=[ 288] 00:20:18.744 bw ( KiB/s): min=79360, max=185344, per=6.33%, avg=122879.89, stdev=26201.59, samples=19 00:20:18.744 iops : min= 310, max= 724, avg=479.95, stdev=102.31, samples=19 00:20:18.744 lat (usec) : 1000=0.02% 00:20:18.744 lat (msec) : 2=0.45%, 4=0.90%, 10=3.32%, 20=7.31%, 50=12.03% 00:20:18.744 lat (msec) : 100=7.42%, 250=68.50%, 500=0.05% 00:20:18.744 cpu : usr=0.38%, sys=1.69%, ctx=1146, majf=0, minf=4097 00:20:18.744 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:18.744 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.745 issued rwts: total=5578,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.745 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.745 job4: (groupid=0, jobs=1): err= 0: pid=3483906: Tue Nov 19 01:56:05 2024 00:20:18.745 read: IOPS=580, BW=145MiB/s (152MB/s)(1464MiB/10082msec) 00:20:18.745 slat (usec): min=9, max=98985, avg=1450.28, stdev=5056.83 00:20:18.745 clat (usec): min=923, max=247176, avg=108632.91, stdev=51230.99 00:20:18.745 lat (usec): min=966, max=271514, avg=110083.19, stdev=51980.15 00:20:18.745 clat percentiles (msec): 00:20:18.745 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 27], 20.00th=[ 50], 00:20:18.745 | 30.00th=[ 95], 40.00th=[ 111], 50.00th=[ 121], 60.00th=[ 129], 00:20:18.745 | 70.00th=[ 138], 80.00th=[ 148], 90.00th=[ 169], 95.00th=[ 184], 00:20:18.745 | 99.00th=[ 209], 99.50th=[ 213], 99.90th=[ 224], 99.95th=[ 247], 00:20:18.745 | 99.99th=[ 247] 00:20:18.745 bw ( KiB/s): min=93184, max=369152, per=7.64%, avg=148292.90, stdev=59787.21, samples=20 00:20:18.745 iops : min= 364, max= 1442, avg=579.20, stdev=233.54, samples=20 00:20:18.745 lat (usec) : 1000=0.02% 00:20:18.745 lat (msec) : 2=0.17%, 4=0.48%, 10=1.83%, 20=4.18%, 50=13.49% 00:20:18.745 lat (msec) : 100=12.65%, 250=67.18% 00:20:18.745 cpu : usr=0.34%, sys=2.08%, ctx=1171, majf=0, minf=4097 00:20:18.745 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:18.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.745 issued rwts: total=5857,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.745 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.745 job5: (groupid=0, jobs=1): err= 0: pid=3483917: Tue Nov 19 01:56:05 2024 00:20:18.745 read: IOPS=531, BW=133MiB/s (139MB/s)(1341MiB/10094msec) 00:20:18.745 slat (usec): min=9, max=104606, avg=1499.53, stdev=5809.02 00:20:18.745 clat (usec): min=1933, max=286025, avg=118896.41, stdev=50677.77 00:20:18.745 lat (usec): min=1961, max=294913, avg=120395.94, stdev=51610.32 00:20:18.745 clat percentiles (msec): 00:20:18.745 | 1.00th=[ 9], 5.00th=[ 33], 10.00th=[ 45], 20.00th=[ 72], 00:20:18.745 | 30.00th=[ 87], 40.00th=[ 108], 50.00th=[ 129], 60.00th=[ 138], 00:20:18.745 | 70.00th=[ 148], 80.00th=[ 163], 90.00th=[ 184], 95.00th=[ 199], 00:20:18.745 | 99.00th=[ 213], 99.50th=[ 222], 99.90th=[ 251], 99.95th=[ 288], 00:20:18.745 | 99.99th=[ 288] 00:20:18.745 bw ( KiB/s): min=78848, max=290816, per=6.99%, avg=135629.30, stdev=52620.20, samples=20 00:20:18.745 iops : min= 308, max= 1136, avg=529.75, stdev=205.55, samples=20 00:20:18.745 lat (msec) : 2=0.02%, 4=0.34%, 10=0.84%, 20=1.29%, 50=8.52% 00:20:18.745 lat (msec) : 100=24.71%, 250=64.19%, 500=0.09% 00:20:18.745 cpu : usr=0.29%, sys=1.86%, ctx=1000, majf=0, minf=4097 00:20:18.745 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:18.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.745 issued rwts: total=5362,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.745 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.745 job6: (groupid=0, jobs=1): err= 0: pid=3483930: Tue Nov 19 01:56:05 2024 00:20:18.745 read: IOPS=435, BW=109MiB/s (114MB/s)(1098MiB/10082msec) 00:20:18.745 slat (usec): min=13, max=73595, avg=2161.31, stdev=6393.04 00:20:18.745 clat (msec): min=9, max=266, avg=144.69, stdev=36.91 00:20:18.745 lat (msec): min=9, max=266, avg=146.85, stdev=37.61 00:20:18.745 clat percentiles (msec): 00:20:18.745 | 1.00th=[ 33], 5.00th=[ 84], 10.00th=[ 95], 20.00th=[ 118], 00:20:18.745 | 30.00th=[ 128], 40.00th=[ 138], 50.00th=[ 144], 60.00th=[ 155], 00:20:18.745 | 70.00th=[ 165], 80.00th=[ 176], 90.00th=[ 194], 95.00th=[ 205], 00:20:18.745 | 99.00th=[ 220], 99.50th=[ 226], 99.90th=[ 247], 99.95th=[ 253], 00:20:18.745 | 99.99th=[ 268] 00:20:18.745 bw ( KiB/s): min=78848, max=155648, per=5.71%, avg=110737.95, stdev=20478.89, samples=20 00:20:18.745 iops : min= 308, max= 608, avg=432.50, stdev=79.98, samples=20 00:20:18.745 lat (msec) : 10=0.02%, 20=0.50%, 50=0.62%, 100=10.64%, 250=88.15% 00:20:18.745 lat (msec) : 500=0.07% 00:20:18.745 cpu : usr=0.35%, sys=1.66%, ctx=824, majf=0, minf=4097 00:20:18.745 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:18.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.745 issued rwts: total=4390,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.745 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.745 job7: (groupid=0, jobs=1): err= 0: pid=3483938: Tue Nov 19 01:56:05 2024 00:20:18.745 read: IOPS=578, BW=145MiB/s (152MB/s)(1460MiB/10095msec) 00:20:18.745 slat (usec): min=13, max=77472, avg=1647.11, stdev=4838.95 00:20:18.745 clat (msec): min=12, max=262, avg=108.90, stdev=47.59 00:20:18.745 lat (msec): min=13, max=262, avg=110.55, stdev=48.34 00:20:18.745 clat percentiles (msec): 00:20:18.745 | 1.00th=[ 36], 5.00th=[ 48], 10.00th=[ 52], 20.00th=[ 59], 00:20:18.745 | 30.00th=[ 69], 40.00th=[ 89], 50.00th=[ 112], 60.00th=[ 126], 00:20:18.745 | 70.00th=[ 136], 80.00th=[ 150], 90.00th=[ 176], 95.00th=[ 194], 00:20:18.745 | 99.00th=[ 211], 99.50th=[ 220], 99.90th=[ 245], 99.95th=[ 264], 00:20:18.745 | 99.99th=[ 264] 00:20:18.745 bw ( KiB/s): min=77824, max=312207, per=7.62%, avg=147820.80, stdev=66704.88, samples=20 00:20:18.745 iops : min= 304, max= 1219, avg=577.35, stdev=260.50, samples=20 00:20:18.745 lat (msec) : 20=0.26%, 50=6.78%, 100=37.74%, 250=55.17%, 500=0.05% 00:20:18.745 cpu : usr=0.31%, sys=2.16%, ctx=1080, majf=0, minf=4098 00:20:18.745 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:18.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.745 issued rwts: total=5840,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.745 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.745 job8: (groupid=0, jobs=1): err= 0: pid=3483984: Tue Nov 19 01:56:05 2024 00:20:18.745 read: IOPS=719, BW=180MiB/s (189MB/s)(1816MiB/10094msec) 00:20:18.745 slat (usec): min=8, max=129959, avg=920.13, stdev=4650.50 00:20:18.745 clat (usec): min=1206, max=290839, avg=87958.46, stdev=57800.50 00:20:18.745 lat (usec): min=1240, max=321269, avg=88878.59, stdev=58382.39 00:20:18.745 clat percentiles (msec): 00:20:18.745 | 1.00th=[ 10], 5.00th=[ 20], 10.00th=[ 29], 20.00th=[ 35], 00:20:18.745 | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 64], 60.00th=[ 91], 00:20:18.745 | 70.00th=[ 128], 80.00th=[ 146], 90.00th=[ 178], 95.00th=[ 192], 00:20:18.745 | 99.00th=[ 213], 99.50th=[ 218], 99.90th=[ 222], 99.95th=[ 284], 00:20:18.745 | 99.99th=[ 292] 00:20:18.745 bw ( KiB/s): min=99328, max=419328, per=9.50%, avg=184290.75, stdev=87746.49, samples=20 00:20:18.745 iops : min= 388, max= 1638, avg=719.85, stdev=342.71, samples=20 00:20:18.745 lat (msec) : 2=0.08%, 4=0.18%, 10=1.20%, 20=3.80%, 50=29.93% 00:20:18.745 lat (msec) : 100=26.31%, 250=38.45%, 500=0.06% 00:20:18.745 cpu : usr=0.33%, sys=2.15%, ctx=1463, majf=0, minf=4097 00:20:18.745 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:18.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.745 issued rwts: total=7264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.745 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.745 job9: (groupid=0, jobs=1): err= 0: pid=3484008: Tue Nov 19 01:56:05 2024 00:20:18.745 read: IOPS=538, BW=135MiB/s (141MB/s)(1365MiB/10134msec) 00:20:18.745 slat (usec): min=9, max=111987, avg=1250.65, stdev=5489.00 00:20:18.745 clat (usec): min=792, max=282011, avg=117459.94, stdev=57493.53 00:20:18.745 lat (usec): min=817, max=282033, avg=118710.60, stdev=58233.95 00:20:18.745 clat percentiles (msec): 00:20:18.745 | 1.00th=[ 6], 5.00th=[ 13], 10.00th=[ 24], 20.00th=[ 66], 00:20:18.745 | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 125], 60.00th=[ 140], 00:20:18.745 | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 190], 95.00th=[ 205], 00:20:18.745 | 99.00th=[ 220], 99.50th=[ 230], 99.90th=[ 243], 99.95th=[ 271], 00:20:18.745 | 99.99th=[ 284] 00:20:18.745 bw ( KiB/s): min=84992, max=197632, per=7.12%, avg=138057.70, stdev=34411.53, samples=20 00:20:18.745 iops : min= 332, max= 772, avg=539.25, stdev=134.39, samples=20 00:20:18.745 lat (usec) : 1000=0.02% 00:20:18.745 lat (msec) : 2=0.09%, 4=0.51%, 10=2.64%, 20=5.53%, 50=7.38% 00:20:18.745 lat (msec) : 100=20.25%, 250=63.50%, 500=0.07% 00:20:18.745 cpu : usr=0.20%, sys=1.65%, ctx=1290, majf=0, minf=4097 00:20:18.745 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:18.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.746 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.746 issued rwts: total=5458,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.746 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.746 job10: (groupid=0, jobs=1): err= 0: pid=3484025: Tue Nov 19 01:56:05 2024 00:20:18.746 read: IOPS=1029, BW=257MiB/s (270MB/s)(2594MiB/10082msec) 00:20:18.746 slat (usec): min=8, max=111791, avg=687.43, stdev=3672.59 00:20:18.746 clat (usec): min=721, max=258170, avg=61461.52, stdev=51094.31 00:20:18.746 lat (usec): min=751, max=258217, avg=62148.95, stdev=51677.97 00:20:18.746 clat percentiles (msec): 00:20:18.746 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 18], 20.00th=[ 28], 00:20:18.746 | 30.00th=[ 32], 40.00th=[ 34], 50.00th=[ 36], 60.00th=[ 42], 00:20:18.746 | 70.00th=[ 70], 80.00th=[ 117], 90.00th=[ 142], 95.00th=[ 163], 00:20:18.746 | 99.00th=[ 213], 99.50th=[ 224], 99.90th=[ 232], 99.95th=[ 234], 00:20:18.746 | 99.99th=[ 245] 00:20:18.746 bw ( KiB/s): min=77824, max=475136, per=13.61%, avg=263937.50, stdev=131687.09, samples=20 00:20:18.746 iops : min= 304, max= 1856, avg=1030.95, stdev=514.41, samples=20 00:20:18.746 lat (usec) : 750=0.02%, 1000=0.05% 00:20:18.746 lat (msec) : 2=0.75%, 4=0.38%, 10=3.82%, 20=6.73%, 50=52.62% 00:20:18.746 lat (msec) : 100=12.25%, 250=23.38%, 500=0.01% 00:20:18.746 cpu : usr=0.49%, sys=3.13%, ctx=1978, majf=0, minf=4097 00:20:18.746 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:18.746 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:18.746 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:18.746 issued rwts: total=10375,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:18.746 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:18.746 00:20:18.746 Run status group 0 (all jobs): 00:20:18.746 READ: bw=1895MiB/s (1987MB/s), 109MiB/s-303MiB/s (114MB/s-317MB/s), io=18.7GiB (20.1GB), run=10010-10134msec 00:20:18.746 00:20:18.746 Disk stats (read/write): 00:20:18.746 nvme0n1: ios=11756/0, merge=0/0, ticks=1242434/0, in_queue=1242434, util=97.18% 00:20:18.746 nvme10n1: ios=24213/0, merge=0/0, ticks=1234535/0, in_queue=1234535, util=97.37% 00:20:18.746 nvme1n1: ios=16650/0, merge=0/0, ticks=1238128/0, in_queue=1238128, util=97.64% 00:20:18.746 nvme2n1: ios=10733/0, merge=0/0, ticks=1239034/0, in_queue=1239034, util=97.77% 00:20:18.746 nvme3n1: ios=11518/0, merge=0/0, ticks=1233585/0, in_queue=1233585, util=97.84% 00:20:18.746 nvme4n1: ios=10533/0, merge=0/0, ticks=1232668/0, in_queue=1232668, util=98.16% 00:20:18.746 nvme5n1: ios=8566/0, merge=0/0, ticks=1230022/0, in_queue=1230022, util=98.32% 00:20:18.746 nvme6n1: ios=11466/0, merge=0/0, ticks=1229183/0, in_queue=1229183, util=98.46% 00:20:18.746 nvme7n1: ios=14341/0, merge=0/0, ticks=1240307/0, in_queue=1240307, util=98.88% 00:20:18.746 nvme8n1: ios=10729/0, merge=0/0, ticks=1237093/0, in_queue=1237093, util=99.11% 00:20:18.746 nvme9n1: ios=20544/0, merge=0/0, ticks=1235628/0, in_queue=1235628, util=99.24% 00:20:18.746 01:56:05 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:18.746 [global] 00:20:18.746 thread=1 00:20:18.746 invalidate=1 00:20:18.746 rw=randwrite 00:20:18.746 time_based=1 00:20:18.746 runtime=10 00:20:18.746 ioengine=libaio 00:20:18.746 direct=1 00:20:18.746 bs=262144 00:20:18.746 iodepth=64 00:20:18.746 norandommap=1 00:20:18.746 numjobs=1 00:20:18.746 00:20:18.746 [job0] 00:20:18.746 filename=/dev/nvme0n1 00:20:18.746 [job1] 00:20:18.746 filename=/dev/nvme10n1 00:20:18.746 [job2] 00:20:18.746 filename=/dev/nvme1n1 00:20:18.746 [job3] 00:20:18.746 filename=/dev/nvme2n1 00:20:18.746 [job4] 00:20:18.746 filename=/dev/nvme3n1 00:20:18.746 [job5] 00:20:18.746 filename=/dev/nvme4n1 00:20:18.746 [job6] 00:20:18.746 filename=/dev/nvme5n1 00:20:18.746 [job7] 00:20:18.746 filename=/dev/nvme6n1 00:20:18.746 [job8] 00:20:18.746 filename=/dev/nvme7n1 00:20:18.746 [job9] 00:20:18.746 filename=/dev/nvme8n1 00:20:18.746 [job10] 00:20:18.746 filename=/dev/nvme9n1 00:20:18.746 Could not set queue depth (nvme0n1) 00:20:18.746 Could not set queue depth (nvme10n1) 00:20:18.746 Could not set queue depth (nvme1n1) 00:20:18.746 Could not set queue depth (nvme2n1) 00:20:18.746 Could not set queue depth (nvme3n1) 00:20:18.746 Could not set queue depth (nvme4n1) 00:20:18.746 Could not set queue depth (nvme5n1) 00:20:18.746 Could not set queue depth (nvme6n1) 00:20:18.746 Could not set queue depth (nvme7n1) 00:20:18.746 Could not set queue depth (nvme8n1) 00:20:18.746 Could not set queue depth (nvme9n1) 00:20:18.746 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:18.746 fio-3.35 00:20:18.746 Starting 11 threads 00:20:28.777 00:20:28.777 job0: (groupid=0, jobs=1): err= 0: pid=3485117: Tue Nov 19 01:56:16 2024 00:20:28.777 write: IOPS=508, BW=127MiB/s (133MB/s)(1286MiB/10118msec); 0 zone resets 00:20:28.777 slat (usec): min=23, max=58069, avg=1650.96, stdev=3511.19 00:20:28.777 clat (msec): min=2, max=254, avg=124.22, stdev=42.26 00:20:28.777 lat (msec): min=2, max=254, avg=125.87, stdev=42.78 00:20:28.777 clat percentiles (msec): 00:20:28.777 | 1.00th=[ 11], 5.00th=[ 49], 10.00th=[ 63], 20.00th=[ 90], 00:20:28.778 | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 130], 60.00th=[ 138], 00:20:28.778 | 70.00th=[ 144], 80.00th=[ 150], 90.00th=[ 169], 95.00th=[ 197], 00:20:28.778 | 99.00th=[ 226], 99.50th=[ 234], 99.90th=[ 245], 99.95th=[ 249], 00:20:28.778 | 99.99th=[ 255] 00:20:28.778 bw ( KiB/s): min=79872, max=217088, per=8.65%, avg=129983.75, stdev=28297.20, samples=20 00:20:28.778 iops : min= 312, max= 848, avg=507.65, stdev=110.54, samples=20 00:20:28.778 lat (msec) : 4=0.12%, 10=0.76%, 20=0.95%, 50=4.86%, 100=17.46% 00:20:28.778 lat (msec) : 250=75.81%, 500=0.04% 00:20:28.778 cpu : usr=1.70%, sys=1.64%, ctx=1978, majf=0, minf=1 00:20:28.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:28.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.778 issued rwts: total=0,5143,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.778 job1: (groupid=0, jobs=1): err= 0: pid=3485118: Tue Nov 19 01:56:16 2024 00:20:28.778 write: IOPS=526, BW=132MiB/s (138MB/s)(1335MiB/10149msec); 0 zone resets 00:20:28.778 slat (usec): min=16, max=54981, avg=1335.29, stdev=3336.16 00:20:28.778 clat (msec): min=3, max=318, avg=120.22, stdev=49.60 00:20:28.778 lat (msec): min=4, max=318, avg=121.55, stdev=50.18 00:20:28.778 clat percentiles (msec): 00:20:28.778 | 1.00th=[ 16], 5.00th=[ 34], 10.00th=[ 53], 20.00th=[ 78], 00:20:28.778 | 30.00th=[ 97], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 140], 00:20:28.778 | 70.00th=[ 144], 80.00th=[ 153], 90.00th=[ 169], 95.00th=[ 213], 00:20:28.778 | 99.00th=[ 262], 99.50th=[ 288], 99.90th=[ 309], 99.95th=[ 313], 00:20:28.778 | 99.99th=[ 317] 00:20:28.778 bw ( KiB/s): min=75776, max=198770, per=8.99%, avg=135073.45, stdev=31115.61, samples=20 00:20:28.778 iops : min= 296, max= 776, avg=527.60, stdev=121.50, samples=20 00:20:28.778 lat (msec) : 4=0.02%, 10=0.45%, 20=1.39%, 50=7.40%, 100=22.21% 00:20:28.778 lat (msec) : 250=67.40%, 500=1.14% 00:20:28.778 cpu : usr=1.83%, sys=1.70%, ctx=2777, majf=0, minf=1 00:20:28.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:28.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.778 issued rwts: total=0,5341,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.778 job2: (groupid=0, jobs=1): err= 0: pid=3485129: Tue Nov 19 01:56:16 2024 00:20:28.778 write: IOPS=415, BW=104MiB/s (109MB/s)(1062MiB/10216msec); 0 zone resets 00:20:28.778 slat (usec): min=17, max=48975, avg=1872.34, stdev=4636.96 00:20:28.778 clat (msec): min=2, max=504, avg=151.95, stdev=71.78 00:20:28.778 lat (msec): min=3, max=504, avg=153.82, stdev=72.85 00:20:28.778 clat percentiles (msec): 00:20:28.778 | 1.00th=[ 11], 5.00th=[ 32], 10.00th=[ 57], 20.00th=[ 95], 00:20:28.778 | 30.00th=[ 117], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 165], 00:20:28.778 | 70.00th=[ 182], 80.00th=[ 201], 90.00th=[ 236], 95.00th=[ 266], 00:20:28.778 | 99.00th=[ 359], 99.50th=[ 414], 99.90th=[ 489], 99.95th=[ 489], 00:20:28.778 | 99.99th=[ 506] 00:20:28.778 bw ( KiB/s): min=51097, max=190976, per=7.13%, avg=107084.90, stdev=32285.05, samples=20 00:20:28.778 iops : min= 199, max= 746, avg=418.25, stdev=126.18, samples=20 00:20:28.778 lat (msec) : 4=0.12%, 10=0.78%, 20=1.88%, 50=5.70%, 100=13.56% 00:20:28.778 lat (msec) : 250=71.28%, 500=6.64%, 750=0.05% 00:20:28.778 cpu : usr=1.32%, sys=1.54%, ctx=2017, majf=0, minf=1 00:20:28.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:28.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.778 issued rwts: total=0,4248,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.778 job3: (groupid=0, jobs=1): err= 0: pid=3485147: Tue Nov 19 01:56:16 2024 00:20:28.778 write: IOPS=668, BW=167MiB/s (175MB/s)(1706MiB/10211msec); 0 zone resets 00:20:28.778 slat (usec): min=17, max=142674, avg=1262.10, stdev=3454.14 00:20:28.778 clat (msec): min=3, max=586, avg=94.47, stdev=63.77 00:20:28.778 lat (msec): min=4, max=586, avg=95.74, stdev=64.56 00:20:28.778 clat percentiles (msec): 00:20:28.778 | 1.00th=[ 15], 5.00th=[ 30], 10.00th=[ 41], 20.00th=[ 43], 00:20:28.778 | 30.00th=[ 50], 40.00th=[ 72], 50.00th=[ 82], 60.00th=[ 101], 00:20:28.778 | 70.00th=[ 117], 80.00th=[ 142], 90.00th=[ 155], 95.00th=[ 165], 00:20:28.778 | 99.00th=[ 393], 99.50th=[ 422], 99.90th=[ 550], 99.95th=[ 567], 00:20:28.778 | 99.99th=[ 584] 00:20:28.778 bw ( KiB/s): min=43433, max=384000, per=11.52%, avg=173022.70, stdev=87468.23, samples=20 00:20:28.778 iops : min= 169, max= 1500, avg=675.75, stdev=341.68, samples=20 00:20:28.778 lat (msec) : 4=0.01%, 10=0.44%, 20=2.45%, 50=27.29%, 100=29.58% 00:20:28.778 lat (msec) : 250=37.89%, 500=2.13%, 750=0.21% 00:20:28.778 cpu : usr=2.35%, sys=2.14%, ctx=2605, majf=0, minf=2 00:20:28.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:28.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.778 issued rwts: total=0,6822,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.778 job4: (groupid=0, jobs=1): err= 0: pid=3485148: Tue Nov 19 01:56:16 2024 00:20:28.778 write: IOPS=579, BW=145MiB/s (152MB/s)(1455MiB/10046msec); 0 zone resets 00:20:28.778 slat (usec): min=15, max=27373, avg=1414.99, stdev=3316.75 00:20:28.778 clat (usec): min=798, max=263149, avg=109029.17, stdev=58720.30 00:20:28.778 lat (usec): min=868, max=263205, avg=110444.16, stdev=59504.02 00:20:28.778 clat percentiles (msec): 00:20:28.778 | 1.00th=[ 4], 5.00th=[ 34], 10.00th=[ 44], 20.00th=[ 53], 00:20:28.778 | 30.00th=[ 58], 40.00th=[ 87], 50.00th=[ 102], 60.00th=[ 130], 00:20:28.778 | 70.00th=[ 146], 80.00th=[ 161], 90.00th=[ 182], 95.00th=[ 218], 00:20:28.778 | 99.00th=[ 253], 99.50th=[ 257], 99.90th=[ 262], 99.95th=[ 264], 00:20:28.778 | 99.99th=[ 264] 00:20:28.778 bw ( KiB/s): min=71680, max=303520, per=9.80%, avg=147301.40, stdev=69413.44, samples=20 00:20:28.778 iops : min= 280, max= 1185, avg=575.35, stdev=271.08, samples=20 00:20:28.778 lat (usec) : 1000=0.09% 00:20:28.778 lat (msec) : 2=0.46%, 4=0.76%, 10=1.32%, 20=0.91%, 50=10.86% 00:20:28.778 lat (msec) : 100=35.02%, 250=49.08%, 500=1.50% 00:20:28.778 cpu : usr=1.85%, sys=1.90%, ctx=2390, majf=0, minf=1 00:20:28.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:28.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.778 issued rwts: total=0,5819,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.778 job5: (groupid=0, jobs=1): err= 0: pid=3485155: Tue Nov 19 01:56:16 2024 00:20:28.778 write: IOPS=600, BW=150MiB/s (158MB/s)(1534MiB/10209msec); 0 zone resets 00:20:28.778 slat (usec): min=21, max=92755, avg=1184.81, stdev=4000.70 00:20:28.778 clat (usec): min=1856, max=547225, avg=105161.92, stdev=73193.45 00:20:28.778 lat (usec): min=1899, max=547255, avg=106346.73, stdev=74085.72 00:20:28.778 clat percentiles (msec): 00:20:28.778 | 1.00th=[ 7], 5.00th=[ 17], 10.00th=[ 28], 20.00th=[ 48], 00:20:28.778 | 30.00th=[ 52], 40.00th=[ 74], 50.00th=[ 102], 60.00th=[ 123], 00:20:28.778 | 70.00th=[ 138], 80.00th=[ 148], 90.00th=[ 167], 95.00th=[ 230], 00:20:28.778 | 99.00th=[ 401], 99.50th=[ 414], 99.90th=[ 514], 99.95th=[ 531], 00:20:28.778 | 99.99th=[ 550] 00:20:28.778 bw ( KiB/s): min=38912, max=308736, per=10.34%, avg=155333.30, stdev=67228.53, samples=20 00:20:28.778 iops : min= 152, max= 1206, avg=606.70, stdev=262.66, samples=20 00:20:28.778 lat (msec) : 2=0.03%, 4=0.36%, 10=1.79%, 20=3.99%, 50=21.39% 00:20:28.778 lat (msec) : 100=22.04%, 250=46.53%, 500=3.70%, 750=0.16% 00:20:28.778 cpu : usr=1.76%, sys=2.33%, ctx=3241, majf=0, minf=1 00:20:28.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:28.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.778 issued rwts: total=0,6134,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.778 job6: (groupid=0, jobs=1): err= 0: pid=3485167: Tue Nov 19 01:56:16 2024 00:20:28.778 write: IOPS=412, BW=103MiB/s (108MB/s)(1052MiB/10210msec); 0 zone resets 00:20:28.778 slat (usec): min=25, max=71825, avg=2199.87, stdev=4669.11 00:20:28.778 clat (msec): min=5, max=516, avg=152.93, stdev=65.59 00:20:28.778 lat (msec): min=5, max=516, avg=155.13, stdev=66.42 00:20:28.778 clat percentiles (msec): 00:20:28.778 | 1.00th=[ 16], 5.00th=[ 56], 10.00th=[ 82], 20.00th=[ 101], 00:20:28.778 | 30.00th=[ 125], 40.00th=[ 136], 50.00th=[ 153], 60.00th=[ 163], 00:20:28.778 | 70.00th=[ 174], 80.00th=[ 194], 90.00th=[ 230], 95.00th=[ 259], 00:20:28.778 | 99.00th=[ 342], 99.50th=[ 430], 99.90th=[ 502], 99.95th=[ 502], 00:20:28.778 | 99.99th=[ 518] 00:20:28.778 bw ( KiB/s): min=49564, max=149504, per=7.06%, avg=106082.60, stdev=29071.75, samples=20 00:20:28.778 iops : min= 193, max= 584, avg=414.30, stdev=113.57, samples=20 00:20:28.778 lat (msec) : 10=0.36%, 20=1.21%, 50=2.26%, 100=15.97%, 250=74.45% 00:20:28.778 lat (msec) : 500=5.61%, 750=0.14% 00:20:28.778 cpu : usr=1.29%, sys=1.33%, ctx=1360, majf=0, minf=1 00:20:28.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:28.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.778 issued rwts: total=0,4208,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.778 job7: (groupid=0, jobs=1): err= 0: pid=3485175: Tue Nov 19 01:56:16 2024 00:20:28.778 write: IOPS=539, BW=135MiB/s (141MB/s)(1378MiB/10212msec); 0 zone resets 00:20:28.778 slat (usec): min=23, max=62148, avg=1459.48, stdev=3914.81 00:20:28.778 clat (msec): min=2, max=473, avg=117.03, stdev=76.02 00:20:28.779 lat (msec): min=2, max=491, avg=118.49, stdev=77.03 00:20:28.779 clat percentiles (msec): 00:20:28.779 | 1.00th=[ 12], 5.00th=[ 35], 10.00th=[ 43], 20.00th=[ 45], 00:20:28.779 | 30.00th=[ 62], 40.00th=[ 81], 50.00th=[ 103], 60.00th=[ 132], 00:20:28.779 | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 257], 00:20:28.779 | 99.00th=[ 359], 99.50th=[ 380], 99.90th=[ 456], 99.95th=[ 472], 00:20:28.779 | 99.99th=[ 477] 00:20:28.779 bw ( KiB/s): min=53652, max=319488, per=9.28%, avg=139475.55, stdev=77479.55, samples=20 00:20:28.779 iops : min= 209, max= 1248, avg=544.75, stdev=302.71, samples=20 00:20:28.779 lat (msec) : 4=0.15%, 10=0.74%, 20=1.25%, 50=24.53%, 100=22.70% 00:20:28.779 lat (msec) : 250=44.79%, 500=5.84% 00:20:28.779 cpu : usr=1.66%, sys=1.98%, ctx=2433, majf=0, minf=1 00:20:28.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:28.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.779 issued rwts: total=0,5512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.779 job8: (groupid=0, jobs=1): err= 0: pid=3485228: Tue Nov 19 01:56:16 2024 00:20:28.779 write: IOPS=488, BW=122MiB/s (128MB/s)(1236MiB/10122msec); 0 zone resets 00:20:28.779 slat (usec): min=23, max=50249, avg=1540.54, stdev=3648.67 00:20:28.779 clat (msec): min=3, max=280, avg=129.38, stdev=50.40 00:20:28.779 lat (msec): min=3, max=280, avg=130.92, stdev=51.18 00:20:28.779 clat percentiles (msec): 00:20:28.779 | 1.00th=[ 22], 5.00th=[ 44], 10.00th=[ 65], 20.00th=[ 88], 00:20:28.779 | 30.00th=[ 104], 40.00th=[ 120], 50.00th=[ 131], 60.00th=[ 142], 00:20:28.779 | 70.00th=[ 150], 80.00th=[ 167], 90.00th=[ 197], 95.00th=[ 220], 00:20:28.779 | 99.00th=[ 257], 99.50th=[ 271], 99.90th=[ 279], 99.95th=[ 279], 00:20:28.779 | 99.99th=[ 279] 00:20:28.779 bw ( KiB/s): min=73728, max=197237, per=8.31%, avg=124914.35, stdev=31513.44, samples=20 00:20:28.779 iops : min= 288, max= 770, avg=487.90, stdev=123.07, samples=20 00:20:28.779 lat (msec) : 4=0.02%, 10=0.02%, 20=0.85%, 50=5.56%, 100=21.70% 00:20:28.779 lat (msec) : 250=70.37%, 500=1.48% 00:20:28.779 cpu : usr=1.57%, sys=1.79%, ctx=2378, majf=0, minf=1 00:20:28.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:28.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.779 issued rwts: total=0,4944,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.779 job9: (groupid=0, jobs=1): err= 0: pid=3485257: Tue Nov 19 01:56:16 2024 00:20:28.779 write: IOPS=500, BW=125MiB/s (131MB/s)(1278MiB/10208msec); 0 zone resets 00:20:28.779 slat (usec): min=16, max=84433, avg=1642.39, stdev=4053.41 00:20:28.779 clat (usec): min=1373, max=503133, avg=126079.28, stdev=71088.33 00:20:28.779 lat (msec): min=2, max=503, avg=127.72, stdev=72.06 00:20:28.779 clat percentiles (msec): 00:20:28.779 | 1.00th=[ 20], 5.00th=[ 42], 10.00th=[ 44], 20.00th=[ 63], 00:20:28.779 | 30.00th=[ 82], 40.00th=[ 96], 50.00th=[ 115], 60.00th=[ 136], 00:20:28.779 | 70.00th=[ 159], 80.00th=[ 182], 90.00th=[ 218], 95.00th=[ 245], 00:20:28.779 | 99.00th=[ 338], 99.50th=[ 376], 99.90th=[ 485], 99.95th=[ 489], 00:20:28.779 | 99.99th=[ 502] 00:20:28.779 bw ( KiB/s): min=53652, max=337920, per=8.60%, avg=129224.15, stdev=62422.95, samples=20 00:20:28.779 iops : min= 209, max= 1320, avg=504.70, stdev=243.87, samples=20 00:20:28.779 lat (msec) : 2=0.02%, 4=0.06%, 10=0.31%, 20=0.68%, 50=15.14% 00:20:28.779 lat (msec) : 100=25.39%, 250=53.81%, 500=4.54%, 750=0.04% 00:20:28.779 cpu : usr=1.31%, sys=1.87%, ctx=2114, majf=0, minf=1 00:20:28.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:28.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.779 issued rwts: total=0,5112,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.779 job10: (groupid=0, jobs=1): err= 0: pid=3485276: Tue Nov 19 01:56:16 2024 00:20:28.779 write: IOPS=665, BW=166MiB/s (174MB/s)(1669MiB/10037msec); 0 zone resets 00:20:28.779 slat (usec): min=21, max=96554, avg=1100.27, stdev=3085.88 00:20:28.779 clat (msec): min=2, max=278, avg=95.08, stdev=58.75 00:20:28.779 lat (msec): min=4, max=286, avg=96.18, stdev=59.43 00:20:28.779 clat percentiles (msec): 00:20:28.779 | 1.00th=[ 9], 5.00th=[ 22], 10.00th=[ 39], 20.00th=[ 41], 00:20:28.779 | 30.00th=[ 43], 40.00th=[ 61], 50.00th=[ 85], 60.00th=[ 116], 00:20:28.779 | 70.00th=[ 130], 80.00th=[ 146], 90.00th=[ 169], 95.00th=[ 203], 00:20:28.779 | 99.00th=[ 264], 99.50th=[ 268], 99.90th=[ 271], 99.95th=[ 271], 00:20:28.779 | 99.99th=[ 279] 00:20:28.779 bw ( KiB/s): min=75776, max=401628, per=11.26%, avg=169233.90, stdev=81182.95, samples=20 00:20:28.779 iops : min= 296, max= 1568, avg=660.95, stdev=317.00, samples=20 00:20:28.779 lat (msec) : 4=0.04%, 10=1.32%, 20=3.30%, 50=31.37%, 100=18.21% 00:20:28.779 lat (msec) : 250=44.26%, 500=1.50% 00:20:28.779 cpu : usr=1.95%, sys=2.50%, ctx=3222, majf=0, minf=1 00:20:28.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:28.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:28.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:28.779 issued rwts: total=0,6676,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:28.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:28.779 00:20:28.779 Run status group 0 (all jobs): 00:20:28.779 WRITE: bw=1467MiB/s (1539MB/s), 103MiB/s-167MiB/s (108MB/s-175MB/s), io=14.6GiB (15.7GB), run=10037-10216msec 00:20:28.779 00:20:28.779 Disk stats (read/write): 00:20:28.779 nvme0n1: ios=49/10084, merge=0/0, ticks=72/1211681, in_queue=1211753, util=97.57% 00:20:28.779 nvme10n1: ios=49/10486, merge=0/0, ticks=202/1218324, in_queue=1218526, util=99.11% 00:20:28.779 nvme1n1: ios=48/8457, merge=0/0, ticks=2253/1237951, in_queue=1240204, util=99.97% 00:20:28.779 nvme2n1: ios=40/13613, merge=0/0, ticks=232/1236706, in_queue=1236938, util=98.22% 00:20:28.779 nvme3n1: ios=22/11325, merge=0/0, ticks=20/1218115, in_queue=1218135, util=97.77% 00:20:28.779 nvme4n1: ios=49/12231, merge=0/0, ticks=1883/1233983, in_queue=1235866, util=99.99% 00:20:28.779 nvme5n1: ios=46/8387, merge=0/0, ticks=3335/1229407, in_queue=1232742, util=100.00% 00:20:28.779 nvme6n1: ios=47/10992, merge=0/0, ticks=67/1238489, in_queue=1238556, util=98.63% 00:20:28.779 nvme7n1: ios=44/9697, merge=0/0, ticks=1798/1214326, in_queue=1216124, util=100.00% 00:20:28.779 nvme8n1: ios=0/10197, merge=0/0, ticks=0/1237775, in_queue=1237775, util=99.03% 00:20:28.779 nvme9n1: ios=0/12976, merge=0/0, ticks=0/1223789, in_queue=1223789, util=99.13% 00:20:28.779 01:56:16 -- target/multiconnection.sh@36 -- # sync 00:20:28.779 01:56:16 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:28.779 01:56:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.779 01:56:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:28.779 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:28.779 01:56:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:28.779 01:56:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.779 01:56:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.779 01:56:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:28.779 01:56:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:28.779 01:56:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:28.779 01:56:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:28.779 01:56:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:28.779 01:56:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:28.779 01:56:16 -- common/autotest_common.sh@10 -- # set +x 00:20:28.779 01:56:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:28.779 01:56:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.779 01:56:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:28.779 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:28.779 01:56:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:28.779 01:56:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.779 01:56:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.779 01:56:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:28.779 01:56:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:28.779 01:56:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:28.779 01:56:16 -- common/autotest_common.sh@1220 -- # return 0 00:20:28.779 01:56:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:28.779 01:56:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:28.779 01:56:16 -- common/autotest_common.sh@10 -- # set +x 00:20:28.779 01:56:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:28.779 01:56:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.779 01:56:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:28.779 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:28.779 01:56:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:28.779 01:56:16 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.779 01:56:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.780 01:56:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:28.780 01:56:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:28.780 01:56:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:28.780 01:56:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:28.780 01:56:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:28.780 01:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:28.780 01:56:17 -- common/autotest_common.sh@10 -- # set +x 00:20:28.780 01:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:28.780 01:56:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.780 01:56:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:29.038 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:29.038 01:56:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:29.038 01:56:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.038 01:56:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.038 01:56:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:29.038 01:56:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.038 01:56:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:29.038 01:56:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.038 01:56:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:29.038 01:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.038 01:56:17 -- common/autotest_common.sh@10 -- # set +x 00:20:29.038 01:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.038 01:56:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.038 01:56:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:29.297 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:29.297 01:56:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:29.297 01:56:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.297 01:56:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.297 01:56:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:29.297 01:56:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.297 01:56:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:29.297 01:56:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.297 01:56:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:29.297 01:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.297 01:56:17 -- common/autotest_common.sh@10 -- # set +x 00:20:29.297 01:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.297 01:56:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.297 01:56:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:29.555 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:29.555 01:56:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:29.555 01:56:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.555 01:56:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.555 01:56:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:29.555 01:56:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.555 01:56:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:29.555 01:56:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.555 01:56:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:29.555 01:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.555 01:56:17 -- common/autotest_common.sh@10 -- # set +x 00:20:29.555 01:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.555 01:56:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.555 01:56:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:29.555 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:29.555 01:56:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:29.555 01:56:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.555 01:56:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.555 01:56:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:29.555 01:56:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.555 01:56:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:29.555 01:56:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.555 01:56:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:29.555 01:56:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.555 01:56:17 -- common/autotest_common.sh@10 -- # set +x 00:20:29.555 01:56:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.555 01:56:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.555 01:56:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:29.555 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:29.555 01:56:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:29.555 01:56:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.555 01:56:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.556 01:56:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:29.814 01:56:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.814 01:56:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:29.814 01:56:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.814 01:56:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:29.814 01:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.814 01:56:18 -- common/autotest_common.sh@10 -- # set +x 00:20:29.814 01:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.814 01:56:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.814 01:56:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:29.814 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:29.814 01:56:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:29.814 01:56:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.814 01:56:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.814 01:56:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:29.814 01:56:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.814 01:56:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:29.814 01:56:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.814 01:56:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:29.814 01:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.814 01:56:18 -- common/autotest_common.sh@10 -- # set +x 00:20:29.814 01:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.814 01:56:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.814 01:56:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:29.814 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:29.814 01:56:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:29.814 01:56:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.814 01:56:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.814 01:56:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:29.814 01:56:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.814 01:56:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:29.814 01:56:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.814 01:56:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:29.814 01:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.814 01:56:18 -- common/autotest_common.sh@10 -- # set +x 00:20:29.814 01:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.814 01:56:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.814 01:56:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:30.072 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:30.072 01:56:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:30.072 01:56:18 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.072 01:56:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.072 01:56:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:30.072 01:56:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.072 01:56:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:30.072 01:56:18 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.072 01:56:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:30.072 01:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.072 01:56:18 -- common/autotest_common.sh@10 -- # set +x 00:20:30.072 01:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.072 01:56:18 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:30.072 01:56:18 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:30.072 01:56:18 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:30.072 01:56:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:30.072 01:56:18 -- nvmf/common.sh@116 -- # sync 00:20:30.072 01:56:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:30.072 01:56:18 -- nvmf/common.sh@119 -- # set +e 00:20:30.072 01:56:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:30.072 01:56:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:30.072 rmmod nvme_tcp 00:20:30.072 rmmod nvme_fabrics 00:20:30.072 rmmod nvme_keyring 00:20:30.072 01:56:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:30.072 01:56:18 -- nvmf/common.sh@123 -- # set -e 00:20:30.072 01:56:18 -- nvmf/common.sh@124 -- # return 0 00:20:30.072 01:56:18 -- nvmf/common.sh@477 -- # '[' -n 3479525 ']' 00:20:30.072 01:56:18 -- nvmf/common.sh@478 -- # killprocess 3479525 00:20:30.072 01:56:18 -- common/autotest_common.sh@936 -- # '[' -z 3479525 ']' 00:20:30.072 01:56:18 -- common/autotest_common.sh@940 -- # kill -0 3479525 00:20:30.072 01:56:18 -- common/autotest_common.sh@941 -- # uname 00:20:30.072 01:56:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.072 01:56:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3479525 00:20:30.072 01:56:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:30.072 01:56:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:30.072 01:56:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3479525' 00:20:30.072 killing process with pid 3479525 00:20:30.072 01:56:18 -- common/autotest_common.sh@955 -- # kill 3479525 00:20:30.072 01:56:18 -- common/autotest_common.sh@960 -- # wait 3479525 00:20:30.638 01:56:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:30.638 01:56:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:30.638 01:56:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:30.638 01:56:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:30.638 01:56:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:30.638 01:56:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:30.638 01:56:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:30.638 01:56:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:33.170 01:56:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:33.170 00:20:33.170 real 1m0.853s 00:20:33.170 user 3m21.320s 00:20:33.170 sys 0m26.636s 00:20:33.170 01:56:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:33.170 01:56:21 -- common/autotest_common.sh@10 -- # set +x 00:20:33.170 ************************************ 00:20:33.170 END TEST nvmf_multiconnection 00:20:33.170 ************************************ 00:20:33.170 01:56:21 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:33.170 01:56:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:33.170 01:56:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:33.170 01:56:21 -- common/autotest_common.sh@10 -- # set +x 00:20:33.170 ************************************ 00:20:33.170 START TEST nvmf_initiator_timeout 00:20:33.170 ************************************ 00:20:33.170 01:56:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:33.170 * Looking for test storage... 00:20:33.170 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:33.170 01:56:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:33.170 01:56:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:33.170 01:56:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:33.170 01:56:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:33.170 01:56:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:33.170 01:56:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:33.170 01:56:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:33.170 01:56:21 -- scripts/common.sh@335 -- # IFS=.-: 00:20:33.170 01:56:21 -- scripts/common.sh@335 -- # read -ra ver1 00:20:33.170 01:56:21 -- scripts/common.sh@336 -- # IFS=.-: 00:20:33.170 01:56:21 -- scripts/common.sh@336 -- # read -ra ver2 00:20:33.170 01:56:21 -- scripts/common.sh@337 -- # local 'op=<' 00:20:33.170 01:56:21 -- scripts/common.sh@339 -- # ver1_l=2 00:20:33.170 01:56:21 -- scripts/common.sh@340 -- # ver2_l=1 00:20:33.170 01:56:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:33.170 01:56:21 -- scripts/common.sh@343 -- # case "$op" in 00:20:33.170 01:56:21 -- scripts/common.sh@344 -- # : 1 00:20:33.170 01:56:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:33.170 01:56:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:33.170 01:56:21 -- scripts/common.sh@364 -- # decimal 1 00:20:33.170 01:56:21 -- scripts/common.sh@352 -- # local d=1 00:20:33.170 01:56:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:33.170 01:56:21 -- scripts/common.sh@354 -- # echo 1 00:20:33.170 01:56:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:33.170 01:56:21 -- scripts/common.sh@365 -- # decimal 2 00:20:33.170 01:56:21 -- scripts/common.sh@352 -- # local d=2 00:20:33.170 01:56:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:33.170 01:56:21 -- scripts/common.sh@354 -- # echo 2 00:20:33.170 01:56:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:33.170 01:56:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:33.170 01:56:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:33.170 01:56:21 -- scripts/common.sh@367 -- # return 0 00:20:33.170 01:56:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:33.170 01:56:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:33.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.170 --rc genhtml_branch_coverage=1 00:20:33.170 --rc genhtml_function_coverage=1 00:20:33.170 --rc genhtml_legend=1 00:20:33.170 --rc geninfo_all_blocks=1 00:20:33.170 --rc geninfo_unexecuted_blocks=1 00:20:33.170 00:20:33.170 ' 00:20:33.170 01:56:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:33.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.170 --rc genhtml_branch_coverage=1 00:20:33.170 --rc genhtml_function_coverage=1 00:20:33.170 --rc genhtml_legend=1 00:20:33.170 --rc geninfo_all_blocks=1 00:20:33.170 --rc geninfo_unexecuted_blocks=1 00:20:33.170 00:20:33.170 ' 00:20:33.170 01:56:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:33.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.170 --rc genhtml_branch_coverage=1 00:20:33.170 --rc genhtml_function_coverage=1 00:20:33.170 --rc genhtml_legend=1 00:20:33.170 --rc geninfo_all_blocks=1 00:20:33.170 --rc geninfo_unexecuted_blocks=1 00:20:33.170 00:20:33.170 ' 00:20:33.170 01:56:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:33.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:33.170 --rc genhtml_branch_coverage=1 00:20:33.170 --rc genhtml_function_coverage=1 00:20:33.170 --rc genhtml_legend=1 00:20:33.170 --rc geninfo_all_blocks=1 00:20:33.170 --rc geninfo_unexecuted_blocks=1 00:20:33.170 00:20:33.170 ' 00:20:33.170 01:56:21 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:33.171 01:56:21 -- nvmf/common.sh@7 -- # uname -s 00:20:33.171 01:56:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:33.171 01:56:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:33.171 01:56:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:33.171 01:56:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:33.171 01:56:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:33.171 01:56:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:33.171 01:56:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:33.171 01:56:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:33.171 01:56:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:33.171 01:56:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:33.171 01:56:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:33.171 01:56:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:33.171 01:56:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:33.171 01:56:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:33.171 01:56:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:33.171 01:56:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:33.171 01:56:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:33.171 01:56:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:33.171 01:56:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:33.171 01:56:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.171 01:56:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.171 01:56:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.171 01:56:21 -- paths/export.sh@5 -- # export PATH 00:20:33.171 01:56:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:33.171 01:56:21 -- nvmf/common.sh@46 -- # : 0 00:20:33.171 01:56:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:33.171 01:56:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:33.171 01:56:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:33.171 01:56:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:33.171 01:56:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:33.171 01:56:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:33.171 01:56:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:33.171 01:56:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:33.171 01:56:21 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:33.171 01:56:21 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:33.171 01:56:21 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:33.171 01:56:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:33.171 01:56:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:33.171 01:56:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:33.171 01:56:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:33.171 01:56:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:33.171 01:56:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:33.171 01:56:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:33.171 01:56:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:33.171 01:56:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:33.171 01:56:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:33.171 01:56:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:33.171 01:56:21 -- common/autotest_common.sh@10 -- # set +x 00:20:35.068 01:56:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:35.068 01:56:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:35.068 01:56:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:35.068 01:56:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:35.068 01:56:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:35.068 01:56:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:35.068 01:56:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:35.068 01:56:23 -- nvmf/common.sh@294 -- # net_devs=() 00:20:35.068 01:56:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:35.068 01:56:23 -- nvmf/common.sh@295 -- # e810=() 00:20:35.068 01:56:23 -- nvmf/common.sh@295 -- # local -ga e810 00:20:35.068 01:56:23 -- nvmf/common.sh@296 -- # x722=() 00:20:35.068 01:56:23 -- nvmf/common.sh@296 -- # local -ga x722 00:20:35.068 01:56:23 -- nvmf/common.sh@297 -- # mlx=() 00:20:35.068 01:56:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:35.068 01:56:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:35.068 01:56:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:35.068 01:56:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:35.068 01:56:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:35.068 01:56:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:35.068 01:56:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:35.068 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:35.068 01:56:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:35.068 01:56:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:35.068 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:35.068 01:56:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:35.068 01:56:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:35.068 01:56:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:35.068 01:56:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:35.068 01:56:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:35.068 01:56:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:35.068 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:35.068 01:56:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:35.068 01:56:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:35.068 01:56:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:35.068 01:56:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:35.068 01:56:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:35.068 01:56:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:35.068 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:35.068 01:56:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:35.068 01:56:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:35.068 01:56:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:35.068 01:56:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:35.068 01:56:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:35.068 01:56:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:35.068 01:56:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:35.068 01:56:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:35.068 01:56:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:35.068 01:56:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:35.068 01:56:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:35.068 01:56:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:35.068 01:56:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:35.068 01:56:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:35.068 01:56:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:35.068 01:56:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:35.068 01:56:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:35.068 01:56:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:35.068 01:56:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:35.068 01:56:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:35.068 01:56:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:35.068 01:56:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:35.068 01:56:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:35.068 01:56:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:35.068 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:35.068 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:20:35.068 00:20:35.068 --- 10.0.0.2 ping statistics --- 00:20:35.068 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:35.068 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:20:35.068 01:56:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:35.068 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:35.068 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:20:35.068 00:20:35.068 --- 10.0.0.1 ping statistics --- 00:20:35.068 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:35.068 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:20:35.068 01:56:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:35.068 01:56:23 -- nvmf/common.sh@410 -- # return 0 00:20:35.068 01:56:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:35.068 01:56:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:35.068 01:56:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:35.068 01:56:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:35.068 01:56:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:35.068 01:56:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:35.068 01:56:23 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:35.068 01:56:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:35.068 01:56:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:35.068 01:56:23 -- common/autotest_common.sh@10 -- # set +x 00:20:35.068 01:56:23 -- nvmf/common.sh@469 -- # nvmfpid=3488651 00:20:35.068 01:56:23 -- nvmf/common.sh@470 -- # waitforlisten 3488651 00:20:35.068 01:56:23 -- common/autotest_common.sh@829 -- # '[' -z 3488651 ']' 00:20:35.068 01:56:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:35.069 01:56:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:35.069 01:56:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:35.069 01:56:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:35.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:35.069 01:56:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:35.069 01:56:23 -- common/autotest_common.sh@10 -- # set +x 00:20:35.327 [2024-11-19 01:56:23.638038] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:35.327 [2024-11-19 01:56:23.638123] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:35.327 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.327 [2024-11-19 01:56:23.708601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:35.327 [2024-11-19 01:56:23.829374] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:35.327 [2024-11-19 01:56:23.829535] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:35.327 [2024-11-19 01:56:23.829562] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:35.327 [2024-11-19 01:56:23.829577] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:35.327 [2024-11-19 01:56:23.829645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:35.327 [2024-11-19 01:56:23.829690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:35.327 [2024-11-19 01:56:23.829755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:35.327 [2024-11-19 01:56:23.829758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:36.261 01:56:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.261 01:56:24 -- common/autotest_common.sh@862 -- # return 0 00:20:36.261 01:56:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:36.261 01:56:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:36.261 01:56:24 -- common/autotest_common.sh@10 -- # set +x 00:20:36.261 01:56:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:36.261 01:56:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.261 01:56:24 -- common/autotest_common.sh@10 -- # set +x 00:20:36.261 Malloc0 00:20:36.261 01:56:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:36.261 01:56:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.261 01:56:24 -- common/autotest_common.sh@10 -- # set +x 00:20:36.261 Delay0 00:20:36.261 01:56:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:36.261 01:56:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.261 01:56:24 -- common/autotest_common.sh@10 -- # set +x 00:20:36.261 [2024-11-19 01:56:24.655643] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:36.261 01:56:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:36.261 01:56:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.261 01:56:24 -- common/autotest_common.sh@10 -- # set +x 00:20:36.261 01:56:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:36.261 01:56:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.261 01:56:24 -- common/autotest_common.sh@10 -- # set +x 00:20:36.261 01:56:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:36.261 01:56:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.261 01:56:24 -- common/autotest_common.sh@10 -- # set +x 00:20:36.261 [2024-11-19 01:56:24.683934] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:36.261 01:56:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.261 01:56:24 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:36.827 01:56:25 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:36.828 01:56:25 -- common/autotest_common.sh@1187 -- # local i=0 00:20:36.828 01:56:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:36.828 01:56:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:36.828 01:56:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:39.352 01:56:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:39.353 01:56:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:39.353 01:56:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:39.353 01:56:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:39.353 01:56:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:39.353 01:56:27 -- common/autotest_common.sh@1197 -- # return 0 00:20:39.353 01:56:27 -- target/initiator_timeout.sh@35 -- # fio_pid=3489101 00:20:39.353 01:56:27 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:39.353 01:56:27 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:39.353 [global] 00:20:39.353 thread=1 00:20:39.353 invalidate=1 00:20:39.353 rw=write 00:20:39.353 time_based=1 00:20:39.353 runtime=60 00:20:39.353 ioengine=libaio 00:20:39.353 direct=1 00:20:39.353 bs=4096 00:20:39.353 iodepth=1 00:20:39.353 norandommap=0 00:20:39.353 numjobs=1 00:20:39.353 00:20:39.353 verify_dump=1 00:20:39.353 verify_backlog=512 00:20:39.353 verify_state_save=0 00:20:39.353 do_verify=1 00:20:39.353 verify=crc32c-intel 00:20:39.353 [job0] 00:20:39.353 filename=/dev/nvme0n1 00:20:39.353 Could not set queue depth (nvme0n1) 00:20:39.353 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:39.353 fio-3.35 00:20:39.353 Starting 1 thread 00:20:41.880 01:56:30 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:41.880 01:56:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.880 01:56:30 -- common/autotest_common.sh@10 -- # set +x 00:20:41.880 true 00:20:41.880 01:56:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.880 01:56:30 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:41.880 01:56:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.880 01:56:30 -- common/autotest_common.sh@10 -- # set +x 00:20:41.880 true 00:20:41.880 01:56:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.880 01:56:30 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:41.880 01:56:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.880 01:56:30 -- common/autotest_common.sh@10 -- # set +x 00:20:41.880 true 00:20:41.880 01:56:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.880 01:56:30 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:41.880 01:56:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.880 01:56:30 -- common/autotest_common.sh@10 -- # set +x 00:20:41.880 true 00:20:41.880 01:56:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.880 01:56:30 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:45.165 01:56:33 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:45.165 01:56:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.165 01:56:33 -- common/autotest_common.sh@10 -- # set +x 00:20:45.165 true 00:20:45.165 01:56:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.165 01:56:33 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:45.165 01:56:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.165 01:56:33 -- common/autotest_common.sh@10 -- # set +x 00:20:45.165 true 00:20:45.165 01:56:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.165 01:56:33 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:45.165 01:56:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.165 01:56:33 -- common/autotest_common.sh@10 -- # set +x 00:20:45.165 true 00:20:45.165 01:56:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.165 01:56:33 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:45.165 01:56:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:45.165 01:56:33 -- common/autotest_common.sh@10 -- # set +x 00:20:45.165 true 00:20:45.165 01:56:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:45.165 01:56:33 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:45.165 01:56:33 -- target/initiator_timeout.sh@54 -- # wait 3489101 00:21:41.380 00:21:41.380 job0: (groupid=0, jobs=1): err= 0: pid=3489170: Tue Nov 19 01:57:27 2024 00:21:41.380 read: IOPS=309, BW=1238KiB/s (1267kB/s)(72.5MiB/60001msec) 00:21:41.380 slat (usec): min=4, max=11422, avg=12.41, stdev=87.60 00:21:41.380 clat (usec): min=212, max=40838k, avg=2978.67, stdev=299738.21 00:21:41.380 lat (usec): min=220, max=40838k, avg=2991.08, stdev=299738.35 00:21:41.380 clat percentiles (usec): 00:21:41.380 | 1.00th=[ 229], 5.00th=[ 237], 10.00th=[ 241], 20.00th=[ 245], 00:21:41.380 | 30.00th=[ 251], 40.00th=[ 258], 50.00th=[ 265], 60.00th=[ 273], 00:21:41.380 | 70.00th=[ 281], 80.00th=[ 289], 90.00th=[ 306], 95.00th=[ 433], 00:21:41.380 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:21:41.380 | 99.99th=[44827] 00:21:41.380 write: IOPS=315, BW=1263KiB/s (1293kB/s)(74.0MiB/60001msec); 0 zone resets 00:21:41.380 slat (usec): min=6, max=42035, avg=18.20, stdev=370.25 00:21:41.380 clat (usec): min=27, max=1250, avg=209.97, stdev=27.71 00:21:41.380 lat (usec): min=171, max=42357, avg=228.18, stdev=372.54 00:21:41.380 clat percentiles (usec): 00:21:41.380 | 1.00th=[ 178], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 190], 00:21:41.380 | 30.00th=[ 194], 40.00th=[ 198], 50.00th=[ 204], 60.00th=[ 212], 00:21:41.380 | 70.00th=[ 219], 80.00th=[ 227], 90.00th=[ 239], 95.00th=[ 260], 00:21:41.380 | 99.00th=[ 322], 99.50th=[ 338], 99.90th=[ 363], 99.95th=[ 379], 00:21:41.380 | 99.99th=[ 416] 00:21:41.380 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=7168.00, stdev=1592.77, samples=20 00:21:41.380 iops : min= 1024, max= 2048, avg=1792.00, stdev=398.19, samples=20 00:21:41.380 lat (usec) : 50=0.01%, 250=61.32%, 500=37.54%, 750=0.51% 00:21:41.380 lat (msec) : 2=0.01%, 50=0.61%, >=2000=0.01% 00:21:41.380 cpu : usr=0.64%, sys=1.06%, ctx=37516, majf=0, minf=35 00:21:41.380 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:41.380 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:41.380 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:41.380 issued rwts: total=18566,18944,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:41.380 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:41.380 00:21:41.380 Run status group 0 (all jobs): 00:21:41.380 READ: bw=1238KiB/s (1267kB/s), 1238KiB/s-1238KiB/s (1267kB/s-1267kB/s), io=72.5MiB (76.0MB), run=60001-60001msec 00:21:41.380 WRITE: bw=1263KiB/s (1293kB/s), 1263KiB/s-1263KiB/s (1293kB/s-1293kB/s), io=74.0MiB (77.6MB), run=60001-60001msec 00:21:41.380 00:21:41.380 Disk stats (read/write): 00:21:41.380 nvme0n1: ios=18534/18698, merge=0/0, ticks=15647/3698, in_queue=19345, util=99.71% 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:41.380 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:41.380 01:57:27 -- common/autotest_common.sh@1208 -- # local i=0 00:21:41.380 01:57:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:41.380 01:57:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:41.380 01:57:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:41.380 01:57:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:41.380 01:57:27 -- common/autotest_common.sh@1220 -- # return 0 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:41.380 nvmf hotplug test: fio successful as expected 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:41.380 01:57:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.380 01:57:27 -- common/autotest_common.sh@10 -- # set +x 00:21:41.380 01:57:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:41.380 01:57:27 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:41.380 01:57:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:41.380 01:57:27 -- nvmf/common.sh@116 -- # sync 00:21:41.380 01:57:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:41.380 01:57:27 -- nvmf/common.sh@119 -- # set +e 00:21:41.380 01:57:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:41.380 01:57:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:41.380 rmmod nvme_tcp 00:21:41.380 rmmod nvme_fabrics 00:21:41.380 rmmod nvme_keyring 00:21:41.380 01:57:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:41.380 01:57:27 -- nvmf/common.sh@123 -- # set -e 00:21:41.380 01:57:27 -- nvmf/common.sh@124 -- # return 0 00:21:41.380 01:57:27 -- nvmf/common.sh@477 -- # '[' -n 3488651 ']' 00:21:41.380 01:57:27 -- nvmf/common.sh@478 -- # killprocess 3488651 00:21:41.380 01:57:27 -- common/autotest_common.sh@936 -- # '[' -z 3488651 ']' 00:21:41.380 01:57:27 -- common/autotest_common.sh@940 -- # kill -0 3488651 00:21:41.380 01:57:27 -- common/autotest_common.sh@941 -- # uname 00:21:41.380 01:57:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:41.380 01:57:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3488651 00:21:41.380 01:57:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:41.380 01:57:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:41.380 01:57:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3488651' 00:21:41.380 killing process with pid 3488651 00:21:41.380 01:57:27 -- common/autotest_common.sh@955 -- # kill 3488651 00:21:41.380 01:57:27 -- common/autotest_common.sh@960 -- # wait 3488651 00:21:41.381 01:57:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:41.381 01:57:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:41.381 01:57:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:41.381 01:57:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:41.381 01:57:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:41.381 01:57:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.381 01:57:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:41.381 01:57:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.948 01:57:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:41.948 00:21:41.948 real 1m9.098s 00:21:41.948 user 4m13.763s 00:21:41.948 sys 0m7.556s 00:21:41.948 01:57:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:41.948 01:57:30 -- common/autotest_common.sh@10 -- # set +x 00:21:41.948 ************************************ 00:21:41.948 END TEST nvmf_initiator_timeout 00:21:41.948 ************************************ 00:21:41.948 01:57:30 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:41.948 01:57:30 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:41.948 01:57:30 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:41.948 01:57:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:41.948 01:57:30 -- common/autotest_common.sh@10 -- # set +x 00:21:43.849 01:57:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:43.849 01:57:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:43.849 01:57:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:43.849 01:57:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:43.849 01:57:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:43.849 01:57:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:43.850 01:57:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:43.850 01:57:32 -- nvmf/common.sh@294 -- # net_devs=() 00:21:43.850 01:57:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:43.850 01:57:32 -- nvmf/common.sh@295 -- # e810=() 00:21:43.850 01:57:32 -- nvmf/common.sh@295 -- # local -ga e810 00:21:43.850 01:57:32 -- nvmf/common.sh@296 -- # x722=() 00:21:43.850 01:57:32 -- nvmf/common.sh@296 -- # local -ga x722 00:21:43.850 01:57:32 -- nvmf/common.sh@297 -- # mlx=() 00:21:43.850 01:57:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:43.850 01:57:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:43.850 01:57:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:43.850 01:57:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:43.850 01:57:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:43.850 01:57:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.850 01:57:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:43.850 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:43.850 01:57:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.850 01:57:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:43.850 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:43.850 01:57:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:43.850 01:57:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:43.850 01:57:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.850 01:57:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.850 01:57:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.850 01:57:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.850 01:57:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:43.850 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:43.850 01:57:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.850 01:57:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.850 01:57:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.850 01:57:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.850 01:57:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.850 01:57:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:43.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:43.850 01:57:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.850 01:57:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:43.850 01:57:32 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:43.850 01:57:32 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:43.850 01:57:32 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:43.850 01:57:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:43.850 01:57:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:43.850 01:57:32 -- common/autotest_common.sh@10 -- # set +x 00:21:43.850 ************************************ 00:21:43.850 START TEST nvmf_perf_adq 00:21:43.850 ************************************ 00:21:43.850 01:57:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:43.850 * Looking for test storage... 00:21:43.850 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:43.850 01:57:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:43.850 01:57:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:43.850 01:57:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:44.109 01:57:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:44.109 01:57:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:44.109 01:57:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:44.109 01:57:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:44.109 01:57:32 -- scripts/common.sh@335 -- # IFS=.-: 00:21:44.109 01:57:32 -- scripts/common.sh@335 -- # read -ra ver1 00:21:44.109 01:57:32 -- scripts/common.sh@336 -- # IFS=.-: 00:21:44.109 01:57:32 -- scripts/common.sh@336 -- # read -ra ver2 00:21:44.109 01:57:32 -- scripts/common.sh@337 -- # local 'op=<' 00:21:44.109 01:57:32 -- scripts/common.sh@339 -- # ver1_l=2 00:21:44.109 01:57:32 -- scripts/common.sh@340 -- # ver2_l=1 00:21:44.109 01:57:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:44.109 01:57:32 -- scripts/common.sh@343 -- # case "$op" in 00:21:44.109 01:57:32 -- scripts/common.sh@344 -- # : 1 00:21:44.109 01:57:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:44.109 01:57:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:44.109 01:57:32 -- scripts/common.sh@364 -- # decimal 1 00:21:44.109 01:57:32 -- scripts/common.sh@352 -- # local d=1 00:21:44.109 01:57:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:44.109 01:57:32 -- scripts/common.sh@354 -- # echo 1 00:21:44.109 01:57:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:44.109 01:57:32 -- scripts/common.sh@365 -- # decimal 2 00:21:44.109 01:57:32 -- scripts/common.sh@352 -- # local d=2 00:21:44.109 01:57:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:44.109 01:57:32 -- scripts/common.sh@354 -- # echo 2 00:21:44.109 01:57:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:44.109 01:57:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:44.109 01:57:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:44.109 01:57:32 -- scripts/common.sh@367 -- # return 0 00:21:44.109 01:57:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:44.109 01:57:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:44.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.109 --rc genhtml_branch_coverage=1 00:21:44.109 --rc genhtml_function_coverage=1 00:21:44.109 --rc genhtml_legend=1 00:21:44.109 --rc geninfo_all_blocks=1 00:21:44.109 --rc geninfo_unexecuted_blocks=1 00:21:44.109 00:21:44.109 ' 00:21:44.109 01:57:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:44.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.109 --rc genhtml_branch_coverage=1 00:21:44.109 --rc genhtml_function_coverage=1 00:21:44.109 --rc genhtml_legend=1 00:21:44.109 --rc geninfo_all_blocks=1 00:21:44.109 --rc geninfo_unexecuted_blocks=1 00:21:44.109 00:21:44.109 ' 00:21:44.109 01:57:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:44.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.109 --rc genhtml_branch_coverage=1 00:21:44.109 --rc genhtml_function_coverage=1 00:21:44.109 --rc genhtml_legend=1 00:21:44.109 --rc geninfo_all_blocks=1 00:21:44.109 --rc geninfo_unexecuted_blocks=1 00:21:44.109 00:21:44.109 ' 00:21:44.109 01:57:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:44.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.109 --rc genhtml_branch_coverage=1 00:21:44.109 --rc genhtml_function_coverage=1 00:21:44.109 --rc genhtml_legend=1 00:21:44.109 --rc geninfo_all_blocks=1 00:21:44.109 --rc geninfo_unexecuted_blocks=1 00:21:44.109 00:21:44.109 ' 00:21:44.109 01:57:32 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:44.109 01:57:32 -- nvmf/common.sh@7 -- # uname -s 00:21:44.109 01:57:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:44.109 01:57:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:44.109 01:57:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:44.109 01:57:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:44.109 01:57:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:44.109 01:57:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:44.109 01:57:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:44.109 01:57:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:44.109 01:57:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:44.109 01:57:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:44.109 01:57:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:44.109 01:57:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:44.109 01:57:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:44.109 01:57:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:44.109 01:57:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:44.109 01:57:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:44.109 01:57:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:44.109 01:57:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:44.109 01:57:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:44.109 01:57:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.109 01:57:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.109 01:57:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.109 01:57:32 -- paths/export.sh@5 -- # export PATH 00:21:44.109 01:57:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.109 01:57:32 -- nvmf/common.sh@46 -- # : 0 00:21:44.109 01:57:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:44.109 01:57:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:44.109 01:57:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:44.109 01:57:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:44.110 01:57:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:44.110 01:57:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:44.110 01:57:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:44.110 01:57:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:44.110 01:57:32 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:44.110 01:57:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:44.110 01:57:32 -- common/autotest_common.sh@10 -- # set +x 00:21:46.012 01:57:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:46.012 01:57:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:46.012 01:57:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:46.012 01:57:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:46.012 01:57:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:46.012 01:57:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:46.012 01:57:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:46.012 01:57:34 -- nvmf/common.sh@294 -- # net_devs=() 00:21:46.012 01:57:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:46.012 01:57:34 -- nvmf/common.sh@295 -- # e810=() 00:21:46.012 01:57:34 -- nvmf/common.sh@295 -- # local -ga e810 00:21:46.012 01:57:34 -- nvmf/common.sh@296 -- # x722=() 00:21:46.012 01:57:34 -- nvmf/common.sh@296 -- # local -ga x722 00:21:46.012 01:57:34 -- nvmf/common.sh@297 -- # mlx=() 00:21:46.012 01:57:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:46.012 01:57:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:46.012 01:57:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:46.012 01:57:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:46.012 01:57:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:46.012 01:57:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:46.012 01:57:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:46.012 01:57:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:46.012 01:57:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.012 01:57:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:46.012 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:46.012 01:57:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.013 01:57:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:46.013 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:46.013 01:57:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:46.013 01:57:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:46.013 01:57:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.013 01:57:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.013 01:57:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.013 01:57:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.013 01:57:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:46.013 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:46.013 01:57:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.013 01:57:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.013 01:57:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.013 01:57:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.013 01:57:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.013 01:57:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:46.013 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:46.013 01:57:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.013 01:57:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:46.013 01:57:34 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:46.013 01:57:34 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:46.013 01:57:34 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:46.013 01:57:34 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:46.013 01:57:34 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:46.582 01:57:34 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:49.112 01:57:37 -- target/perf_adq.sh@54 -- # sleep 5 00:21:54.385 01:57:42 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:54.385 01:57:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:54.385 01:57:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:54.385 01:57:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:54.385 01:57:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:54.385 01:57:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:54.385 01:57:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:54.385 01:57:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:54.385 01:57:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.385 01:57:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:54.385 01:57:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:54.385 01:57:42 -- common/autotest_common.sh@10 -- # set +x 00:21:54.385 01:57:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:54.385 01:57:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:54.385 01:57:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:54.385 01:57:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:54.385 01:57:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:54.385 01:57:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:54.385 01:57:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:54.385 01:57:42 -- nvmf/common.sh@294 -- # net_devs=() 00:21:54.385 01:57:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:54.385 01:57:42 -- nvmf/common.sh@295 -- # e810=() 00:21:54.385 01:57:42 -- nvmf/common.sh@295 -- # local -ga e810 00:21:54.385 01:57:42 -- nvmf/common.sh@296 -- # x722=() 00:21:54.385 01:57:42 -- nvmf/common.sh@296 -- # local -ga x722 00:21:54.385 01:57:42 -- nvmf/common.sh@297 -- # mlx=() 00:21:54.385 01:57:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:54.385 01:57:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:54.385 01:57:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:54.385 01:57:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:54.385 01:57:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:54.385 01:57:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.385 01:57:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:54.385 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:54.385 01:57:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.385 01:57:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:54.385 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:54.385 01:57:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:54.385 01:57:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.385 01:57:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.385 01:57:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.385 01:57:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.385 01:57:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:54.385 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:54.385 01:57:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.385 01:57:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.385 01:57:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.385 01:57:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.385 01:57:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.385 01:57:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:54.385 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:54.385 01:57:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.385 01:57:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:54.385 01:57:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:54.385 01:57:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:54.385 01:57:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:54.385 01:57:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:54.385 01:57:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:54.385 01:57:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:54.385 01:57:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:54.385 01:57:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:54.385 01:57:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:54.385 01:57:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:54.386 01:57:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:54.386 01:57:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:54.386 01:57:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:54.386 01:57:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:54.386 01:57:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:54.386 01:57:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:54.386 01:57:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:54.386 01:57:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:54.386 01:57:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:54.386 01:57:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:54.386 01:57:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:54.386 01:57:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:54.386 01:57:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:54.386 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:54.386 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:21:54.386 00:21:54.386 --- 10.0.0.2 ping statistics --- 00:21:54.386 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:54.386 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:21:54.386 01:57:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:54.386 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:54.386 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:21:54.386 00:21:54.386 --- 10.0.0.1 ping statistics --- 00:21:54.386 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:54.386 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:21:54.386 01:57:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:54.386 01:57:42 -- nvmf/common.sh@410 -- # return 0 00:21:54.386 01:57:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:54.386 01:57:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:54.386 01:57:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:54.386 01:57:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:54.386 01:57:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:54.386 01:57:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:54.386 01:57:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:54.386 01:57:42 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:54.386 01:57:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:54.386 01:57:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:54.386 01:57:42 -- common/autotest_common.sh@10 -- # set +x 00:21:54.386 01:57:42 -- nvmf/common.sh@469 -- # nvmfpid=3501718 00:21:54.386 01:57:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:54.386 01:57:42 -- nvmf/common.sh@470 -- # waitforlisten 3501718 00:21:54.386 01:57:42 -- common/autotest_common.sh@829 -- # '[' -z 3501718 ']' 00:21:54.386 01:57:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:54.386 01:57:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:54.386 01:57:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:54.386 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:54.386 01:57:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:54.386 01:57:42 -- common/autotest_common.sh@10 -- # set +x 00:21:54.386 [2024-11-19 01:57:42.794844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:54.386 [2024-11-19 01:57:42.794918] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:54.386 EAL: No free 2048 kB hugepages reported on node 1 00:21:54.386 [2024-11-19 01:57:42.866029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:54.644 [2024-11-19 01:57:42.985104] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:54.644 [2024-11-19 01:57:42.985269] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:54.644 [2024-11-19 01:57:42.985289] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:54.644 [2024-11-19 01:57:42.985303] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:54.644 [2024-11-19 01:57:42.985388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:54.644 [2024-11-19 01:57:42.985444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:54.644 [2024-11-19 01:57:42.985473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:54.644 [2024-11-19 01:57:42.985476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:55.210 01:57:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:55.210 01:57:43 -- common/autotest_common.sh@862 -- # return 0 00:21:55.210 01:57:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:55.210 01:57:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:55.210 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 01:57:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:55.468 01:57:43 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:55.468 01:57:43 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:55.468 01:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.468 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 01:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.468 01:57:43 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:55.468 01:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.468 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 01:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.468 01:57:43 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:55.468 01:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.468 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 [2024-11-19 01:57:43.886276] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:55.468 01:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.468 01:57:43 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:55.468 01:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.468 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 Malloc1 00:21:55.468 01:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.468 01:57:43 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:55.468 01:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.468 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 01:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.468 01:57:43 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:55.468 01:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.468 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 01:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.468 01:57:43 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:55.468 01:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.468 01:57:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.468 [2024-11-19 01:57:43.937293] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:55.468 01:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.468 01:57:43 -- target/perf_adq.sh@73 -- # perfpid=3501885 00:21:55.468 01:57:43 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:55.468 01:57:43 -- target/perf_adq.sh@74 -- # sleep 2 00:21:55.468 EAL: No free 2048 kB hugepages reported on node 1 00:21:57.455 01:57:45 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:57.455 01:57:45 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:57.455 01:57:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.455 01:57:45 -- target/perf_adq.sh@76 -- # wc -l 00:21:57.455 01:57:45 -- common/autotest_common.sh@10 -- # set +x 00:21:57.455 01:57:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.455 01:57:45 -- target/perf_adq.sh@76 -- # count=4 00:21:57.455 01:57:45 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:57.455 01:57:45 -- target/perf_adq.sh@81 -- # wait 3501885 00:22:07.427 Initializing NVMe Controllers 00:22:07.427 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:07.427 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:07.427 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:07.427 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:07.427 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:07.427 Initialization complete. Launching workers. 00:22:07.427 ======================================================== 00:22:07.427 Latency(us) 00:22:07.427 Device Information : IOPS MiB/s Average min max 00:22:07.427 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11213.35 43.80 5707.47 1601.10 10492.03 00:22:07.427 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11243.65 43.92 5698.28 1684.14 42655.48 00:22:07.427 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11412.75 44.58 5607.98 1553.29 10304.64 00:22:07.427 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11068.85 43.24 5783.70 1408.34 9961.25 00:22:07.427 ======================================================== 00:22:07.427 Total : 44938.61 175.54 5698.68 1408.34 42655.48 00:22:07.427 00:22:07.427 01:57:54 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:07.427 01:57:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:07.427 01:57:54 -- nvmf/common.sh@116 -- # sync 00:22:07.427 01:57:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:07.427 01:57:54 -- nvmf/common.sh@119 -- # set +e 00:22:07.427 01:57:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:07.427 01:57:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:07.427 rmmod nvme_tcp 00:22:07.427 rmmod nvme_fabrics 00:22:07.427 rmmod nvme_keyring 00:22:07.427 01:57:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:07.427 01:57:54 -- nvmf/common.sh@123 -- # set -e 00:22:07.427 01:57:54 -- nvmf/common.sh@124 -- # return 0 00:22:07.427 01:57:54 -- nvmf/common.sh@477 -- # '[' -n 3501718 ']' 00:22:07.427 01:57:54 -- nvmf/common.sh@478 -- # killprocess 3501718 00:22:07.427 01:57:54 -- common/autotest_common.sh@936 -- # '[' -z 3501718 ']' 00:22:07.427 01:57:54 -- common/autotest_common.sh@940 -- # kill -0 3501718 00:22:07.427 01:57:54 -- common/autotest_common.sh@941 -- # uname 00:22:07.427 01:57:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:07.427 01:57:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3501718 00:22:07.427 01:57:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:07.427 01:57:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:07.427 01:57:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3501718' 00:22:07.427 killing process with pid 3501718 00:22:07.427 01:57:54 -- common/autotest_common.sh@955 -- # kill 3501718 00:22:07.427 01:57:54 -- common/autotest_common.sh@960 -- # wait 3501718 00:22:07.427 01:57:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:07.427 01:57:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:07.427 01:57:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:07.427 01:57:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:07.427 01:57:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:07.427 01:57:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.427 01:57:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.427 01:57:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:08.363 01:57:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:08.363 01:57:56 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:08.363 01:57:56 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:08.930 01:57:57 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:11.459 01:57:59 -- target/perf_adq.sh@54 -- # sleep 5 00:22:16.728 01:58:04 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:16.728 01:58:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:16.728 01:58:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:16.728 01:58:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:16.728 01:58:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:16.728 01:58:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:16.728 01:58:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:16.728 01:58:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:16.728 01:58:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:16.728 01:58:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:16.728 01:58:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:16.728 01:58:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:16.728 01:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:16.728 01:58:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:16.728 01:58:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:16.728 01:58:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:16.729 01:58:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:16.729 01:58:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:16.729 01:58:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:16.729 01:58:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:16.729 01:58:04 -- nvmf/common.sh@294 -- # net_devs=() 00:22:16.729 01:58:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:16.729 01:58:04 -- nvmf/common.sh@295 -- # e810=() 00:22:16.729 01:58:04 -- nvmf/common.sh@295 -- # local -ga e810 00:22:16.729 01:58:04 -- nvmf/common.sh@296 -- # x722=() 00:22:16.729 01:58:04 -- nvmf/common.sh@296 -- # local -ga x722 00:22:16.729 01:58:04 -- nvmf/common.sh@297 -- # mlx=() 00:22:16.729 01:58:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:16.729 01:58:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:16.729 01:58:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:16.729 01:58:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:16.729 01:58:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:16.729 01:58:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:16.729 01:58:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:16.729 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:16.729 01:58:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:16.729 01:58:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:16.729 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:16.729 01:58:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:16.729 01:58:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:16.729 01:58:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:16.729 01:58:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:16.729 01:58:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:16.729 01:58:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:16.729 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:16.729 01:58:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:16.729 01:58:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:16.729 01:58:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:16.729 01:58:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:16.729 01:58:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:16.729 01:58:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:16.729 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:16.729 01:58:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:16.729 01:58:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:16.729 01:58:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:16.729 01:58:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:16.729 01:58:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:16.729 01:58:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:16.729 01:58:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:16.729 01:58:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:16.729 01:58:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:16.729 01:58:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:16.729 01:58:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:16.729 01:58:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:16.729 01:58:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:16.729 01:58:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:16.729 01:58:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:16.729 01:58:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:16.729 01:58:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:16.729 01:58:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:16.729 01:58:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:16.729 01:58:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:16.729 01:58:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:16.729 01:58:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:16.729 01:58:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:16.729 01:58:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:16.729 01:58:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:16.729 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:16.729 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:22:16.729 00:22:16.729 --- 10.0.0.2 ping statistics --- 00:22:16.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:16.729 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:22:16.729 01:58:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:16.729 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:16.729 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:22:16.729 00:22:16.729 --- 10.0.0.1 ping statistics --- 00:22:16.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:16.729 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:22:16.729 01:58:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:16.729 01:58:05 -- nvmf/common.sh@410 -- # return 0 00:22:16.729 01:58:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:16.729 01:58:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:16.729 01:58:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:16.729 01:58:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:16.729 01:58:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:16.729 01:58:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:16.729 01:58:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:16.729 01:58:05 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:16.729 01:58:05 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:16.729 01:58:05 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:16.729 01:58:05 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:16.729 net.core.busy_poll = 1 00:22:16.729 01:58:05 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:16.729 net.core.busy_read = 1 00:22:16.729 01:58:05 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:16.729 01:58:05 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:16.729 01:58:05 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:16.729 01:58:05 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:16.729 01:58:05 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:16.729 01:58:05 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:16.729 01:58:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:16.729 01:58:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:16.729 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:16.729 01:58:05 -- nvmf/common.sh@469 -- # nvmfpid=3504703 00:22:16.729 01:58:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:16.729 01:58:05 -- nvmf/common.sh@470 -- # waitforlisten 3504703 00:22:16.729 01:58:05 -- common/autotest_common.sh@829 -- # '[' -z 3504703 ']' 00:22:16.729 01:58:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:16.729 01:58:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:16.729 01:58:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:16.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:16.729 01:58:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:16.729 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:16.729 [2024-11-19 01:58:05.226975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:16.729 [2024-11-19 01:58:05.227081] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:16.729 EAL: No free 2048 kB hugepages reported on node 1 00:22:16.988 [2024-11-19 01:58:05.293905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:16.988 [2024-11-19 01:58:05.405808] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:16.988 [2024-11-19 01:58:05.405943] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:16.988 [2024-11-19 01:58:05.405969] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:16.988 [2024-11-19 01:58:05.405982] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:16.988 [2024-11-19 01:58:05.406048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:16.988 [2024-11-19 01:58:05.406100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:16.988 [2024-11-19 01:58:05.406151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:16.988 [2024-11-19 01:58:05.406154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:16.988 01:58:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:16.988 01:58:05 -- common/autotest_common.sh@862 -- # return 0 00:22:16.988 01:58:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:16.988 01:58:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:16.988 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:16.988 01:58:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:16.988 01:58:05 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:16.988 01:58:05 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:16.988 01:58:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:16.988 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:16.988 01:58:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:16.988 01:58:05 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:16.988 01:58:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:16.988 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:17.247 01:58:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.247 01:58:05 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:17.247 01:58:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.247 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:17.247 [2024-11-19 01:58:05.592611] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:17.247 01:58:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.247 01:58:05 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:17.247 01:58:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.247 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:17.247 Malloc1 00:22:17.247 01:58:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.247 01:58:05 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:17.247 01:58:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.247 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:17.247 01:58:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.247 01:58:05 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:17.247 01:58:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.247 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:17.247 01:58:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.247 01:58:05 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:17.247 01:58:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.247 01:58:05 -- common/autotest_common.sh@10 -- # set +x 00:22:17.247 [2024-11-19 01:58:05.645847] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:17.247 01:58:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.247 01:58:05 -- target/perf_adq.sh@94 -- # perfpid=3504734 00:22:17.247 01:58:05 -- target/perf_adq.sh@95 -- # sleep 2 00:22:17.247 01:58:05 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:17.247 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.150 01:58:07 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:19.150 01:58:07 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:19.150 01:58:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.150 01:58:07 -- target/perf_adq.sh@97 -- # wc -l 00:22:19.150 01:58:07 -- common/autotest_common.sh@10 -- # set +x 00:22:19.150 01:58:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.150 01:58:07 -- target/perf_adq.sh@97 -- # count=2 00:22:19.150 01:58:07 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:19.150 01:58:07 -- target/perf_adq.sh@103 -- # wait 3504734 00:22:29.120 Initializing NVMe Controllers 00:22:29.120 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:29.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:29.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:29.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:29.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:29.120 Initialization complete. Launching workers. 00:22:29.120 ======================================================== 00:22:29.120 Latency(us) 00:22:29.120 Device Information : IOPS MiB/s Average min max 00:22:29.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7932.60 30.99 8069.82 1133.93 53137.56 00:22:29.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 6653.70 25.99 9649.47 1197.13 54024.96 00:22:29.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7447.90 29.09 8613.40 1134.48 52677.30 00:22:29.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 6822.30 26.65 9384.09 1408.97 53911.56 00:22:29.120 ======================================================== 00:22:29.120 Total : 28856.50 112.72 8885.08 1133.93 54024.96 00:22:29.120 00:22:29.120 01:58:15 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:29.120 01:58:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:29.120 01:58:15 -- nvmf/common.sh@116 -- # sync 00:22:29.120 01:58:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:29.120 01:58:15 -- nvmf/common.sh@119 -- # set +e 00:22:29.120 01:58:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:29.120 01:58:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:29.120 rmmod nvme_tcp 00:22:29.120 rmmod nvme_fabrics 00:22:29.120 rmmod nvme_keyring 00:22:29.120 01:58:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:29.120 01:58:15 -- nvmf/common.sh@123 -- # set -e 00:22:29.120 01:58:15 -- nvmf/common.sh@124 -- # return 0 00:22:29.120 01:58:15 -- nvmf/common.sh@477 -- # '[' -n 3504703 ']' 00:22:29.120 01:58:15 -- nvmf/common.sh@478 -- # killprocess 3504703 00:22:29.120 01:58:15 -- common/autotest_common.sh@936 -- # '[' -z 3504703 ']' 00:22:29.120 01:58:15 -- common/autotest_common.sh@940 -- # kill -0 3504703 00:22:29.120 01:58:15 -- common/autotest_common.sh@941 -- # uname 00:22:29.120 01:58:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:29.120 01:58:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3504703 00:22:29.120 01:58:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:29.120 01:58:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:29.120 01:58:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3504703' 00:22:29.120 killing process with pid 3504703 00:22:29.120 01:58:15 -- common/autotest_common.sh@955 -- # kill 3504703 00:22:29.120 01:58:15 -- common/autotest_common.sh@960 -- # wait 3504703 00:22:29.120 01:58:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:29.120 01:58:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:29.120 01:58:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:29.120 01:58:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:29.120 01:58:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:29.120 01:58:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.120 01:58:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.120 01:58:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.058 01:58:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:30.058 01:58:18 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:30.058 00:22:30.058 real 0m45.950s 00:22:30.058 user 2m41.522s 00:22:30.058 sys 0m9.950s 00:22:30.058 01:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:30.058 01:58:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.058 ************************************ 00:22:30.058 END TEST nvmf_perf_adq 00:22:30.058 ************************************ 00:22:30.058 01:58:18 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:30.058 01:58:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:30.058 01:58:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:30.058 01:58:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.058 ************************************ 00:22:30.058 START TEST nvmf_shutdown 00:22:30.058 ************************************ 00:22:30.058 01:58:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:30.058 * Looking for test storage... 00:22:30.058 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:30.058 01:58:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:30.058 01:58:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:30.058 01:58:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:30.058 01:58:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:30.058 01:58:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:30.058 01:58:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:30.058 01:58:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:30.058 01:58:18 -- scripts/common.sh@335 -- # IFS=.-: 00:22:30.058 01:58:18 -- scripts/common.sh@335 -- # read -ra ver1 00:22:30.058 01:58:18 -- scripts/common.sh@336 -- # IFS=.-: 00:22:30.058 01:58:18 -- scripts/common.sh@336 -- # read -ra ver2 00:22:30.058 01:58:18 -- scripts/common.sh@337 -- # local 'op=<' 00:22:30.058 01:58:18 -- scripts/common.sh@339 -- # ver1_l=2 00:22:30.058 01:58:18 -- scripts/common.sh@340 -- # ver2_l=1 00:22:30.058 01:58:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:30.058 01:58:18 -- scripts/common.sh@343 -- # case "$op" in 00:22:30.058 01:58:18 -- scripts/common.sh@344 -- # : 1 00:22:30.058 01:58:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:30.058 01:58:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:30.058 01:58:18 -- scripts/common.sh@364 -- # decimal 1 00:22:30.058 01:58:18 -- scripts/common.sh@352 -- # local d=1 00:22:30.058 01:58:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:30.058 01:58:18 -- scripts/common.sh@354 -- # echo 1 00:22:30.058 01:58:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:30.058 01:58:18 -- scripts/common.sh@365 -- # decimal 2 00:22:30.058 01:58:18 -- scripts/common.sh@352 -- # local d=2 00:22:30.058 01:58:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:30.058 01:58:18 -- scripts/common.sh@354 -- # echo 2 00:22:30.058 01:58:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:30.058 01:58:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:30.058 01:58:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:30.058 01:58:18 -- scripts/common.sh@367 -- # return 0 00:22:30.059 01:58:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:30.059 01:58:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:30.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.059 --rc genhtml_branch_coverage=1 00:22:30.059 --rc genhtml_function_coverage=1 00:22:30.059 --rc genhtml_legend=1 00:22:30.059 --rc geninfo_all_blocks=1 00:22:30.059 --rc geninfo_unexecuted_blocks=1 00:22:30.059 00:22:30.059 ' 00:22:30.059 01:58:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:30.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.059 --rc genhtml_branch_coverage=1 00:22:30.059 --rc genhtml_function_coverage=1 00:22:30.059 --rc genhtml_legend=1 00:22:30.059 --rc geninfo_all_blocks=1 00:22:30.059 --rc geninfo_unexecuted_blocks=1 00:22:30.059 00:22:30.059 ' 00:22:30.059 01:58:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:30.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.059 --rc genhtml_branch_coverage=1 00:22:30.059 --rc genhtml_function_coverage=1 00:22:30.059 --rc genhtml_legend=1 00:22:30.059 --rc geninfo_all_blocks=1 00:22:30.059 --rc geninfo_unexecuted_blocks=1 00:22:30.059 00:22:30.059 ' 00:22:30.059 01:58:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:30.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.059 --rc genhtml_branch_coverage=1 00:22:30.059 --rc genhtml_function_coverage=1 00:22:30.059 --rc genhtml_legend=1 00:22:30.059 --rc geninfo_all_blocks=1 00:22:30.059 --rc geninfo_unexecuted_blocks=1 00:22:30.059 00:22:30.059 ' 00:22:30.059 01:58:18 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:30.059 01:58:18 -- nvmf/common.sh@7 -- # uname -s 00:22:30.059 01:58:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:30.059 01:58:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:30.059 01:58:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:30.059 01:58:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:30.059 01:58:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:30.059 01:58:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:30.059 01:58:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:30.059 01:58:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:30.059 01:58:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:30.059 01:58:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:30.059 01:58:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:30.059 01:58:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:30.059 01:58:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:30.059 01:58:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:30.059 01:58:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:30.059 01:58:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:30.059 01:58:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:30.059 01:58:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:30.059 01:58:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:30.059 01:58:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.059 01:58:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.059 01:58:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.059 01:58:18 -- paths/export.sh@5 -- # export PATH 00:22:30.059 01:58:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.059 01:58:18 -- nvmf/common.sh@46 -- # : 0 00:22:30.059 01:58:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:30.059 01:58:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:30.059 01:58:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:30.059 01:58:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:30.059 01:58:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:30.059 01:58:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:30.059 01:58:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:30.059 01:58:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:30.059 01:58:18 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:30.059 01:58:18 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:30.059 01:58:18 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:30.059 01:58:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:30.059 01:58:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:30.059 01:58:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.059 ************************************ 00:22:30.059 START TEST nvmf_shutdown_tc1 00:22:30.059 ************************************ 00:22:30.059 01:58:18 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:30.059 01:58:18 -- target/shutdown.sh@74 -- # starttarget 00:22:30.059 01:58:18 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:30.059 01:58:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:30.059 01:58:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:30.059 01:58:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:30.059 01:58:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:30.059 01:58:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:30.059 01:58:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:30.059 01:58:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:30.059 01:58:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.059 01:58:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:30.059 01:58:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:30.059 01:58:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:30.059 01:58:18 -- common/autotest_common.sh@10 -- # set +x 00:22:31.961 01:58:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:31.961 01:58:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:31.961 01:58:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:31.961 01:58:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:31.961 01:58:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:31.961 01:58:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:31.962 01:58:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:31.962 01:58:20 -- nvmf/common.sh@294 -- # net_devs=() 00:22:31.962 01:58:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:31.962 01:58:20 -- nvmf/common.sh@295 -- # e810=() 00:22:31.962 01:58:20 -- nvmf/common.sh@295 -- # local -ga e810 00:22:31.962 01:58:20 -- nvmf/common.sh@296 -- # x722=() 00:22:31.962 01:58:20 -- nvmf/common.sh@296 -- # local -ga x722 00:22:31.962 01:58:20 -- nvmf/common.sh@297 -- # mlx=() 00:22:31.962 01:58:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:31.962 01:58:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:31.962 01:58:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:31.962 01:58:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:31.962 01:58:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:31.962 01:58:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:31.962 01:58:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:31.962 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:31.962 01:58:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:31.962 01:58:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:31.962 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:31.962 01:58:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:31.962 01:58:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:31.962 01:58:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:31.962 01:58:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:31.962 01:58:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:31.962 01:58:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:31.962 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:31.962 01:58:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:31.962 01:58:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:31.962 01:58:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:31.962 01:58:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:31.962 01:58:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:31.962 01:58:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:31.962 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:31.962 01:58:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:31.962 01:58:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:31.962 01:58:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:31.962 01:58:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:31.962 01:58:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:31.962 01:58:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:31.962 01:58:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:31.962 01:58:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:31.962 01:58:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:31.962 01:58:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:31.962 01:58:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:31.962 01:58:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:31.962 01:58:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:31.962 01:58:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:31.962 01:58:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:31.962 01:58:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:31.962 01:58:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:31.962 01:58:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:31.962 01:58:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:31.962 01:58:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:31.962 01:58:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:31.962 01:58:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:32.221 01:58:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:32.221 01:58:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:32.221 01:58:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:32.221 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:32.221 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:22:32.221 00:22:32.221 --- 10.0.0.2 ping statistics --- 00:22:32.221 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:32.221 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:22:32.221 01:58:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:32.221 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:32.221 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:22:32.221 00:22:32.221 --- 10.0.0.1 ping statistics --- 00:22:32.221 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:32.221 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:22:32.221 01:58:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:32.221 01:58:20 -- nvmf/common.sh@410 -- # return 0 00:22:32.221 01:58:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:32.221 01:58:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:32.221 01:58:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:32.221 01:58:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:32.221 01:58:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:32.221 01:58:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:32.221 01:58:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:32.221 01:58:20 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:32.221 01:58:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:32.221 01:58:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:32.221 01:58:20 -- common/autotest_common.sh@10 -- # set +x 00:22:32.221 01:58:20 -- nvmf/common.sh@469 -- # nvmfpid=3507943 00:22:32.221 01:58:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:32.221 01:58:20 -- nvmf/common.sh@470 -- # waitforlisten 3507943 00:22:32.221 01:58:20 -- common/autotest_common.sh@829 -- # '[' -z 3507943 ']' 00:22:32.221 01:58:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:32.221 01:58:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:32.221 01:58:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:32.221 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:32.221 01:58:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:32.221 01:58:20 -- common/autotest_common.sh@10 -- # set +x 00:22:32.221 [2024-11-19 01:58:20.623703] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:32.221 [2024-11-19 01:58:20.623775] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:32.221 EAL: No free 2048 kB hugepages reported on node 1 00:22:32.221 [2024-11-19 01:58:20.689438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:32.479 [2024-11-19 01:58:20.800551] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:32.479 [2024-11-19 01:58:20.800711] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:32.479 [2024-11-19 01:58:20.800730] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:32.479 [2024-11-19 01:58:20.800750] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:32.479 [2024-11-19 01:58:20.800847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:32.479 [2024-11-19 01:58:20.800901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:32.479 [2024-11-19 01:58:20.800952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:32.479 [2024-11-19 01:58:20.800956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:33.415 01:58:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:33.415 01:58:21 -- common/autotest_common.sh@862 -- # return 0 00:22:33.415 01:58:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:33.415 01:58:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:33.415 01:58:21 -- common/autotest_common.sh@10 -- # set +x 00:22:33.415 01:58:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:33.415 01:58:21 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:33.415 01:58:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.415 01:58:21 -- common/autotest_common.sh@10 -- # set +x 00:22:33.415 [2024-11-19 01:58:21.646315] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:33.415 01:58:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.415 01:58:21 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:33.415 01:58:21 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:33.415 01:58:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:33.415 01:58:21 -- common/autotest_common.sh@10 -- # set +x 00:22:33.415 01:58:21 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:33.415 01:58:21 -- target/shutdown.sh@28 -- # cat 00:22:33.415 01:58:21 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:33.415 01:58:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.415 01:58:21 -- common/autotest_common.sh@10 -- # set +x 00:22:33.415 Malloc1 00:22:33.415 [2024-11-19 01:58:21.735463] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:33.415 Malloc2 00:22:33.415 Malloc3 00:22:33.415 Malloc4 00:22:33.415 Malloc5 00:22:33.415 Malloc6 00:22:33.674 Malloc7 00:22:33.674 Malloc8 00:22:33.674 Malloc9 00:22:33.674 Malloc10 00:22:33.674 01:58:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.674 01:58:22 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:33.674 01:58:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:33.674 01:58:22 -- common/autotest_common.sh@10 -- # set +x 00:22:33.674 01:58:22 -- target/shutdown.sh@78 -- # perfpid=3508249 00:22:33.674 01:58:22 -- target/shutdown.sh@79 -- # waitforlisten 3508249 /var/tmp/bdevperf.sock 00:22:33.674 01:58:22 -- common/autotest_common.sh@829 -- # '[' -z 3508249 ']' 00:22:33.674 01:58:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:33.674 01:58:22 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:33.674 01:58:22 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:33.674 01:58:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:33.674 01:58:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:33.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:33.674 01:58:22 -- nvmf/common.sh@520 -- # config=() 00:22:33.674 01:58:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:33.674 01:58:22 -- nvmf/common.sh@520 -- # local subsystem config 00:22:33.674 01:58:22 -- common/autotest_common.sh@10 -- # set +x 00:22:33.674 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.674 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.674 { 00:22:33.674 "params": { 00:22:33.674 "name": "Nvme$subsystem", 00:22:33.674 "trtype": "$TEST_TRANSPORT", 00:22:33.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.674 "adrfam": "ipv4", 00:22:33.674 "trsvcid": "$NVMF_PORT", 00:22:33.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.674 "hdgst": ${hdgst:-false}, 00:22:33.674 "ddgst": ${ddgst:-false} 00:22:33.674 }, 00:22:33.674 "method": "bdev_nvme_attach_controller" 00:22:33.674 } 00:22:33.674 EOF 00:22:33.674 )") 00:22:33.674 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.674 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.674 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.674 { 00:22:33.674 "params": { 00:22:33.674 "name": "Nvme$subsystem", 00:22:33.674 "trtype": "$TEST_TRANSPORT", 00:22:33.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.674 "adrfam": "ipv4", 00:22:33.674 "trsvcid": "$NVMF_PORT", 00:22:33.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.674 "hdgst": ${hdgst:-false}, 00:22:33.674 "ddgst": ${ddgst:-false} 00:22:33.674 }, 00:22:33.674 "method": "bdev_nvme_attach_controller" 00:22:33.674 } 00:22:33.674 EOF 00:22:33.674 )") 00:22:33.674 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.674 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.674 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.674 { 00:22:33.674 "params": { 00:22:33.674 "name": "Nvme$subsystem", 00:22:33.674 "trtype": "$TEST_TRANSPORT", 00:22:33.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.674 "adrfam": "ipv4", 00:22:33.674 "trsvcid": "$NVMF_PORT", 00:22:33.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.674 "hdgst": ${hdgst:-false}, 00:22:33.674 "ddgst": ${ddgst:-false} 00:22:33.674 }, 00:22:33.674 "method": "bdev_nvme_attach_controller" 00:22:33.674 } 00:22:33.674 EOF 00:22:33.674 )") 00:22:33.674 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.674 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.933 { 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme$subsystem", 00:22:33.933 "trtype": "$TEST_TRANSPORT", 00:22:33.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "$NVMF_PORT", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.933 "hdgst": ${hdgst:-false}, 00:22:33.933 "ddgst": ${ddgst:-false} 00:22:33.933 }, 00:22:33.933 "method": "bdev_nvme_attach_controller" 00:22:33.933 } 00:22:33.933 EOF 00:22:33.933 )") 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.933 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.933 { 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme$subsystem", 00:22:33.933 "trtype": "$TEST_TRANSPORT", 00:22:33.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "$NVMF_PORT", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.933 "hdgst": ${hdgst:-false}, 00:22:33.933 "ddgst": ${ddgst:-false} 00:22:33.933 }, 00:22:33.933 "method": "bdev_nvme_attach_controller" 00:22:33.933 } 00:22:33.933 EOF 00:22:33.933 )") 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.933 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.933 { 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme$subsystem", 00:22:33.933 "trtype": "$TEST_TRANSPORT", 00:22:33.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "$NVMF_PORT", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.933 "hdgst": ${hdgst:-false}, 00:22:33.933 "ddgst": ${ddgst:-false} 00:22:33.933 }, 00:22:33.933 "method": "bdev_nvme_attach_controller" 00:22:33.933 } 00:22:33.933 EOF 00:22:33.933 )") 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.933 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.933 { 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme$subsystem", 00:22:33.933 "trtype": "$TEST_TRANSPORT", 00:22:33.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "$NVMF_PORT", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.933 "hdgst": ${hdgst:-false}, 00:22:33.933 "ddgst": ${ddgst:-false} 00:22:33.933 }, 00:22:33.933 "method": "bdev_nvme_attach_controller" 00:22:33.933 } 00:22:33.933 EOF 00:22:33.933 )") 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.933 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.933 { 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme$subsystem", 00:22:33.933 "trtype": "$TEST_TRANSPORT", 00:22:33.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "$NVMF_PORT", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.933 "hdgst": ${hdgst:-false}, 00:22:33.933 "ddgst": ${ddgst:-false} 00:22:33.933 }, 00:22:33.933 "method": "bdev_nvme_attach_controller" 00:22:33.933 } 00:22:33.933 EOF 00:22:33.933 )") 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.933 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.933 { 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme$subsystem", 00:22:33.933 "trtype": "$TEST_TRANSPORT", 00:22:33.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "$NVMF_PORT", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.933 "hdgst": ${hdgst:-false}, 00:22:33.933 "ddgst": ${ddgst:-false} 00:22:33.933 }, 00:22:33.933 "method": "bdev_nvme_attach_controller" 00:22:33.933 } 00:22:33.933 EOF 00:22:33.933 )") 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.933 01:58:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.933 { 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme$subsystem", 00:22:33.933 "trtype": "$TEST_TRANSPORT", 00:22:33.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "$NVMF_PORT", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.933 "hdgst": ${hdgst:-false}, 00:22:33.933 "ddgst": ${ddgst:-false} 00:22:33.933 }, 00:22:33.933 "method": "bdev_nvme_attach_controller" 00:22:33.933 } 00:22:33.933 EOF 00:22:33.933 )") 00:22:33.933 01:58:22 -- nvmf/common.sh@542 -- # cat 00:22:33.933 01:58:22 -- nvmf/common.sh@544 -- # jq . 00:22:33.933 01:58:22 -- nvmf/common.sh@545 -- # IFS=, 00:22:33.933 01:58:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:33.933 "params": { 00:22:33.933 "name": "Nvme1", 00:22:33.933 "trtype": "tcp", 00:22:33.933 "traddr": "10.0.0.2", 00:22:33.933 "adrfam": "ipv4", 00:22:33.933 "trsvcid": "4420", 00:22:33.933 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:33.933 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme2", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme3", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme4", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme5", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme6", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme7", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme8", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme9", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 },{ 00:22:33.934 "params": { 00:22:33.934 "name": "Nvme10", 00:22:33.934 "trtype": "tcp", 00:22:33.934 "traddr": "10.0.0.2", 00:22:33.934 "adrfam": "ipv4", 00:22:33.934 "trsvcid": "4420", 00:22:33.934 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:33.934 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:33.934 "hdgst": false, 00:22:33.934 "ddgst": false 00:22:33.934 }, 00:22:33.934 "method": "bdev_nvme_attach_controller" 00:22:33.934 }' 00:22:33.934 [2024-11-19 01:58:22.247014] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:33.934 [2024-11-19 01:58:22.247088] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:33.934 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.934 [2024-11-19 01:58:22.309284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:33.934 [2024-11-19 01:58:22.417690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:35.834 01:58:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:35.834 01:58:23 -- common/autotest_common.sh@862 -- # return 0 00:22:35.834 01:58:23 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:35.834 01:58:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:35.834 01:58:23 -- common/autotest_common.sh@10 -- # set +x 00:22:35.834 01:58:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:35.834 01:58:23 -- target/shutdown.sh@83 -- # kill -9 3508249 00:22:35.834 01:58:23 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:35.834 01:58:23 -- target/shutdown.sh@87 -- # sleep 1 00:22:36.769 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3508249 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:36.769 01:58:24 -- target/shutdown.sh@88 -- # kill -0 3507943 00:22:36.769 01:58:24 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:36.769 01:58:24 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:36.769 01:58:24 -- nvmf/common.sh@520 -- # config=() 00:22:36.769 01:58:24 -- nvmf/common.sh@520 -- # local subsystem config 00:22:36.769 01:58:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:24 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:25 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:25 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.769 01:58:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.769 { 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme$subsystem", 00:22:36.769 "trtype": "$TEST_TRANSPORT", 00:22:36.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "$NVMF_PORT", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.769 "hdgst": ${hdgst:-false}, 00:22:36.769 "ddgst": ${ddgst:-false} 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 } 00:22:36.769 EOF 00:22:36.769 )") 00:22:36.769 01:58:25 -- nvmf/common.sh@542 -- # cat 00:22:36.769 01:58:25 -- nvmf/common.sh@544 -- # jq . 00:22:36.769 01:58:25 -- nvmf/common.sh@545 -- # IFS=, 00:22:36.769 01:58:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme1", 00:22:36.769 "trtype": "tcp", 00:22:36.769 "traddr": "10.0.0.2", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "4420", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:36.769 "hdgst": false, 00:22:36.769 "ddgst": false 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 },{ 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme2", 00:22:36.769 "trtype": "tcp", 00:22:36.769 "traddr": "10.0.0.2", 00:22:36.769 "adrfam": "ipv4", 00:22:36.769 "trsvcid": "4420", 00:22:36.769 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:36.769 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:36.769 "hdgst": false, 00:22:36.769 "ddgst": false 00:22:36.769 }, 00:22:36.769 "method": "bdev_nvme_attach_controller" 00:22:36.769 },{ 00:22:36.769 "params": { 00:22:36.769 "name": "Nvme3", 00:22:36.769 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 },{ 00:22:36.770 "params": { 00:22:36.770 "name": "Nvme4", 00:22:36.770 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 },{ 00:22:36.770 "params": { 00:22:36.770 "name": "Nvme5", 00:22:36.770 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 },{ 00:22:36.770 "params": { 00:22:36.770 "name": "Nvme6", 00:22:36.770 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 },{ 00:22:36.770 "params": { 00:22:36.770 "name": "Nvme7", 00:22:36.770 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 },{ 00:22:36.770 "params": { 00:22:36.770 "name": "Nvme8", 00:22:36.770 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 },{ 00:22:36.770 "params": { 00:22:36.770 "name": "Nvme9", 00:22:36.770 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 },{ 00:22:36.770 "params": { 00:22:36.770 "name": "Nvme10", 00:22:36.770 "trtype": "tcp", 00:22:36.770 "traddr": "10.0.0.2", 00:22:36.770 "adrfam": "ipv4", 00:22:36.770 "trsvcid": "4420", 00:22:36.770 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:36.770 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:36.770 "hdgst": false, 00:22:36.770 "ddgst": false 00:22:36.770 }, 00:22:36.770 "method": "bdev_nvme_attach_controller" 00:22:36.770 }' 00:22:36.770 [2024-11-19 01:58:25.016900] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:36.770 [2024-11-19 01:58:25.017003] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3508566 ] 00:22:36.770 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.770 [2024-11-19 01:58:25.080335] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:36.770 [2024-11-19 01:58:25.192277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:38.669 Running I/O for 1 seconds... 00:22:39.604 00:22:39.604 Latency(us) 00:22:39.604 [2024-11-19T00:58:28.147Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme1n1 : 1.09 398.64 24.91 0.00 0.00 157684.27 18835.53 121168.78 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme2n1 : 1.07 371.05 23.19 0.00 0.00 166604.64 40389.59 145247.19 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme3n1 : 1.09 397.31 24.83 0.00 0.00 156144.92 17767.54 119615.34 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme4n1 : 1.09 396.87 24.80 0.00 0.00 155216.52 17476.27 117285.17 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme5n1 : 1.10 394.60 24.66 0.00 0.00 154899.97 19126.80 118061.89 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme6n1 : 1.10 393.58 24.60 0.00 0.00 154323.47 18155.90 118838.61 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme7n1 : 1.10 392.81 24.55 0.00 0.00 153633.99 17573.36 123498.95 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme8n1 : 1.11 392.00 24.50 0.00 0.00 153519.62 11942.12 124275.67 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme9n1 : 1.11 395.63 24.73 0.00 0.00 151063.66 12427.57 124275.67 00:22:39.604 [2024-11-19T00:58:28.147Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.604 Verification LBA range: start 0x0 length 0x400 00:22:39.604 Nvme10n1 : 1.12 389.19 24.32 0.00 0.00 153482.68 4102.07 148354.09 00:22:39.604 [2024-11-19T00:58:28.147Z] =================================================================================================================== 00:22:39.604 [2024-11-19T00:58:28.147Z] Total : 3921.69 245.11 0.00 0.00 155560.58 4102.07 148354.09 00:22:39.862 01:58:28 -- target/shutdown.sh@93 -- # stoptarget 00:22:39.862 01:58:28 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:39.862 01:58:28 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:39.862 01:58:28 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:39.862 01:58:28 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:39.862 01:58:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:39.862 01:58:28 -- nvmf/common.sh@116 -- # sync 00:22:39.862 01:58:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:39.862 01:58:28 -- nvmf/common.sh@119 -- # set +e 00:22:39.862 01:58:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:39.862 01:58:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:39.862 rmmod nvme_tcp 00:22:39.862 rmmod nvme_fabrics 00:22:39.862 rmmod nvme_keyring 00:22:39.862 01:58:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:39.862 01:58:28 -- nvmf/common.sh@123 -- # set -e 00:22:39.862 01:58:28 -- nvmf/common.sh@124 -- # return 0 00:22:39.862 01:58:28 -- nvmf/common.sh@477 -- # '[' -n 3507943 ']' 00:22:39.862 01:58:28 -- nvmf/common.sh@478 -- # killprocess 3507943 00:22:39.862 01:58:28 -- common/autotest_common.sh@936 -- # '[' -z 3507943 ']' 00:22:39.863 01:58:28 -- common/autotest_common.sh@940 -- # kill -0 3507943 00:22:39.863 01:58:28 -- common/autotest_common.sh@941 -- # uname 00:22:39.863 01:58:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:39.863 01:58:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3507943 00:22:39.863 01:58:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:39.863 01:58:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:39.863 01:58:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3507943' 00:22:39.863 killing process with pid 3507943 00:22:39.863 01:58:28 -- common/autotest_common.sh@955 -- # kill 3507943 00:22:39.863 01:58:28 -- common/autotest_common.sh@960 -- # wait 3507943 00:22:40.428 01:58:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:40.428 01:58:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:40.428 01:58:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:40.428 01:58:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:40.428 01:58:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:40.428 01:58:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:40.428 01:58:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:40.428 01:58:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:42.964 01:58:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:42.964 00:22:42.964 real 0m12.530s 00:22:42.964 user 0m37.390s 00:22:42.964 sys 0m3.225s 00:22:42.964 01:58:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:42.964 01:58:30 -- common/autotest_common.sh@10 -- # set +x 00:22:42.964 ************************************ 00:22:42.964 END TEST nvmf_shutdown_tc1 00:22:42.964 ************************************ 00:22:42.964 01:58:30 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:42.964 01:58:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:42.964 01:58:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:42.964 01:58:30 -- common/autotest_common.sh@10 -- # set +x 00:22:42.964 ************************************ 00:22:42.964 START TEST nvmf_shutdown_tc2 00:22:42.964 ************************************ 00:22:42.964 01:58:30 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:42.964 01:58:30 -- target/shutdown.sh@98 -- # starttarget 00:22:42.964 01:58:30 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:42.964 01:58:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:42.964 01:58:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:42.964 01:58:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:42.964 01:58:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:42.964 01:58:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:42.964 01:58:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:42.964 01:58:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:42.964 01:58:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:42.964 01:58:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:42.964 01:58:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:42.964 01:58:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:42.964 01:58:30 -- common/autotest_common.sh@10 -- # set +x 00:22:42.964 01:58:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:42.964 01:58:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:42.964 01:58:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:42.964 01:58:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:42.964 01:58:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:42.964 01:58:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:42.964 01:58:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:42.964 01:58:30 -- nvmf/common.sh@294 -- # net_devs=() 00:22:42.964 01:58:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:42.964 01:58:30 -- nvmf/common.sh@295 -- # e810=() 00:22:42.964 01:58:30 -- nvmf/common.sh@295 -- # local -ga e810 00:22:42.964 01:58:30 -- nvmf/common.sh@296 -- # x722=() 00:22:42.964 01:58:30 -- nvmf/common.sh@296 -- # local -ga x722 00:22:42.964 01:58:30 -- nvmf/common.sh@297 -- # mlx=() 00:22:42.964 01:58:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:42.964 01:58:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:42.964 01:58:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:42.964 01:58:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:42.964 01:58:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:42.964 01:58:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:42.964 01:58:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:42.964 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:42.964 01:58:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:42.964 01:58:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:42.964 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:42.964 01:58:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:42.964 01:58:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:42.964 01:58:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:42.964 01:58:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:42.964 01:58:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:42.964 01:58:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:42.964 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:42.964 01:58:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:42.964 01:58:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:42.964 01:58:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:42.964 01:58:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:42.964 01:58:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:42.964 01:58:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:42.964 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:42.964 01:58:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:42.964 01:58:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:42.964 01:58:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:42.964 01:58:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:42.964 01:58:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:42.964 01:58:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:42.964 01:58:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:42.964 01:58:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:42.964 01:58:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:42.964 01:58:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:42.964 01:58:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:42.964 01:58:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:42.964 01:58:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:42.964 01:58:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:42.964 01:58:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:42.964 01:58:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:42.964 01:58:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:42.964 01:58:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:42.964 01:58:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:42.964 01:58:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:42.964 01:58:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:42.964 01:58:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:42.964 01:58:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:42.964 01:58:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:42.964 01:58:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:42.964 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:42.964 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:22:42.965 00:22:42.965 --- 10.0.0.2 ping statistics --- 00:22:42.965 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:42.965 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:22:42.965 01:58:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:42.965 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:42.965 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:22:42.965 00:22:42.965 --- 10.0.0.1 ping statistics --- 00:22:42.965 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:42.965 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:22:42.965 01:58:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:42.965 01:58:31 -- nvmf/common.sh@410 -- # return 0 00:22:42.965 01:58:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:42.965 01:58:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:42.965 01:58:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:42.965 01:58:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:42.965 01:58:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:42.965 01:58:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:42.965 01:58:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:42.965 01:58:31 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:42.965 01:58:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:42.965 01:58:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:42.965 01:58:31 -- common/autotest_common.sh@10 -- # set +x 00:22:42.965 01:58:31 -- nvmf/common.sh@469 -- # nvmfpid=3509468 00:22:42.965 01:58:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:42.965 01:58:31 -- nvmf/common.sh@470 -- # waitforlisten 3509468 00:22:42.965 01:58:31 -- common/autotest_common.sh@829 -- # '[' -z 3509468 ']' 00:22:42.965 01:58:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:42.965 01:58:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:42.965 01:58:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:42.965 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:42.965 01:58:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:42.965 01:58:31 -- common/autotest_common.sh@10 -- # set +x 00:22:42.965 [2024-11-19 01:58:31.201944] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:42.965 [2024-11-19 01:58:31.202025] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:42.965 EAL: No free 2048 kB hugepages reported on node 1 00:22:42.965 [2024-11-19 01:58:31.269888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:42.965 [2024-11-19 01:58:31.385758] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:42.965 [2024-11-19 01:58:31.385914] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:42.965 [2024-11-19 01:58:31.385933] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:42.965 [2024-11-19 01:58:31.385948] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:42.965 [2024-11-19 01:58:31.386065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:42.965 [2024-11-19 01:58:31.386154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:42.965 [2024-11-19 01:58:31.386199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:42.965 [2024-11-19 01:58:31.386203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:43.900 01:58:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:43.900 01:58:32 -- common/autotest_common.sh@862 -- # return 0 00:22:43.900 01:58:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:43.900 01:58:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:43.900 01:58:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.900 01:58:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:43.900 01:58:32 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:43.900 01:58:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.900 01:58:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.900 [2024-11-19 01:58:32.233354] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:43.900 01:58:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.900 01:58:32 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:43.900 01:58:32 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:43.900 01:58:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:43.900 01:58:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.900 01:58:32 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.900 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.900 01:58:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.901 01:58:32 -- target/shutdown.sh@28 -- # cat 00:22:43.901 01:58:32 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:43.901 01:58:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.901 01:58:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.901 Malloc1 00:22:43.901 [2024-11-19 01:58:32.322772] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:43.901 Malloc2 00:22:43.901 Malloc3 00:22:44.159 Malloc4 00:22:44.159 Malloc5 00:22:44.159 Malloc6 00:22:44.159 Malloc7 00:22:44.159 Malloc8 00:22:44.159 Malloc9 00:22:44.417 Malloc10 00:22:44.417 01:58:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.417 01:58:32 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:44.417 01:58:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:44.417 01:58:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.417 01:58:32 -- target/shutdown.sh@102 -- # perfpid=3509663 00:22:44.417 01:58:32 -- target/shutdown.sh@103 -- # waitforlisten 3509663 /var/tmp/bdevperf.sock 00:22:44.417 01:58:32 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:44.417 01:58:32 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:44.417 01:58:32 -- common/autotest_common.sh@829 -- # '[' -z 3509663 ']' 00:22:44.417 01:58:32 -- nvmf/common.sh@520 -- # config=() 00:22:44.417 01:58:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:44.417 01:58:32 -- nvmf/common.sh@520 -- # local subsystem config 00:22:44.417 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.417 01:58:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:44.417 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.417 { 00:22:44.417 "params": { 00:22:44.417 "name": "Nvme$subsystem", 00:22:44.417 "trtype": "$TEST_TRANSPORT", 00:22:44.417 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.417 "adrfam": "ipv4", 00:22:44.417 "trsvcid": "$NVMF_PORT", 00:22:44.417 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.417 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.417 "hdgst": ${hdgst:-false}, 00:22:44.417 "ddgst": ${ddgst:-false} 00:22:44.417 }, 00:22:44.417 "method": "bdev_nvme_attach_controller" 00:22:44.417 } 00:22:44.417 EOF 00:22:44.417 )") 00:22:44.417 01:58:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:44.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:44.417 01:58:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:44.417 01:58:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.417 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.417 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.417 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.417 { 00:22:44.417 "params": { 00:22:44.417 "name": "Nvme$subsystem", 00:22:44.417 "trtype": "$TEST_TRANSPORT", 00:22:44.417 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.417 "adrfam": "ipv4", 00:22:44.417 "trsvcid": "$NVMF_PORT", 00:22:44.417 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.417 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.417 "hdgst": ${hdgst:-false}, 00:22:44.417 "ddgst": ${ddgst:-false} 00:22:44.417 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.418 { 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme$subsystem", 00:22:44.418 "trtype": "$TEST_TRANSPORT", 00:22:44.418 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "$NVMF_PORT", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.418 "hdgst": ${hdgst:-false}, 00:22:44.418 "ddgst": ${ddgst:-false} 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 } 00:22:44.418 EOF 00:22:44.418 )") 00:22:44.418 01:58:32 -- nvmf/common.sh@542 -- # cat 00:22:44.418 01:58:32 -- nvmf/common.sh@544 -- # jq . 00:22:44.418 01:58:32 -- nvmf/common.sh@545 -- # IFS=, 00:22:44.418 01:58:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme1", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme2", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme3", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme4", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme5", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme6", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme7", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme8", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme9", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 },{ 00:22:44.418 "params": { 00:22:44.418 "name": "Nvme10", 00:22:44.418 "trtype": "tcp", 00:22:44.418 "traddr": "10.0.0.2", 00:22:44.418 "adrfam": "ipv4", 00:22:44.418 "trsvcid": "4420", 00:22:44.418 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:44.418 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:44.418 "hdgst": false, 00:22:44.418 "ddgst": false 00:22:44.418 }, 00:22:44.418 "method": "bdev_nvme_attach_controller" 00:22:44.418 }' 00:22:44.418 [2024-11-19 01:58:32.827458] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:44.418 [2024-11-19 01:58:32.827535] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3509663 ] 00:22:44.418 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.418 [2024-11-19 01:58:32.892538] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:44.677 [2024-11-19 01:58:33.001919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:46.051 Running I/O for 10 seconds... 00:22:46.051 01:58:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:46.051 01:58:34 -- common/autotest_common.sh@862 -- # return 0 00:22:46.051 01:58:34 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:46.051 01:58:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.051 01:58:34 -- common/autotest_common.sh@10 -- # set +x 00:22:46.309 01:58:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.309 01:58:34 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:46.309 01:58:34 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:46.309 01:58:34 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:46.309 01:58:34 -- target/shutdown.sh@57 -- # local ret=1 00:22:46.309 01:58:34 -- target/shutdown.sh@58 -- # local i 00:22:46.309 01:58:34 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:46.309 01:58:34 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:46.309 01:58:34 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:46.309 01:58:34 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:46.309 01:58:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.309 01:58:34 -- common/autotest_common.sh@10 -- # set +x 00:22:46.309 01:58:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.309 01:58:34 -- target/shutdown.sh@60 -- # read_io_count=42 00:22:46.309 01:58:34 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:22:46.309 01:58:34 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:46.568 01:58:34 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:46.568 01:58:34 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:46.568 01:58:34 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:46.568 01:58:34 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:46.568 01:58:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.568 01:58:34 -- common/autotest_common.sh@10 -- # set +x 00:22:46.568 01:58:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.568 01:58:34 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:46.568 01:58:34 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:46.568 01:58:34 -- target/shutdown.sh@64 -- # ret=0 00:22:46.568 01:58:34 -- target/shutdown.sh@65 -- # break 00:22:46.568 01:58:34 -- target/shutdown.sh@69 -- # return 0 00:22:46.568 01:58:34 -- target/shutdown.sh@109 -- # killprocess 3509663 00:22:46.568 01:58:34 -- common/autotest_common.sh@936 -- # '[' -z 3509663 ']' 00:22:46.568 01:58:34 -- common/autotest_common.sh@940 -- # kill -0 3509663 00:22:46.568 01:58:34 -- common/autotest_common.sh@941 -- # uname 00:22:46.568 01:58:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:46.568 01:58:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3509663 00:22:46.568 01:58:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:46.568 01:58:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:46.568 01:58:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3509663' 00:22:46.568 killing process with pid 3509663 00:22:46.568 01:58:34 -- common/autotest_common.sh@955 -- # kill 3509663 00:22:46.568 01:58:34 -- common/autotest_common.sh@960 -- # wait 3509663 00:22:46.568 Received shutdown signal, test time was about 0.621476 seconds 00:22:46.568 00:22:46.568 Latency(us) 00:22:46.568 [2024-11-19T00:58:35.111Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme1n1 : 0.62 442.23 27.64 0.00 0.00 141558.30 12913.02 118061.89 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme2n1 : 0.59 394.32 24.64 0.00 0.00 154295.33 4053.52 139810.13 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme3n1 : 0.62 441.26 27.58 0.00 0.00 138328.61 13107.20 115731.72 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme4n1 : 0.62 440.31 27.52 0.00 0.00 136806.58 12524.66 127382.57 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme5n1 : 0.62 438.25 27.39 0.00 0.00 135716.45 13398.47 112624.83 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme6n1 : 0.59 386.52 24.16 0.00 0.00 149460.41 22330.79 117285.17 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme7n1 : 0.59 384.18 24.01 0.00 0.00 148370.27 22622.06 119615.34 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme8n1 : 0.60 382.62 23.91 0.00 0.00 147192.41 20388.98 121168.78 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme9n1 : 0.60 379.78 23.74 0.00 0.00 146473.17 20777.34 121945.51 00:22:46.568 [2024-11-19T00:58:35.111Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.568 Verification LBA range: start 0x0 length 0x400 00:22:46.568 Nvme10n1 : 0.61 374.39 23.40 0.00 0.00 146689.50 21845.33 122722.23 00:22:46.568 [2024-11-19T00:58:35.111Z] =================================================================================================================== 00:22:46.568 [2024-11-19T00:58:35.111Z] Total : 4063.87 253.99 0.00 0.00 144048.12 4053.52 139810.13 00:22:47.179 01:58:35 -- target/shutdown.sh@112 -- # sleep 1 00:22:48.188 01:58:36 -- target/shutdown.sh@113 -- # kill -0 3509468 00:22:48.188 01:58:36 -- target/shutdown.sh@115 -- # stoptarget 00:22:48.188 01:58:36 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:48.188 01:58:36 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:48.188 01:58:36 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:48.188 01:58:36 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:48.188 01:58:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:48.188 01:58:36 -- nvmf/common.sh@116 -- # sync 00:22:48.188 01:58:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:48.188 01:58:36 -- nvmf/common.sh@119 -- # set +e 00:22:48.188 01:58:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:48.188 01:58:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:48.188 rmmod nvme_tcp 00:22:48.188 rmmod nvme_fabrics 00:22:48.188 rmmod nvme_keyring 00:22:48.188 01:58:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:48.188 01:58:36 -- nvmf/common.sh@123 -- # set -e 00:22:48.188 01:58:36 -- nvmf/common.sh@124 -- # return 0 00:22:48.188 01:58:36 -- nvmf/common.sh@477 -- # '[' -n 3509468 ']' 00:22:48.188 01:58:36 -- nvmf/common.sh@478 -- # killprocess 3509468 00:22:48.188 01:58:36 -- common/autotest_common.sh@936 -- # '[' -z 3509468 ']' 00:22:48.188 01:58:36 -- common/autotest_common.sh@940 -- # kill -0 3509468 00:22:48.188 01:58:36 -- common/autotest_common.sh@941 -- # uname 00:22:48.188 01:58:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:48.188 01:58:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3509468 00:22:48.188 01:58:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:48.188 01:58:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:48.188 01:58:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3509468' 00:22:48.188 killing process with pid 3509468 00:22:48.188 01:58:36 -- common/autotest_common.sh@955 -- # kill 3509468 00:22:48.188 01:58:36 -- common/autotest_common.sh@960 -- # wait 3509468 00:22:48.755 01:58:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:48.755 01:58:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:48.755 01:58:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:48.755 01:58:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:48.755 01:58:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:48.755 01:58:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:48.755 01:58:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:48.755 01:58:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:50.660 01:58:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:50.660 00:22:50.660 real 0m8.073s 00:22:50.660 user 0m24.996s 00:22:50.660 sys 0m1.387s 00:22:50.660 01:58:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:50.660 01:58:39 -- common/autotest_common.sh@10 -- # set +x 00:22:50.660 ************************************ 00:22:50.660 END TEST nvmf_shutdown_tc2 00:22:50.660 ************************************ 00:22:50.660 01:58:39 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:50.660 01:58:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:50.660 01:58:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:50.660 01:58:39 -- common/autotest_common.sh@10 -- # set +x 00:22:50.660 ************************************ 00:22:50.660 START TEST nvmf_shutdown_tc3 00:22:50.660 ************************************ 00:22:50.660 01:58:39 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:50.660 01:58:39 -- target/shutdown.sh@120 -- # starttarget 00:22:50.660 01:58:39 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:50.660 01:58:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:50.660 01:58:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:50.660 01:58:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:50.660 01:58:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:50.660 01:58:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:50.660 01:58:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:50.660 01:58:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:50.660 01:58:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:50.660 01:58:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:50.660 01:58:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:50.660 01:58:39 -- common/autotest_common.sh@10 -- # set +x 00:22:50.660 01:58:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:50.660 01:58:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:50.660 01:58:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:50.660 01:58:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:50.660 01:58:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:50.660 01:58:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:50.660 01:58:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:50.660 01:58:39 -- nvmf/common.sh@294 -- # net_devs=() 00:22:50.660 01:58:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:50.660 01:58:39 -- nvmf/common.sh@295 -- # e810=() 00:22:50.660 01:58:39 -- nvmf/common.sh@295 -- # local -ga e810 00:22:50.660 01:58:39 -- nvmf/common.sh@296 -- # x722=() 00:22:50.660 01:58:39 -- nvmf/common.sh@296 -- # local -ga x722 00:22:50.660 01:58:39 -- nvmf/common.sh@297 -- # mlx=() 00:22:50.660 01:58:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:50.660 01:58:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:50.660 01:58:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:50.660 01:58:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:50.660 01:58:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:50.660 01:58:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:50.660 01:58:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:50.660 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:50.660 01:58:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:50.660 01:58:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:50.660 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:50.660 01:58:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:50.660 01:58:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:50.660 01:58:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:50.660 01:58:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:50.660 01:58:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:50.660 01:58:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:50.660 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:50.660 01:58:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:50.660 01:58:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:50.660 01:58:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:50.660 01:58:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:50.660 01:58:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:50.660 01:58:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:50.660 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:50.660 01:58:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:50.660 01:58:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:50.660 01:58:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:50.660 01:58:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:50.660 01:58:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:50.660 01:58:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:50.660 01:58:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:50.660 01:58:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:50.660 01:58:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:50.661 01:58:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:50.661 01:58:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:50.661 01:58:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:50.661 01:58:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:50.661 01:58:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:50.661 01:58:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:50.661 01:58:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:50.661 01:58:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:50.661 01:58:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:50.661 01:58:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:50.661 01:58:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:50.661 01:58:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:50.661 01:58:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:50.918 01:58:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:50.918 01:58:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:50.918 01:58:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:50.918 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:50.918 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.335 ms 00:22:50.918 00:22:50.918 --- 10.0.0.2 ping statistics --- 00:22:50.918 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:50.918 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:22:50.918 01:58:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:50.918 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:50.918 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:22:50.918 00:22:50.918 --- 10.0.0.1 ping statistics --- 00:22:50.918 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:50.918 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:22:50.918 01:58:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:50.918 01:58:39 -- nvmf/common.sh@410 -- # return 0 00:22:50.918 01:58:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:50.918 01:58:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:50.918 01:58:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:50.918 01:58:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:50.918 01:58:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:50.918 01:58:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:50.918 01:58:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:50.918 01:58:39 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:50.918 01:58:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:50.918 01:58:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:50.918 01:58:39 -- common/autotest_common.sh@10 -- # set +x 00:22:50.918 01:58:39 -- nvmf/common.sh@469 -- # nvmfpid=3510592 00:22:50.918 01:58:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:50.918 01:58:39 -- nvmf/common.sh@470 -- # waitforlisten 3510592 00:22:50.918 01:58:39 -- common/autotest_common.sh@829 -- # '[' -z 3510592 ']' 00:22:50.918 01:58:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:50.918 01:58:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:50.918 01:58:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:50.918 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:50.918 01:58:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:50.918 01:58:39 -- common/autotest_common.sh@10 -- # set +x 00:22:50.918 [2024-11-19 01:58:39.325256] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:50.918 [2024-11-19 01:58:39.325345] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:50.918 EAL: No free 2048 kB hugepages reported on node 1 00:22:50.918 [2024-11-19 01:58:39.389766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:51.176 [2024-11-19 01:58:39.498556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:51.176 [2024-11-19 01:58:39.498714] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:51.176 [2024-11-19 01:58:39.498733] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:51.176 [2024-11-19 01:58:39.498746] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:51.176 [2024-11-19 01:58:39.498838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:51.176 [2024-11-19 01:58:39.498902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:51.176 [2024-11-19 01:58:39.498948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:51.176 [2024-11-19 01:58:39.498950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:52.110 01:58:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:52.110 01:58:40 -- common/autotest_common.sh@862 -- # return 0 00:22:52.110 01:58:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:52.110 01:58:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:52.110 01:58:40 -- common/autotest_common.sh@10 -- # set +x 00:22:52.110 01:58:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:52.110 01:58:40 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:52.110 01:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.110 01:58:40 -- common/autotest_common.sh@10 -- # set +x 00:22:52.110 [2024-11-19 01:58:40.338284] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:52.110 01:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.110 01:58:40 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:52.110 01:58:40 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:52.110 01:58:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:52.110 01:58:40 -- common/autotest_common.sh@10 -- # set +x 00:22:52.110 01:58:40 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:52.110 01:58:40 -- target/shutdown.sh@28 -- # cat 00:22:52.110 01:58:40 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:52.110 01:58:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.110 01:58:40 -- common/autotest_common.sh@10 -- # set +x 00:22:52.110 Malloc1 00:22:52.110 [2024-11-19 01:58:40.427386] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:52.110 Malloc2 00:22:52.110 Malloc3 00:22:52.110 Malloc4 00:22:52.110 Malloc5 00:22:52.110 Malloc6 00:22:52.369 Malloc7 00:22:52.369 Malloc8 00:22:52.369 Malloc9 00:22:52.369 Malloc10 00:22:52.369 01:58:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.369 01:58:40 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:52.369 01:58:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:52.369 01:58:40 -- common/autotest_common.sh@10 -- # set +x 00:22:52.369 01:58:40 -- target/shutdown.sh@124 -- # perfpid=3510792 00:22:52.369 01:58:40 -- target/shutdown.sh@125 -- # waitforlisten 3510792 /var/tmp/bdevperf.sock 00:22:52.369 01:58:40 -- common/autotest_common.sh@829 -- # '[' -z 3510792 ']' 00:22:52.369 01:58:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:52.369 01:58:40 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:52.369 01:58:40 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:52.369 01:58:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:52.369 01:58:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:52.369 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:52.369 01:58:40 -- nvmf/common.sh@520 -- # config=() 00:22:52.369 01:58:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:52.369 01:58:40 -- nvmf/common.sh@520 -- # local subsystem config 00:22:52.369 01:58:40 -- common/autotest_common.sh@10 -- # set +x 00:22:52.369 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.369 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.369 { 00:22:52.369 "params": { 00:22:52.369 "name": "Nvme$subsystem", 00:22:52.369 "trtype": "$TEST_TRANSPORT", 00:22:52.369 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.369 "adrfam": "ipv4", 00:22:52.369 "trsvcid": "$NVMF_PORT", 00:22:52.369 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.369 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.369 "hdgst": ${hdgst:-false}, 00:22:52.369 "ddgst": ${ddgst:-false} 00:22:52.369 }, 00:22:52.369 "method": "bdev_nvme_attach_controller" 00:22:52.369 } 00:22:52.369 EOF 00:22:52.369 )") 00:22:52.369 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.369 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.369 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.369 { 00:22:52.369 "params": { 00:22:52.369 "name": "Nvme$subsystem", 00:22:52.369 "trtype": "$TEST_TRANSPORT", 00:22:52.369 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.369 "adrfam": "ipv4", 00:22:52.369 "trsvcid": "$NVMF_PORT", 00:22:52.369 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.369 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.369 "hdgst": ${hdgst:-false}, 00:22:52.369 "ddgst": ${ddgst:-false} 00:22:52.369 }, 00:22:52.369 "method": "bdev_nvme_attach_controller" 00:22:52.369 } 00:22:52.369 EOF 00:22:52.369 )") 00:22:52.369 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.369 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.369 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.369 { 00:22:52.369 "params": { 00:22:52.369 "name": "Nvme$subsystem", 00:22:52.369 "trtype": "$TEST_TRANSPORT", 00:22:52.369 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.369 "adrfam": "ipv4", 00:22:52.369 "trsvcid": "$NVMF_PORT", 00:22:52.369 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.369 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.369 "hdgst": ${hdgst:-false}, 00:22:52.369 "ddgst": ${ddgst:-false} 00:22:52.369 }, 00:22:52.369 "method": "bdev_nvme_attach_controller" 00:22:52.369 } 00:22:52.369 EOF 00:22:52.369 )") 00:22:52.369 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.369 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.369 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.369 { 00:22:52.369 "params": { 00:22:52.369 "name": "Nvme$subsystem", 00:22:52.369 "trtype": "$TEST_TRANSPORT", 00:22:52.369 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.369 "adrfam": "ipv4", 00:22:52.369 "trsvcid": "$NVMF_PORT", 00:22:52.369 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.369 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.369 "hdgst": ${hdgst:-false}, 00:22:52.369 "ddgst": ${ddgst:-false} 00:22:52.369 }, 00:22:52.369 "method": "bdev_nvme_attach_controller" 00:22:52.369 } 00:22:52.369 EOF 00:22:52.369 )") 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.628 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.628 { 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme$subsystem", 00:22:52.628 "trtype": "$TEST_TRANSPORT", 00:22:52.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "$NVMF_PORT", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.628 "hdgst": ${hdgst:-false}, 00:22:52.628 "ddgst": ${ddgst:-false} 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 } 00:22:52.628 EOF 00:22:52.628 )") 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.628 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.628 { 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme$subsystem", 00:22:52.628 "trtype": "$TEST_TRANSPORT", 00:22:52.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "$NVMF_PORT", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.628 "hdgst": ${hdgst:-false}, 00:22:52.628 "ddgst": ${ddgst:-false} 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 } 00:22:52.628 EOF 00:22:52.628 )") 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.628 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.628 { 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme$subsystem", 00:22:52.628 "trtype": "$TEST_TRANSPORT", 00:22:52.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "$NVMF_PORT", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.628 "hdgst": ${hdgst:-false}, 00:22:52.628 "ddgst": ${ddgst:-false} 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 } 00:22:52.628 EOF 00:22:52.628 )") 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.628 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.628 { 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme$subsystem", 00:22:52.628 "trtype": "$TEST_TRANSPORT", 00:22:52.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "$NVMF_PORT", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.628 "hdgst": ${hdgst:-false}, 00:22:52.628 "ddgst": ${ddgst:-false} 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 } 00:22:52.628 EOF 00:22:52.628 )") 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.628 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.628 { 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme$subsystem", 00:22:52.628 "trtype": "$TEST_TRANSPORT", 00:22:52.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "$NVMF_PORT", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.628 "hdgst": ${hdgst:-false}, 00:22:52.628 "ddgst": ${ddgst:-false} 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 } 00:22:52.628 EOF 00:22:52.628 )") 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.628 01:58:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.628 { 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme$subsystem", 00:22:52.628 "trtype": "$TEST_TRANSPORT", 00:22:52.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "$NVMF_PORT", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.628 "hdgst": ${hdgst:-false}, 00:22:52.628 "ddgst": ${ddgst:-false} 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 } 00:22:52.628 EOF 00:22:52.628 )") 00:22:52.628 01:58:40 -- nvmf/common.sh@542 -- # cat 00:22:52.628 01:58:40 -- nvmf/common.sh@544 -- # jq . 00:22:52.628 01:58:40 -- nvmf/common.sh@545 -- # IFS=, 00:22:52.628 01:58:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme1", 00:22:52.628 "trtype": "tcp", 00:22:52.628 "traddr": "10.0.0.2", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "4420", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:52.628 "hdgst": false, 00:22:52.628 "ddgst": false 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 },{ 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme2", 00:22:52.628 "trtype": "tcp", 00:22:52.628 "traddr": "10.0.0.2", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "4420", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:52.628 "hdgst": false, 00:22:52.628 "ddgst": false 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 },{ 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme3", 00:22:52.628 "trtype": "tcp", 00:22:52.628 "traddr": "10.0.0.2", 00:22:52.628 "adrfam": "ipv4", 00:22:52.628 "trsvcid": "4420", 00:22:52.628 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:52.628 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:52.628 "hdgst": false, 00:22:52.628 "ddgst": false 00:22:52.628 }, 00:22:52.628 "method": "bdev_nvme_attach_controller" 00:22:52.628 },{ 00:22:52.628 "params": { 00:22:52.628 "name": "Nvme4", 00:22:52.628 "trtype": "tcp", 00:22:52.628 "traddr": "10.0.0.2", 00:22:52.629 "adrfam": "ipv4", 00:22:52.629 "trsvcid": "4420", 00:22:52.629 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:52.629 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:52.629 "hdgst": false, 00:22:52.629 "ddgst": false 00:22:52.629 }, 00:22:52.629 "method": "bdev_nvme_attach_controller" 00:22:52.629 },{ 00:22:52.629 "params": { 00:22:52.629 "name": "Nvme5", 00:22:52.629 "trtype": "tcp", 00:22:52.629 "traddr": "10.0.0.2", 00:22:52.629 "adrfam": "ipv4", 00:22:52.629 "trsvcid": "4420", 00:22:52.629 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:52.629 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:52.629 "hdgst": false, 00:22:52.629 "ddgst": false 00:22:52.629 }, 00:22:52.629 "method": "bdev_nvme_attach_controller" 00:22:52.629 },{ 00:22:52.629 "params": { 00:22:52.629 "name": "Nvme6", 00:22:52.629 "trtype": "tcp", 00:22:52.629 "traddr": "10.0.0.2", 00:22:52.629 "adrfam": "ipv4", 00:22:52.629 "trsvcid": "4420", 00:22:52.629 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:52.629 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:52.629 "hdgst": false, 00:22:52.629 "ddgst": false 00:22:52.629 }, 00:22:52.629 "method": "bdev_nvme_attach_controller" 00:22:52.629 },{ 00:22:52.629 "params": { 00:22:52.629 "name": "Nvme7", 00:22:52.629 "trtype": "tcp", 00:22:52.629 "traddr": "10.0.0.2", 00:22:52.629 "adrfam": "ipv4", 00:22:52.629 "trsvcid": "4420", 00:22:52.629 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:52.629 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:52.629 "hdgst": false, 00:22:52.629 "ddgst": false 00:22:52.629 }, 00:22:52.629 "method": "bdev_nvme_attach_controller" 00:22:52.629 },{ 00:22:52.629 "params": { 00:22:52.629 "name": "Nvme8", 00:22:52.629 "trtype": "tcp", 00:22:52.629 "traddr": "10.0.0.2", 00:22:52.629 "adrfam": "ipv4", 00:22:52.629 "trsvcid": "4420", 00:22:52.629 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:52.629 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:52.629 "hdgst": false, 00:22:52.629 "ddgst": false 00:22:52.629 }, 00:22:52.629 "method": "bdev_nvme_attach_controller" 00:22:52.629 },{ 00:22:52.629 "params": { 00:22:52.629 "name": "Nvme9", 00:22:52.629 "trtype": "tcp", 00:22:52.629 "traddr": "10.0.0.2", 00:22:52.629 "adrfam": "ipv4", 00:22:52.629 "trsvcid": "4420", 00:22:52.629 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:52.629 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:52.629 "hdgst": false, 00:22:52.629 "ddgst": false 00:22:52.629 }, 00:22:52.629 "method": "bdev_nvme_attach_controller" 00:22:52.629 },{ 00:22:52.629 "params": { 00:22:52.629 "name": "Nvme10", 00:22:52.629 "trtype": "tcp", 00:22:52.629 "traddr": "10.0.0.2", 00:22:52.629 "adrfam": "ipv4", 00:22:52.629 "trsvcid": "4420", 00:22:52.629 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:52.629 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:52.629 "hdgst": false, 00:22:52.629 "ddgst": false 00:22:52.629 }, 00:22:52.629 "method": "bdev_nvme_attach_controller" 00:22:52.629 }' 00:22:52.629 [2024-11-19 01:58:40.942987] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:52.629 [2024-11-19 01:58:40.943061] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3510792 ] 00:22:52.629 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.629 [2024-11-19 01:58:41.007354] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:52.629 [2024-11-19 01:58:41.116756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:55.173 Running I/O for 10 seconds... 00:22:55.173 01:58:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:55.173 01:58:43 -- common/autotest_common.sh@862 -- # return 0 00:22:55.173 01:58:43 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:55.173 01:58:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.173 01:58:43 -- common/autotest_common.sh@10 -- # set +x 00:22:55.173 01:58:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.173 01:58:43 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:55.173 01:58:43 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:55.173 01:58:43 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:55.173 01:58:43 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:55.173 01:58:43 -- target/shutdown.sh@57 -- # local ret=1 00:22:55.173 01:58:43 -- target/shutdown.sh@58 -- # local i 00:22:55.173 01:58:43 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:55.173 01:58:43 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:55.173 01:58:43 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:55.173 01:58:43 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:55.173 01:58:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.173 01:58:43 -- common/autotest_common.sh@10 -- # set +x 00:22:55.173 01:58:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.173 01:58:43 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:55.174 01:58:43 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:55.174 01:58:43 -- target/shutdown.sh@64 -- # ret=0 00:22:55.174 01:58:43 -- target/shutdown.sh@65 -- # break 00:22:55.174 01:58:43 -- target/shutdown.sh@69 -- # return 0 00:22:55.174 01:58:43 -- target/shutdown.sh@134 -- # killprocess 3510592 00:22:55.174 01:58:43 -- common/autotest_common.sh@936 -- # '[' -z 3510592 ']' 00:22:55.174 01:58:43 -- common/autotest_common.sh@940 -- # kill -0 3510592 00:22:55.174 01:58:43 -- common/autotest_common.sh@941 -- # uname 00:22:55.174 01:58:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:55.174 01:58:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3510592 00:22:55.174 01:58:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:55.174 01:58:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:55.174 01:58:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3510592' 00:22:55.174 killing process with pid 3510592 00:22:55.174 01:58:43 -- common/autotest_common.sh@955 -- # kill 3510592 00:22:55.174 01:58:43 -- common/autotest_common.sh@960 -- # wait 3510592 00:22:55.174 [2024-11-19 01:58:43.599241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.599993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.600120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d32e0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.174 [2024-11-19 01:58:43.601801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601863] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.175 [2024-11-19 01:58:43.601887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.175 [2024-11-19 01:58:43.601925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601943] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.175 [2024-11-19 01:58:43.601950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-19 01:58:43.601965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.175 the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.601980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with [2024-11-19 01:58:43.601981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsthe state(5) to be set 00:22:55.175 id:0 cdw10:00000000 cdw11:00000000 00:22:55.175 [2024-11-19 01:58:43.602003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with [2024-11-19 01:58:43.602005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:55.175 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.175 [2024-11-19 01:58:43.602018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602021] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.175 [2024-11-19 01:58:43.602030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.175 [2024-11-19 01:58:43.602042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b1bf70 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.602557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5cd0 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605349] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.175 [2024-11-19 01:58:43.605323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.175 [2024-11-19 01:58:43.605604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.605980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3790 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.606818] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.176 [2024-11-19 01:58:43.608878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.608917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.608942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.608956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.608969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.608986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.176 [2024-11-19 01:58:43.609440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609539] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.177 [2024-11-19 01:58:43.609558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.609767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d3c40 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with [2024-11-19 01:58:43.611897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:22:55.177 id:0 cdw10:00000000 cdw11:00000000 00:22:55.177 [2024-11-19 01:58:43.611922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.177 [2024-11-19 01:58:43.611947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611974] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-11-19 01:58:43.611982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:55.177 the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.611997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.612000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.177 [2024-11-19 01:58:43.612009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.177 [2024-11-19 01:58:43.612017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.177 [2024-11-19 01:58:43.612022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce2600 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with [2024-11-19 01:58:43.612112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b1bf70 (9): the state(5) to be set 00:22:55.178 Bad file descriptor 00:22:55.178 [2024-11-19 01:58:43.612130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d40d0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612188] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612224] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612251] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612277] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b47690 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612347] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612384] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612436] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3e1b0 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.612506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612548] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612576] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612603] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.178 [2024-11-19 01:58:43.612616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.178 [2024-11-19 01:58:43.612629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b74590 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613200] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.178 [2024-11-19 01:58:43.613213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.178 [2024-11-19 01:58:43.613445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.613990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.614016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.614039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4580 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.614433] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.179 [2024-11-19 01:58:43.615506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.615995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.179 [2024-11-19 01:58:43.616195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:12[2024-11-19 01:58:43.616208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.179 the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-19 01:58:43.616238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with [2024-11-19 01:58:43.616304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:12the state(5) to be set 00:22:55.180 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with [2024-11-19 01:58:43.616368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128the state(5) to be set 00:22:55.180 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with [2024-11-19 01:58:43.616389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:55.180 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-19 01:58:43.616454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4a30 is same with the state(5) to be set 00:22:55.180 [2024-11-19 01:58:43.616471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.616975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.616991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.617004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.617023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.617040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.617056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.617071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.617086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.617100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.617115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.617129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.617144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.617158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.180 [2024-11-19 01:58:43.617173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.180 [2024-11-19 01:58:43.617186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-19 01:58:43.617928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with [2024-11-19 01:58:43.617959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:55.181 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.617972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.617985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.617997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-19 01:58:43.617998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.618031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with [2024-11-19 01:58:43.618036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:55.181 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.618052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.618065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.618078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 [2024-11-19 01:58:43.618091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.181 [2024-11-19 01:58:43.618103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28672 len:1[2024-11-19 01:58:43.618116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.181 the state(5) to be set 00:22:55.181 [2024-11-19 01:58:43.618130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with [2024-11-19 01:58:43.618131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:55.181 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.182 [2024-11-19 01:58:43.618144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.182 [2024-11-19 01:58:43.618157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.182 [2024-11-19 01:58:43.618169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.182 [2024-11-19 01:58:43.618182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.182 [2024-11-19 01:58:43.618195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with [2024-11-19 01:58:43.618208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:29056 len:12the state(5) to be set 00:22:55.182 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.182 [2024-11-19 01:58:43.618222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.182 [2024-11-19 01:58:43.618238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d6b950 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618334] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d6b950 was disconnected and fr[2024-11-19 01:58:43.618337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with eed. reset controller. 00:22:55.182 the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.618728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d4ec0 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.619989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.620002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.620014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.620026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.620039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.182 [2024-11-19 01:58:43.620074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:55.183 [2024-11-19 01:58:43.620089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cd2150 (9): Bad file descriptor 00:22:55.183 [2024-11-19 01:58:43.620178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.620583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5370 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621324] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.183 [2024-11-19 01:58:43.621357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621686] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.183 [2024-11-19 01:58:43.621698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.183 [2024-11-19 01:58:43.621912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.621927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.621939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.621951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.621970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.621982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.621994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce2600 (9): [2024-11-19 01:58:43.622085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with Bad file descriptor 00:22:55.184 the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622150] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-19 01:58:43.622152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:55.184 the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with [2024-11-19 01:58:43.622226] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsthe state(5) to be set 00:22:55.184 id:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with [2024-11-19 01:58:43.622241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:55.184 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622257] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbd0a0 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b47690 (9): Bad file descriptor 00:22:55.184 [2024-11-19 01:58:43.622318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18d5820 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3e1b0 (9): Bad file descriptor 00:22:55.184 [2024-11-19 01:58:43.622372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b74590 (9): Bad file descriptor 00:22:55.184 [2024-11-19 01:58:43.622423] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622458] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622486] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cd1c70 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622624] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622665] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622710] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.184 [2024-11-19 01:58:43.622723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.622736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccca60 is same with the state(5) to be set 00:22:55.184 [2024-11-19 01:58:43.622990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.184 [2024-11-19 01:58:43.623334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.184 [2024-11-19 01:58:43.623347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.623976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.623994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.185 [2024-11-19 01:58:43.624512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.185 [2024-11-19 01:58:43.624528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-19 01:58:43.624660] nvmf.c:1141:spdk_nvmf_tgt_new_qpair: *ERROR*: No poll groups exist. 00:22:55.186 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.624909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.624923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d60260 is same with the state(5) to be set 00:22:55.186 [2024-11-19 01:58:43.626186] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.186 [2024-11-19 01:58:43.626282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:55.186 [2024-11-19 01:58:43.626575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.186 [2024-11-19 01:58:43.626679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.186 [2024-11-19 01:58:43.626715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b1bf70 with addr=10.0.0.2, port=4420 00:22:55.186 [2024-11-19 01:58:43.626731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b1bf70 is same with the state(5) to be set 00:22:55.186 [2024-11-19 01:58:43.626751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cd2150 (9): Bad file descriptor 00:22:55.186 [2024-11-19 01:58:43.627147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b1bf70 (9): Bad file descriptor 00:22:55.186 [2024-11-19 01:58:43.627172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:55.186 [2024-11-19 01:58:43.627185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:55.186 [2024-11-19 01:58:43.627201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:55.186 [2024-11-19 01:58:43.627323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.186 [2024-11-19 01:58:43.627350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:55.186 [2024-11-19 01:58:43.627364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:55.186 [2024-11-19 01:58:43.627377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:55.186 [2024-11-19 01:58:43.627473] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:55.186 [2024-11-19 01:58:43.627507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.186 [2024-11-19 01:58:43.630674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:55.186 [2024-11-19 01:58:43.630886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.186 [2024-11-19 01:58:43.630990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.186 [2024-11-19 01:58:43.631022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cd2150 with addr=10.0.0.2, port=4420 00:22:55.186 [2024-11-19 01:58:43.631038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cd2150 is same with the state(5) to be set 00:22:55.186 [2024-11-19 01:58:43.631102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cd2150 (9): Bad file descriptor 00:22:55.186 [2024-11-19 01:58:43.631162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:55.186 [2024-11-19 01:58:43.631179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:55.186 [2024-11-19 01:58:43.631193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:55.186 [2024-11-19 01:58:43.631255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.186 [2024-11-19 01:58:43.632134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.186 [2024-11-19 01:58:43.632157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.186 [2024-11-19 01:58:43.632189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.186 [2024-11-19 01:58:43.632215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632228] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:55.186 [2024-11-19 01:58:43.632241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b69490 is same with the state(5) to be set 00:22:55.186 [2024-11-19 01:58:43.632293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbd0a0 (9): Bad file descriptor 00:22:55.186 [2024-11-19 01:58:43.632343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cd1c70 (9): Bad file descriptor 00:22:55.186 [2024-11-19 01:58:43.632373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ccca60 (9): Bad file descriptor 00:22:55.186 [2024-11-19 01:58:43.632506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.186 [2024-11-19 01:58:43.632778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.186 [2024-11-19 01:58:43.632791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.632806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.632820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.632835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.632849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.632864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.632878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.632893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.632906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.632922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.632940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.632963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.632976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.632992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.187 [2024-11-19 01:58:43.633829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.187 [2024-11-19 01:58:43.633843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.633858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.633872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.633887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.633900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.633915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.633929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.633944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.633957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.633979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.633993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.634435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.634449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b0c550 is same with the state(5) to be set 00:22:55.188 [2024-11-19 01:58:43.635720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.635972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.635986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.188 [2024-11-19 01:58:43.636274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.188 [2024-11-19 01:58:43.636288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.636974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.636988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.189 [2024-11-19 01:58:43.637441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.189 [2024-11-19 01:58:43.637454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.637470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.637483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.637499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.637512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.637527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.637540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.637555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.637571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.637587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.637601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.637616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.637628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.637656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca81a0 is same with the state(5) to be set 00:22:55.190 [2024-11-19 01:58:43.638878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.638901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.638922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.638937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.638952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.638965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.638985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.638998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.190 [2024-11-19 01:58:43.639839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.190 [2024-11-19 01:58:43.639853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.639868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.639881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.639897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.639910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.639930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.639944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.639960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.639974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.639989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.640800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.640814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca96f0 is same with the state(5) to be set 00:22:55.191 [2024-11-19 01:58:43.642069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.642093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.642113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.642128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.642144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.191 [2024-11-19 01:58:43.642157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.191 [2024-11-19 01:58:43.642173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.642979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.642992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.192 [2024-11-19 01:58:43.643309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.192 [2024-11-19 01:58:43.643325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.643985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.643999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d72580 is same with the state(5) to be set 00:22:55.193 [2024-11-19 01:58:43.646237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:55.193 [2024-11-19 01:58:43.646270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:55.193 [2024-11-19 01:58:43.646289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:55.193 [2024-11-19 01:58:43.646306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:55.193 [2024-11-19 01:58:43.646433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b69490 (9): Bad file descriptor 00:22:55.193 [2024-11-19 01:58:43.646785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.646893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.646918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce2600 with addr=10.0.0.2, port=4420 00:22:55.193 [2024-11-19 01:58:43.646943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce2600 is same with the state(5) to be set 00:22:55.193 [2024-11-19 01:58:43.647052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.647153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.647179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3e1b0 with addr=10.0.0.2, port=4420 00:22:55.193 [2024-11-19 01:58:43.647194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3e1b0 is same with the state(5) to be set 00:22:55.193 [2024-11-19 01:58:43.647286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.647367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.647397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b47690 with addr=10.0.0.2, port=4420 00:22:55.193 [2024-11-19 01:58:43.647413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b47690 is same with the state(5) to be set 00:22:55.193 [2024-11-19 01:58:43.647486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.647572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.193 [2024-11-19 01:58:43.647595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b74590 with addr=10.0.0.2, port=4420 00:22:55.193 [2024-11-19 01:58:43.647611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b74590 is same with the state(5) to be set 00:22:55.193 [2024-11-19 01:58:43.648482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.193 [2024-11-19 01:58:43.648742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.193 [2024-11-19 01:58:43.648758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.648786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.648815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.648851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.648880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.648909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.648945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.648974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.648987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.194 [2024-11-19 01:58:43.649905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.194 [2024-11-19 01:58:43.649921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.649935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.649955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.649969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.649985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.650432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.650446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d6ce00 is same with the state(5) to be set 00:22:55.195 [2024-11-19 01:58:43.651727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.651976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.651991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.195 [2024-11-19 01:58:43.652394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.195 [2024-11-19 01:58:43.652410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.652984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.652998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.196 [2024-11-19 01:58:43.653434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.196 [2024-11-19 01:58:43.653450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.653463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.653478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.653495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.653511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.653525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.653540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.653553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.653568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.653581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.653597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.653610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.653625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.653653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.653678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d6e3e0 is same with the state(5) to be set 00:22:55.197 [2024-11-19 01:58:43.654882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.654905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.654926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.654942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.654958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.654972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.654987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.197 [2024-11-19 01:58:43.655833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.197 [2024-11-19 01:58:43.655851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.655866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.655880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.655897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.655911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.655927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.655940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.655956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.655970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.655986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.198 [2024-11-19 01:58:43.656819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.198 [2024-11-19 01:58:43.656844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d6f9c0 is same with the state(5) to be set 00:22:55.198 [2024-11-19 01:58:43.658344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:55.198 [2024-11-19 01:58:43.658375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:55.198 [2024-11-19 01:58:43.658395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:55.198 [2024-11-19 01:58:43.658413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:55.198 [2024-11-19 01:58:43.658431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:55.198 [2024-11-19 01:58:43.658506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce2600 (9): Bad file descriptor 00:22:55.198 [2024-11-19 01:58:43.658530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3e1b0 (9): Bad file descriptor 00:22:55.198 [2024-11-19 01:58:43.658549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b47690 (9): Bad file descriptor 00:22:55.198 [2024-11-19 01:58:43.658567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b74590 (9): Bad file descriptor 00:22:55.198 [2024-11-19 01:58:43.658645] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.198 [2024-11-19 01:58:43.658675] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.198 [2024-11-19 01:58:43.658701] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.198 [2024-11-19 01:58:43.658722] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.198 [2024-11-19 01:58:43.658994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.198 [2024-11-19 01:58:43.659104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.198 [2024-11-19 01:58:43.659128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b1bf70 with addr=10.0.0.2, port=4420 00:22:55.199 [2024-11-19 01:58:43.659144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b1bf70 is same with the state(5) to be set 00:22:55.199 [2024-11-19 01:58:43.659229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.659356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.659381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cd2150 with addr=10.0.0.2, port=4420 00:22:55.199 [2024-11-19 01:58:43.659397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cd2150 is same with the state(5) to be set 00:22:55.199 [2024-11-19 01:58:43.659484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.659583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.659607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbd0a0 with addr=10.0.0.2, port=4420 00:22:55.199 [2024-11-19 01:58:43.659622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbd0a0 is same with the state(5) to be set 00:22:55.199 [2024-11-19 01:58:43.659720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.659800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.659823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ccca60 with addr=10.0.0.2, port=4420 00:22:55.199 [2024-11-19 01:58:43.659839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccca60 is same with the state(5) to be set 00:22:55.199 [2024-11-19 01:58:43.659910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.659999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.199 [2024-11-19 01:58:43.660023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cd1c70 with addr=10.0.0.2, port=4420 00:22:55.199 [2024-11-19 01:58:43.660038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cd1c70 is same with the state(5) to be set 00:22:55.199 [2024-11-19 01:58:43.660053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:55.199 [2024-11-19 01:58:43.660066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:55.199 [2024-11-19 01:58:43.660081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:55.199 [2024-11-19 01:58:43.660101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:55.199 [2024-11-19 01:58:43.660115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:55.199 [2024-11-19 01:58:43.660129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:55.199 [2024-11-19 01:58:43.660147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:55.199 [2024-11-19 01:58:43.660160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:55.199 [2024-11-19 01:58:43.660172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:55.199 [2024-11-19 01:58:43.660199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:55.199 [2024-11-19 01:58:43.660223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:55.199 [2024-11-19 01:58:43.660239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:55.199 [2024-11-19 01:58:43.661134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.199 [2024-11-19 01:58:43.661941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.199 [2024-11-19 01:58:43.661955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.661970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.661984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.661999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.662978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.200 [2024-11-19 01:58:43.662993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.200 [2024-11-19 01:58:43.663006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.201 [2024-11-19 01:58:43.663021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.201 [2024-11-19 01:58:43.663039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.201 [2024-11-19 01:58:43.663055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.201 [2024-11-19 01:58:43.663068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.201 [2024-11-19 01:58:43.663083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:55.201 [2024-11-19 01:58:43.663097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:55.201 [2024-11-19 01:58:43.663111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d70fa0 is same with the state(5) to be set 00:22:55.201 [2024-11-19 01:58:43.664826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.664850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.664863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.664875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 task offset: 24320 on job bdev=Nvme5n1 fails 00:22:55.201 00:22:55.201 Latency(us) 00:22:55.201 [2024-11-19T00:58:43.744Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme1n1 ended in about 0.53 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme1n1 : 0.53 307.80 19.24 120.12 0.00 148256.14 87769.69 121945.51 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme2n1 ended in about 0.54 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme2n1 : 0.54 302.40 18.90 118.01 0.00 148796.95 90099.86 120392.06 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme3n1 ended in about 0.55 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme3n1 : 0.55 300.65 18.79 117.33 0.00 147545.85 86216.25 119615.34 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme4n1 ended in about 0.55 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme4n1 : 0.55 298.92 18.68 116.65 0.00 146370.55 81944.27 118838.61 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme5n1 ended in about 0.53 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme5n1 : 0.53 311.45 19.47 121.54 0.00 138064.21 52817.16 118061.89 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme6n1 ended in about 0.56 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme6n1 : 0.56 293.75 18.36 114.64 0.00 144838.39 77283.93 116508.44 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme7n1 ended in about 0.56 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme7n1 : 0.56 292.09 18.26 113.99 0.00 143715.04 71846.87 119615.34 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme8n1 ended in about 0.56 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme8n1 : 0.56 290.45 18.15 113.35 0.00 142492.89 66409.81 122722.23 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme9n1 ended in about 0.57 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme9n1 : 0.57 287.27 17.95 112.10 0.00 142130.93 61361.11 124275.67 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:55.201 [2024-11-19T00:58:43.744Z] Job: Nvme10n1 ended in about 0.55 seconds with error 00:22:55.201 Verification LBA range: start 0x0 length 0x400 00:22:55.201 Nvme10n1 : 0.55 228.34 14.27 115.98 0.00 161664.66 100197.26 142917.03 00:22:55.201 [2024-11-19T00:58:43.744Z] =================================================================================================================== 00:22:55.201 [2024-11-19T00:58:43.744Z] Total : 2913.11 182.07 1163.70 0.00 146128.63 52817.16 142917.03 00:22:55.201 [2024-11-19 01:58:43.691700] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:55.201 [2024-11-19 01:58:43.691780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:55.201 [2024-11-19 01:58:43.691861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b1bf70 (9): Bad file descriptor 00:22:55.201 [2024-11-19 01:58:43.691892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cd2150 (9): Bad file descriptor 00:22:55.201 [2024-11-19 01:58:43.691912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbd0a0 (9): Bad file descriptor 00:22:55.201 [2024-11-19 01:58:43.691930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ccca60 (9): Bad file descriptor 00:22:55.201 [2024-11-19 01:58:43.691949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cd1c70 (9): Bad file descriptor 00:22:55.201 [2024-11-19 01:58:43.692316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.201 [2024-11-19 01:58:43.692420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.201 [2024-11-19 01:58:43.692446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b69490 with addr=10.0.0.2, port=4420 00:22:55.201 [2024-11-19 01:58:43.692465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b69490 is same with the state(5) to be set 00:22:55.201 [2024-11-19 01:58:43.692482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:55.201 [2024-11-19 01:58:43.692495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:55.201 [2024-11-19 01:58:43.692511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:55.201 [2024-11-19 01:58:43.692532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:55.201 [2024-11-19 01:58:43.692547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:55.201 [2024-11-19 01:58:43.692560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:55.201 [2024-11-19 01:58:43.692579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:55.201 [2024-11-19 01:58:43.692594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:55.201 [2024-11-19 01:58:43.692607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:55.201 [2024-11-19 01:58:43.692623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:55.201 [2024-11-19 01:58:43.692653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:55.201 [2024-11-19 01:58:43.692678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:55.201 [2024-11-19 01:58:43.692697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:55.201 [2024-11-19 01:58:43.692721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:55.201 [2024-11-19 01:58:43.692735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:55.201 [2024-11-19 01:58:43.692796] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.201 [2024-11-19 01:58:43.692820] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.201 [2024-11-19 01:58:43.692838] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.201 [2024-11-19 01:58:43.692857] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.201 [2024-11-19 01:58:43.692875] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:55.201 [2024-11-19 01:58:43.693254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.693280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.693293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.693305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.693316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.201 [2024-11-19 01:58:43.693342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b69490 (9): Bad file descriptor 00:22:55.201 [2024-11-19 01:58:43.693419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:55.201 [2024-11-19 01:58:43.693444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:55.201 [2024-11-19 01:58:43.693475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:55.201 [2024-11-19 01:58:43.693490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:55.201 [2024-11-19 01:58:43.693506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:55.201 [2024-11-19 01:58:43.693554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:55.201 [2024-11-19 01:58:43.693577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:55.202 [2024-11-19 01:58:43.693611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.202 [2024-11-19 01:58:43.693738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.693854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.693883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b74590 with addr=10.0.0.2, port=4420 00:22:55.202 [2024-11-19 01:58:43.693900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b74590 is same with the state(5) to be set 00:22:55.202 [2024-11-19 01:58:43.693993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.694092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.694117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b47690 with addr=10.0.0.2, port=4420 00:22:55.202 [2024-11-19 01:58:43.694133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b47690 is same with the state(5) to be set 00:22:55.202 [2024-11-19 01:58:43.694231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.694324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.694351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3e1b0 with addr=10.0.0.2, port=4420 00:22:55.202 [2024-11-19 01:58:43.694384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3e1b0 is same with the state(5) to be set 00:22:55.202 [2024-11-19 01:58:43.694472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.694559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:55.202 [2024-11-19 01:58:43.694584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce2600 with addr=10.0.0.2, port=4420 00:22:55.202 [2024-11-19 01:58:43.694600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce2600 is same with the state(5) to be set 00:22:55.202 [2024-11-19 01:58:43.694619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b74590 (9): Bad file descriptor 00:22:55.202 [2024-11-19 01:58:43.694645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b47690 (9): Bad file descriptor 00:22:55.202 [2024-11-19 01:58:43.694693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3e1b0 (9): Bad file descriptor 00:22:55.202 [2024-11-19 01:58:43.694718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce2600 (9): Bad file descriptor 00:22:55.202 [2024-11-19 01:58:43.694734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:55.202 [2024-11-19 01:58:43.694747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:55.202 [2024-11-19 01:58:43.694760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:55.202 [2024-11-19 01:58:43.694777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:55.202 [2024-11-19 01:58:43.694791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:55.202 [2024-11-19 01:58:43.694803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:55.202 [2024-11-19 01:58:43.694840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.202 [2024-11-19 01:58:43.694857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.202 [2024-11-19 01:58:43.694870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:55.202 [2024-11-19 01:58:43.694882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:55.202 [2024-11-19 01:58:43.694895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:55.202 [2024-11-19 01:58:43.694910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:55.202 [2024-11-19 01:58:43.694924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:55.202 [2024-11-19 01:58:43.694936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:55.202 [2024-11-19 01:58:43.694971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.202 [2024-11-19 01:58:43.694988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.770 01:58:44 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:55.770 01:58:44 -- target/shutdown.sh@138 -- # sleep 1 00:22:56.706 01:58:45 -- target/shutdown.sh@141 -- # kill -9 3510792 00:22:56.706 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3510792) - No such process 00:22:56.706 01:58:45 -- target/shutdown.sh@141 -- # true 00:22:56.706 01:58:45 -- target/shutdown.sh@143 -- # stoptarget 00:22:56.706 01:58:45 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:56.706 01:58:45 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:56.706 01:58:45 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:56.706 01:58:45 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:56.706 01:58:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:56.706 01:58:45 -- nvmf/common.sh@116 -- # sync 00:22:56.706 01:58:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:56.706 01:58:45 -- nvmf/common.sh@119 -- # set +e 00:22:56.706 01:58:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:56.706 01:58:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:56.706 rmmod nvme_tcp 00:22:56.964 rmmod nvme_fabrics 00:22:56.965 rmmod nvme_keyring 00:22:56.965 01:58:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:56.965 01:58:45 -- nvmf/common.sh@123 -- # set -e 00:22:56.965 01:58:45 -- nvmf/common.sh@124 -- # return 0 00:22:56.965 01:58:45 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:56.965 01:58:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:56.965 01:58:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:56.965 01:58:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:56.965 01:58:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:56.965 01:58:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:56.965 01:58:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:56.965 01:58:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:56.965 01:58:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:58.869 01:58:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:58.869 00:22:58.869 real 0m8.228s 00:22:58.869 user 0m21.970s 00:22:58.869 sys 0m1.443s 00:22:58.869 01:58:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:58.869 01:58:47 -- common/autotest_common.sh@10 -- # set +x 00:22:58.869 ************************************ 00:22:58.869 END TEST nvmf_shutdown_tc3 00:22:58.869 ************************************ 00:22:58.869 01:58:47 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:58.869 00:22:58.869 real 0m29.073s 00:22:58.869 user 1m24.498s 00:22:58.869 sys 0m6.176s 00:22:58.869 01:58:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:58.869 01:58:47 -- common/autotest_common.sh@10 -- # set +x 00:22:58.869 ************************************ 00:22:58.869 END TEST nvmf_shutdown 00:22:58.869 ************************************ 00:22:58.869 01:58:47 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:58.869 01:58:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:58.869 01:58:47 -- common/autotest_common.sh@10 -- # set +x 00:22:58.869 01:58:47 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:58.869 01:58:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:58.869 01:58:47 -- common/autotest_common.sh@10 -- # set +x 00:22:58.869 01:58:47 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:58.869 01:58:47 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:58.869 01:58:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:58.869 01:58:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:58.869 01:58:47 -- common/autotest_common.sh@10 -- # set +x 00:22:58.869 ************************************ 00:22:58.869 START TEST nvmf_multicontroller 00:22:58.869 ************************************ 00:22:58.869 01:58:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:59.128 * Looking for test storage... 00:22:59.128 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:59.128 01:58:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:59.128 01:58:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:59.128 01:58:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:59.128 01:58:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:59.128 01:58:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:59.128 01:58:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:59.128 01:58:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:59.128 01:58:47 -- scripts/common.sh@335 -- # IFS=.-: 00:22:59.128 01:58:47 -- scripts/common.sh@335 -- # read -ra ver1 00:22:59.128 01:58:47 -- scripts/common.sh@336 -- # IFS=.-: 00:22:59.128 01:58:47 -- scripts/common.sh@336 -- # read -ra ver2 00:22:59.128 01:58:47 -- scripts/common.sh@337 -- # local 'op=<' 00:22:59.128 01:58:47 -- scripts/common.sh@339 -- # ver1_l=2 00:22:59.128 01:58:47 -- scripts/common.sh@340 -- # ver2_l=1 00:22:59.128 01:58:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:59.128 01:58:47 -- scripts/common.sh@343 -- # case "$op" in 00:22:59.128 01:58:47 -- scripts/common.sh@344 -- # : 1 00:22:59.128 01:58:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:59.128 01:58:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:59.128 01:58:47 -- scripts/common.sh@364 -- # decimal 1 00:22:59.128 01:58:47 -- scripts/common.sh@352 -- # local d=1 00:22:59.128 01:58:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:59.128 01:58:47 -- scripts/common.sh@354 -- # echo 1 00:22:59.128 01:58:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:59.128 01:58:47 -- scripts/common.sh@365 -- # decimal 2 00:22:59.128 01:58:47 -- scripts/common.sh@352 -- # local d=2 00:22:59.128 01:58:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:59.128 01:58:47 -- scripts/common.sh@354 -- # echo 2 00:22:59.128 01:58:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:59.128 01:58:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:59.128 01:58:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:59.128 01:58:47 -- scripts/common.sh@367 -- # return 0 00:22:59.128 01:58:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:59.128 01:58:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:59.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:59.128 --rc genhtml_branch_coverage=1 00:22:59.128 --rc genhtml_function_coverage=1 00:22:59.128 --rc genhtml_legend=1 00:22:59.128 --rc geninfo_all_blocks=1 00:22:59.128 --rc geninfo_unexecuted_blocks=1 00:22:59.128 00:22:59.128 ' 00:22:59.128 01:58:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:59.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:59.128 --rc genhtml_branch_coverage=1 00:22:59.128 --rc genhtml_function_coverage=1 00:22:59.128 --rc genhtml_legend=1 00:22:59.128 --rc geninfo_all_blocks=1 00:22:59.128 --rc geninfo_unexecuted_blocks=1 00:22:59.128 00:22:59.128 ' 00:22:59.128 01:58:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:59.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:59.128 --rc genhtml_branch_coverage=1 00:22:59.128 --rc genhtml_function_coverage=1 00:22:59.128 --rc genhtml_legend=1 00:22:59.128 --rc geninfo_all_blocks=1 00:22:59.128 --rc geninfo_unexecuted_blocks=1 00:22:59.128 00:22:59.128 ' 00:22:59.128 01:58:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:59.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:59.128 --rc genhtml_branch_coverage=1 00:22:59.128 --rc genhtml_function_coverage=1 00:22:59.128 --rc genhtml_legend=1 00:22:59.128 --rc geninfo_all_blocks=1 00:22:59.128 --rc geninfo_unexecuted_blocks=1 00:22:59.128 00:22:59.128 ' 00:22:59.128 01:58:47 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:59.128 01:58:47 -- nvmf/common.sh@7 -- # uname -s 00:22:59.128 01:58:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:59.128 01:58:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:59.128 01:58:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:59.128 01:58:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:59.128 01:58:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:59.128 01:58:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:59.128 01:58:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:59.128 01:58:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:59.128 01:58:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:59.128 01:58:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:59.128 01:58:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:59.128 01:58:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:59.128 01:58:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:59.128 01:58:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:59.128 01:58:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:59.128 01:58:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:59.128 01:58:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:59.128 01:58:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:59.128 01:58:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:59.128 01:58:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:59.128 01:58:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:59.129 01:58:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:59.129 01:58:47 -- paths/export.sh@5 -- # export PATH 00:22:59.129 01:58:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:59.129 01:58:47 -- nvmf/common.sh@46 -- # : 0 00:22:59.129 01:58:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:59.129 01:58:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:59.129 01:58:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:59.129 01:58:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:59.129 01:58:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:59.129 01:58:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:59.129 01:58:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:59.129 01:58:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:59.129 01:58:47 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:59.129 01:58:47 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:59.129 01:58:47 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:59.129 01:58:47 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:59.129 01:58:47 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:59.129 01:58:47 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:59.129 01:58:47 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:59.129 01:58:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:59.129 01:58:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:59.129 01:58:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:59.129 01:58:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:59.129 01:58:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:59.129 01:58:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:59.129 01:58:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:59.129 01:58:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:59.129 01:58:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:59.129 01:58:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:59.129 01:58:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:59.129 01:58:47 -- common/autotest_common.sh@10 -- # set +x 00:23:01.704 01:58:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:01.704 01:58:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:01.704 01:58:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:01.704 01:58:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:01.704 01:58:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:01.704 01:58:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:01.704 01:58:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:01.704 01:58:49 -- nvmf/common.sh@294 -- # net_devs=() 00:23:01.704 01:58:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:01.704 01:58:49 -- nvmf/common.sh@295 -- # e810=() 00:23:01.704 01:58:49 -- nvmf/common.sh@295 -- # local -ga e810 00:23:01.704 01:58:49 -- nvmf/common.sh@296 -- # x722=() 00:23:01.704 01:58:49 -- nvmf/common.sh@296 -- # local -ga x722 00:23:01.704 01:58:49 -- nvmf/common.sh@297 -- # mlx=() 00:23:01.704 01:58:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:01.704 01:58:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:01.704 01:58:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:01.705 01:58:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:01.705 01:58:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:01.705 01:58:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:01.705 01:58:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:01.705 01:58:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:01.705 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:01.705 01:58:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:01.705 01:58:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:01.705 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:01.705 01:58:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:01.705 01:58:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:01.705 01:58:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:01.705 01:58:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:01.705 01:58:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:01.705 01:58:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:01.705 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:01.705 01:58:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:01.705 01:58:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:01.705 01:58:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:01.705 01:58:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:01.705 01:58:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:01.705 01:58:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:01.705 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:01.705 01:58:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:01.705 01:58:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:01.705 01:58:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:01.705 01:58:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:01.705 01:58:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:01.705 01:58:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:01.705 01:58:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:01.705 01:58:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:01.705 01:58:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:01.705 01:58:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:01.705 01:58:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:01.705 01:58:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:01.705 01:58:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:01.705 01:58:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:01.705 01:58:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:01.705 01:58:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:01.705 01:58:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:01.705 01:58:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:01.705 01:58:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:01.705 01:58:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:01.705 01:58:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:01.705 01:58:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:01.705 01:58:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:01.705 01:58:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:01.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:01.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:23:01.705 00:23:01.705 --- 10.0.0.2 ping statistics --- 00:23:01.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:01.705 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:23:01.705 01:58:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:01.705 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:01.705 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:23:01.705 00:23:01.705 --- 10.0.0.1 ping statistics --- 00:23:01.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:01.705 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:23:01.705 01:58:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:01.705 01:58:49 -- nvmf/common.sh@410 -- # return 0 00:23:01.705 01:58:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:01.705 01:58:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:01.705 01:58:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:01.705 01:58:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:01.705 01:58:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:01.705 01:58:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:01.705 01:58:49 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:01.705 01:58:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:01.705 01:58:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:01.705 01:58:49 -- common/autotest_common.sh@10 -- # set +x 00:23:01.705 01:58:49 -- nvmf/common.sh@469 -- # nvmfpid=3513346 00:23:01.705 01:58:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:01.705 01:58:49 -- nvmf/common.sh@470 -- # waitforlisten 3513346 00:23:01.705 01:58:49 -- common/autotest_common.sh@829 -- # '[' -z 3513346 ']' 00:23:01.705 01:58:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:01.705 01:58:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:01.705 01:58:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:01.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:01.705 01:58:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:01.705 01:58:49 -- common/autotest_common.sh@10 -- # set +x 00:23:01.705 [2024-11-19 01:58:49.864966] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:01.705 [2024-11-19 01:58:49.865037] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:01.705 EAL: No free 2048 kB hugepages reported on node 1 00:23:01.705 [2024-11-19 01:58:49.935213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:01.705 [2024-11-19 01:58:50.056183] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:01.705 [2024-11-19 01:58:50.056342] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:01.705 [2024-11-19 01:58:50.056360] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:01.705 [2024-11-19 01:58:50.056382] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:01.705 [2024-11-19 01:58:50.056550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:01.705 [2024-11-19 01:58:50.056578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:01.705 [2024-11-19 01:58:50.056582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:02.641 01:58:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:02.641 01:58:50 -- common/autotest_common.sh@862 -- # return 0 00:23:02.641 01:58:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:02.641 01:58:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 01:58:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:02.641 01:58:50 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 [2024-11-19 01:58:50.878373] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 Malloc0 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 [2024-11-19 01:58:50.936602] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 [2024-11-19 01:58:50.944491] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 Malloc1 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 01:58:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:50 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:02.641 01:58:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:02.641 01:58:50 -- common/autotest_common.sh@10 -- # set +x 00:23:02.641 01:58:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:02.641 01:58:51 -- host/multicontroller.sh@44 -- # bdevperf_pid=3513500 00:23:02.641 01:58:51 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:02.641 01:58:51 -- host/multicontroller.sh@47 -- # waitforlisten 3513500 /var/tmp/bdevperf.sock 00:23:02.641 01:58:51 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:02.641 01:58:51 -- common/autotest_common.sh@829 -- # '[' -z 3513500 ']' 00:23:02.641 01:58:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:02.641 01:58:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:02.641 01:58:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:02.641 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:02.641 01:58:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:02.641 01:58:51 -- common/autotest_common.sh@10 -- # set +x 00:23:03.575 01:58:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:03.575 01:58:52 -- common/autotest_common.sh@862 -- # return 0 00:23:03.575 01:58:52 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:03.575 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.575 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:03.575 NVMe0n1 00:23:03.575 01:58:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.575 01:58:52 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:03.575 01:58:52 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:03.575 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.575 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:03.833 01:58:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.833 1 00:23:03.833 01:58:52 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:03.833 01:58:52 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.833 01:58:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:03.833 01:58:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.833 01:58:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:03.833 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.833 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:03.833 request: 00:23:03.833 { 00:23:03.833 "name": "NVMe0", 00:23:03.833 "trtype": "tcp", 00:23:03.833 "traddr": "10.0.0.2", 00:23:03.833 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:03.833 "hostaddr": "10.0.0.2", 00:23:03.833 "hostsvcid": "60000", 00:23:03.833 "adrfam": "ipv4", 00:23:03.833 "trsvcid": "4420", 00:23:03.833 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.833 "method": "bdev_nvme_attach_controller", 00:23:03.833 "req_id": 1 00:23:03.833 } 00:23:03.833 Got JSON-RPC error response 00:23:03.833 response: 00:23:03.833 { 00:23:03.833 "code": -114, 00:23:03.833 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:03.833 } 00:23:03.833 01:58:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.833 01:58:52 -- common/autotest_common.sh@653 -- # es=1 00:23:03.833 01:58:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.833 01:58:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.833 01:58:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.833 01:58:52 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:03.833 01:58:52 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.833 01:58:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:03.833 01:58:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.833 01:58:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:03.833 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.833 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:03.833 request: 00:23:03.833 { 00:23:03.833 "name": "NVMe0", 00:23:03.833 "trtype": "tcp", 00:23:03.833 "traddr": "10.0.0.2", 00:23:03.833 "hostaddr": "10.0.0.2", 00:23:03.833 "hostsvcid": "60000", 00:23:03.833 "adrfam": "ipv4", 00:23:03.833 "trsvcid": "4420", 00:23:03.833 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:03.833 "method": "bdev_nvme_attach_controller", 00:23:03.833 "req_id": 1 00:23:03.833 } 00:23:03.833 Got JSON-RPC error response 00:23:03.833 response: 00:23:03.833 { 00:23:03.833 "code": -114, 00:23:03.833 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:03.833 } 00:23:03.833 01:58:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.833 01:58:52 -- common/autotest_common.sh@653 -- # es=1 00:23:03.833 01:58:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.833 01:58:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.833 01:58:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.833 01:58:52 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:03.833 01:58:52 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.833 01:58:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:03.833 01:58:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.833 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.833 01:58:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:03.833 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.833 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:03.833 request: 00:23:03.833 { 00:23:03.833 "name": "NVMe0", 00:23:03.833 "trtype": "tcp", 00:23:03.833 "traddr": "10.0.0.2", 00:23:03.833 "hostaddr": "10.0.0.2", 00:23:03.833 "hostsvcid": "60000", 00:23:03.833 "adrfam": "ipv4", 00:23:03.833 "trsvcid": "4420", 00:23:03.834 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.834 "multipath": "disable", 00:23:03.834 "method": "bdev_nvme_attach_controller", 00:23:03.834 "req_id": 1 00:23:03.834 } 00:23:03.834 Got JSON-RPC error response 00:23:03.834 response: 00:23:03.834 { 00:23:03.834 "code": -114, 00:23:03.834 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:03.834 } 00:23:03.834 01:58:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.834 01:58:52 -- common/autotest_common.sh@653 -- # es=1 00:23:03.834 01:58:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.834 01:58:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.834 01:58:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.834 01:58:52 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:03.834 01:58:52 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.834 01:58:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:03.834 01:58:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.834 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.834 01:58:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.834 01:58:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.834 01:58:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:03.834 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.834 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:03.834 request: 00:23:03.834 { 00:23:03.834 "name": "NVMe0", 00:23:03.834 "trtype": "tcp", 00:23:03.834 "traddr": "10.0.0.2", 00:23:03.834 "hostaddr": "10.0.0.2", 00:23:03.834 "hostsvcid": "60000", 00:23:03.834 "adrfam": "ipv4", 00:23:03.834 "trsvcid": "4420", 00:23:03.834 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.834 "multipath": "failover", 00:23:03.834 "method": "bdev_nvme_attach_controller", 00:23:03.834 "req_id": 1 00:23:03.834 } 00:23:03.834 Got JSON-RPC error response 00:23:03.834 response: 00:23:03.834 { 00:23:03.834 "code": -114, 00:23:03.834 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:03.834 } 00:23:03.834 01:58:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.834 01:58:52 -- common/autotest_common.sh@653 -- # es=1 00:23:03.834 01:58:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.834 01:58:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.834 01:58:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.834 01:58:52 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:03.834 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.834 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:03.834 00:23:03.834 01:58:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.092 01:58:52 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:04.092 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.092 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:04.092 01:58:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.092 01:58:52 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:04.092 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.092 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:04.092 00:23:04.092 01:58:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.092 01:58:52 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:04.092 01:58:52 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:04.092 01:58:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.092 01:58:52 -- common/autotest_common.sh@10 -- # set +x 00:23:04.092 01:58:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.092 01:58:52 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:04.092 01:58:52 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:05.466 0 00:23:05.467 01:58:53 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:05.467 01:58:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.467 01:58:53 -- common/autotest_common.sh@10 -- # set +x 00:23:05.467 01:58:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.467 01:58:53 -- host/multicontroller.sh@100 -- # killprocess 3513500 00:23:05.467 01:58:53 -- common/autotest_common.sh@936 -- # '[' -z 3513500 ']' 00:23:05.467 01:58:53 -- common/autotest_common.sh@940 -- # kill -0 3513500 00:23:05.467 01:58:53 -- common/autotest_common.sh@941 -- # uname 00:23:05.467 01:58:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:05.467 01:58:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3513500 00:23:05.467 01:58:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:05.467 01:58:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:05.467 01:58:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3513500' 00:23:05.467 killing process with pid 3513500 00:23:05.467 01:58:53 -- common/autotest_common.sh@955 -- # kill 3513500 00:23:05.467 01:58:53 -- common/autotest_common.sh@960 -- # wait 3513500 00:23:05.725 01:58:54 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:05.725 01:58:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.725 01:58:54 -- common/autotest_common.sh@10 -- # set +x 00:23:05.725 01:58:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.725 01:58:54 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:05.725 01:58:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.725 01:58:54 -- common/autotest_common.sh@10 -- # set +x 00:23:05.725 01:58:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.725 01:58:54 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:05.725 01:58:54 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:05.725 01:58:54 -- common/autotest_common.sh@1607 -- # read -r file 00:23:05.725 01:58:54 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:05.725 01:58:54 -- common/autotest_common.sh@1606 -- # sort -u 00:23:05.725 01:58:54 -- common/autotest_common.sh@1608 -- # cat 00:23:05.725 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:05.725 [2024-11-19 01:58:51.044163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:05.725 [2024-11-19 01:58:51.044245] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3513500 ] 00:23:05.725 EAL: No free 2048 kB hugepages reported on node 1 00:23:05.725 [2024-11-19 01:58:51.102717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:05.725 [2024-11-19 01:58:51.210222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:05.725 [2024-11-19 01:58:52.607652] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 2d1a5750-8f39-476d-bd5b-bb51e06471ca already exists 00:23:05.725 [2024-11-19 01:58:52.607695] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:2d1a5750-8f39-476d-bd5b-bb51e06471ca alias for bdev NVMe1n1 00:23:05.725 [2024-11-19 01:58:52.607730] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:05.725 Running I/O for 1 seconds... 00:23:05.725 00:23:05.725 Latency(us) 00:23:05.725 [2024-11-19T00:58:54.268Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:05.725 [2024-11-19T00:58:54.268Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:05.725 NVMe0n1 : 1.01 19437.33 75.93 0.00 0.00 6566.96 2803.48 16505.36 00:23:05.725 [2024-11-19T00:58:54.268Z] =================================================================================================================== 00:23:05.725 [2024-11-19T00:58:54.268Z] Total : 19437.33 75.93 0.00 0.00 6566.96 2803.48 16505.36 00:23:05.725 Received shutdown signal, test time was about 1.000000 seconds 00:23:05.725 00:23:05.725 Latency(us) 00:23:05.725 [2024-11-19T00:58:54.268Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:05.725 [2024-11-19T00:58:54.268Z] =================================================================================================================== 00:23:05.725 [2024-11-19T00:58:54.268Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:05.725 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:05.725 01:58:54 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:05.725 01:58:54 -- common/autotest_common.sh@1607 -- # read -r file 00:23:05.725 01:58:54 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:05.725 01:58:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:05.725 01:58:54 -- nvmf/common.sh@116 -- # sync 00:23:05.725 01:58:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:05.725 01:58:54 -- nvmf/common.sh@119 -- # set +e 00:23:05.725 01:58:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:05.725 01:58:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:05.725 rmmod nvme_tcp 00:23:05.725 rmmod nvme_fabrics 00:23:05.725 rmmod nvme_keyring 00:23:05.725 01:58:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:05.725 01:58:54 -- nvmf/common.sh@123 -- # set -e 00:23:05.725 01:58:54 -- nvmf/common.sh@124 -- # return 0 00:23:05.725 01:58:54 -- nvmf/common.sh@477 -- # '[' -n 3513346 ']' 00:23:05.725 01:58:54 -- nvmf/common.sh@478 -- # killprocess 3513346 00:23:05.725 01:58:54 -- common/autotest_common.sh@936 -- # '[' -z 3513346 ']' 00:23:05.725 01:58:54 -- common/autotest_common.sh@940 -- # kill -0 3513346 00:23:05.725 01:58:54 -- common/autotest_common.sh@941 -- # uname 00:23:05.725 01:58:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:05.725 01:58:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3513346 00:23:05.725 01:58:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:05.725 01:58:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:05.725 01:58:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3513346' 00:23:05.725 killing process with pid 3513346 00:23:05.725 01:58:54 -- common/autotest_common.sh@955 -- # kill 3513346 00:23:05.725 01:58:54 -- common/autotest_common.sh@960 -- # wait 3513346 00:23:06.293 01:58:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:06.293 01:58:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:06.293 01:58:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:06.293 01:58:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:06.293 01:58:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:06.293 01:58:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:06.293 01:58:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:06.293 01:58:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.198 01:58:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:08.198 00:23:08.198 real 0m9.191s 00:23:08.198 user 0m17.725s 00:23:08.198 sys 0m2.448s 00:23:08.198 01:58:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:08.198 01:58:56 -- common/autotest_common.sh@10 -- # set +x 00:23:08.198 ************************************ 00:23:08.198 END TEST nvmf_multicontroller 00:23:08.198 ************************************ 00:23:08.198 01:58:56 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:08.198 01:58:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:08.198 01:58:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:08.198 01:58:56 -- common/autotest_common.sh@10 -- # set +x 00:23:08.198 ************************************ 00:23:08.198 START TEST nvmf_aer 00:23:08.198 ************************************ 00:23:08.198 01:58:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:08.198 * Looking for test storage... 00:23:08.198 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:08.198 01:58:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:08.198 01:58:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:08.198 01:58:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:08.456 01:58:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:08.456 01:58:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:08.456 01:58:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:08.456 01:58:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:08.456 01:58:56 -- scripts/common.sh@335 -- # IFS=.-: 00:23:08.456 01:58:56 -- scripts/common.sh@335 -- # read -ra ver1 00:23:08.456 01:58:56 -- scripts/common.sh@336 -- # IFS=.-: 00:23:08.456 01:58:56 -- scripts/common.sh@336 -- # read -ra ver2 00:23:08.456 01:58:56 -- scripts/common.sh@337 -- # local 'op=<' 00:23:08.456 01:58:56 -- scripts/common.sh@339 -- # ver1_l=2 00:23:08.456 01:58:56 -- scripts/common.sh@340 -- # ver2_l=1 00:23:08.456 01:58:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:08.456 01:58:56 -- scripts/common.sh@343 -- # case "$op" in 00:23:08.457 01:58:56 -- scripts/common.sh@344 -- # : 1 00:23:08.457 01:58:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:08.457 01:58:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:08.457 01:58:56 -- scripts/common.sh@364 -- # decimal 1 00:23:08.457 01:58:56 -- scripts/common.sh@352 -- # local d=1 00:23:08.457 01:58:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:08.457 01:58:56 -- scripts/common.sh@354 -- # echo 1 00:23:08.457 01:58:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:08.457 01:58:56 -- scripts/common.sh@365 -- # decimal 2 00:23:08.457 01:58:56 -- scripts/common.sh@352 -- # local d=2 00:23:08.457 01:58:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:08.457 01:58:56 -- scripts/common.sh@354 -- # echo 2 00:23:08.457 01:58:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:08.457 01:58:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:08.457 01:58:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:08.457 01:58:56 -- scripts/common.sh@367 -- # return 0 00:23:08.457 01:58:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:08.457 01:58:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:08.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.457 --rc genhtml_branch_coverage=1 00:23:08.457 --rc genhtml_function_coverage=1 00:23:08.457 --rc genhtml_legend=1 00:23:08.457 --rc geninfo_all_blocks=1 00:23:08.457 --rc geninfo_unexecuted_blocks=1 00:23:08.457 00:23:08.457 ' 00:23:08.457 01:58:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:08.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.457 --rc genhtml_branch_coverage=1 00:23:08.457 --rc genhtml_function_coverage=1 00:23:08.457 --rc genhtml_legend=1 00:23:08.457 --rc geninfo_all_blocks=1 00:23:08.457 --rc geninfo_unexecuted_blocks=1 00:23:08.457 00:23:08.457 ' 00:23:08.457 01:58:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:08.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.457 --rc genhtml_branch_coverage=1 00:23:08.457 --rc genhtml_function_coverage=1 00:23:08.457 --rc genhtml_legend=1 00:23:08.457 --rc geninfo_all_blocks=1 00:23:08.457 --rc geninfo_unexecuted_blocks=1 00:23:08.457 00:23:08.457 ' 00:23:08.457 01:58:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:08.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.457 --rc genhtml_branch_coverage=1 00:23:08.457 --rc genhtml_function_coverage=1 00:23:08.457 --rc genhtml_legend=1 00:23:08.457 --rc geninfo_all_blocks=1 00:23:08.457 --rc geninfo_unexecuted_blocks=1 00:23:08.457 00:23:08.457 ' 00:23:08.457 01:58:56 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:08.457 01:58:56 -- nvmf/common.sh@7 -- # uname -s 00:23:08.457 01:58:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:08.457 01:58:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:08.457 01:58:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:08.457 01:58:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:08.457 01:58:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:08.457 01:58:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:08.457 01:58:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:08.457 01:58:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:08.457 01:58:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:08.457 01:58:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:08.457 01:58:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.457 01:58:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.457 01:58:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:08.457 01:58:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:08.457 01:58:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:08.457 01:58:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:08.457 01:58:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:08.457 01:58:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:08.457 01:58:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:08.457 01:58:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.457 01:58:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.457 01:58:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.457 01:58:56 -- paths/export.sh@5 -- # export PATH 00:23:08.457 01:58:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.457 01:58:56 -- nvmf/common.sh@46 -- # : 0 00:23:08.457 01:58:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:08.457 01:58:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:08.457 01:58:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:08.457 01:58:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:08.457 01:58:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:08.457 01:58:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:08.457 01:58:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:08.457 01:58:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:08.457 01:58:56 -- host/aer.sh@11 -- # nvmftestinit 00:23:08.457 01:58:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:08.457 01:58:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:08.457 01:58:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:08.457 01:58:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:08.457 01:58:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:08.457 01:58:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.457 01:58:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.457 01:58:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.457 01:58:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:08.457 01:58:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:08.457 01:58:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:08.457 01:58:56 -- common/autotest_common.sh@10 -- # set +x 00:23:10.359 01:58:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:10.359 01:58:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:10.359 01:58:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:10.359 01:58:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:10.359 01:58:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:10.359 01:58:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:10.359 01:58:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:10.359 01:58:58 -- nvmf/common.sh@294 -- # net_devs=() 00:23:10.359 01:58:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:10.359 01:58:58 -- nvmf/common.sh@295 -- # e810=() 00:23:10.359 01:58:58 -- nvmf/common.sh@295 -- # local -ga e810 00:23:10.359 01:58:58 -- nvmf/common.sh@296 -- # x722=() 00:23:10.359 01:58:58 -- nvmf/common.sh@296 -- # local -ga x722 00:23:10.359 01:58:58 -- nvmf/common.sh@297 -- # mlx=() 00:23:10.359 01:58:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:10.359 01:58:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:10.359 01:58:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:10.359 01:58:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:10.359 01:58:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:10.359 01:58:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.359 01:58:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:10.359 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:10.359 01:58:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.359 01:58:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:10.359 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:10.359 01:58:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:10.359 01:58:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.359 01:58:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.359 01:58:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.359 01:58:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.359 01:58:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:10.359 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:10.359 01:58:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.359 01:58:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.359 01:58:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.359 01:58:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.359 01:58:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.359 01:58:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:10.359 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:10.359 01:58:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.359 01:58:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:10.359 01:58:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:10.359 01:58:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:10.359 01:58:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:10.359 01:58:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:10.359 01:58:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:10.359 01:58:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:10.359 01:58:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:10.359 01:58:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:10.359 01:58:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:10.359 01:58:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:10.359 01:58:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:10.359 01:58:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:10.359 01:58:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:10.359 01:58:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:10.360 01:58:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:10.360 01:58:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:10.360 01:58:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:10.360 01:58:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:10.360 01:58:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:10.360 01:58:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:10.360 01:58:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:10.360 01:58:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:10.360 01:58:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:10.360 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:10.360 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:23:10.360 00:23:10.360 --- 10.0.0.2 ping statistics --- 00:23:10.360 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.360 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:23:10.360 01:58:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:10.618 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:10.618 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:23:10.618 00:23:10.618 --- 10.0.0.1 ping statistics --- 00:23:10.618 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.618 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:23:10.618 01:58:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:10.618 01:58:58 -- nvmf/common.sh@410 -- # return 0 00:23:10.618 01:58:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:10.618 01:58:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:10.618 01:58:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:10.618 01:58:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:10.618 01:58:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:10.618 01:58:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:10.618 01:58:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:10.618 01:58:58 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:10.618 01:58:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:10.618 01:58:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:10.618 01:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:10.618 01:58:58 -- nvmf/common.sh@469 -- # nvmfpid=3515876 00:23:10.618 01:58:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:10.618 01:58:58 -- nvmf/common.sh@470 -- # waitforlisten 3515876 00:23:10.618 01:58:58 -- common/autotest_common.sh@829 -- # '[' -z 3515876 ']' 00:23:10.618 01:58:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:10.618 01:58:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:10.618 01:58:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:10.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:10.618 01:58:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:10.618 01:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:10.618 [2024-11-19 01:58:58.976217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.618 [2024-11-19 01:58:58.976287] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:10.618 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.618 [2024-11-19 01:58:59.046380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:10.876 [2024-11-19 01:58:59.166569] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:10.876 [2024-11-19 01:58:59.166745] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:10.876 [2024-11-19 01:58:59.166767] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:10.876 [2024-11-19 01:58:59.166781] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:10.876 [2024-11-19 01:58:59.166847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:10.876 [2024-11-19 01:58:59.166902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:10.876 [2024-11-19 01:58:59.166878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:10.876 [2024-11-19 01:58:59.166905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:11.808 01:59:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:11.808 01:59:00 -- common/autotest_common.sh@862 -- # return 0 00:23:11.808 01:59:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:11.808 01:59:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:11.808 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:11.808 01:59:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:11.808 01:59:00 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:11.808 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.808 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:11.808 [2024-11-19 01:59:00.080561] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:11.808 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.808 01:59:00 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:11.808 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.808 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:11.808 Malloc0 00:23:11.808 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.808 01:59:00 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:11.808 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.808 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:11.808 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.808 01:59:00 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:11.808 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.808 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:11.808 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.808 01:59:00 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:11.808 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.808 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:11.808 [2024-11-19 01:59:00.132413] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:11.808 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.808 01:59:00 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:11.808 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.808 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:11.808 [2024-11-19 01:59:00.140169] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:11.808 [ 00:23:11.808 { 00:23:11.808 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:11.808 "subtype": "Discovery", 00:23:11.808 "listen_addresses": [], 00:23:11.808 "allow_any_host": true, 00:23:11.808 "hosts": [] 00:23:11.808 }, 00:23:11.808 { 00:23:11.808 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:11.808 "subtype": "NVMe", 00:23:11.808 "listen_addresses": [ 00:23:11.808 { 00:23:11.808 "transport": "TCP", 00:23:11.808 "trtype": "TCP", 00:23:11.808 "adrfam": "IPv4", 00:23:11.808 "traddr": "10.0.0.2", 00:23:11.808 "trsvcid": "4420" 00:23:11.808 } 00:23:11.808 ], 00:23:11.808 "allow_any_host": true, 00:23:11.808 "hosts": [], 00:23:11.808 "serial_number": "SPDK00000000000001", 00:23:11.808 "model_number": "SPDK bdev Controller", 00:23:11.808 "max_namespaces": 2, 00:23:11.808 "min_cntlid": 1, 00:23:11.808 "max_cntlid": 65519, 00:23:11.808 "namespaces": [ 00:23:11.808 { 00:23:11.808 "nsid": 1, 00:23:11.808 "bdev_name": "Malloc0", 00:23:11.808 "name": "Malloc0", 00:23:11.808 "nguid": "76486C6D24614380A0A0E3CD93413EDB", 00:23:11.808 "uuid": "76486c6d-2461-4380-a0a0-e3cd93413edb" 00:23:11.808 } 00:23:11.808 ] 00:23:11.808 } 00:23:11.808 ] 00:23:11.808 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.808 01:59:00 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:11.808 01:59:00 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:11.808 01:59:00 -- host/aer.sh@33 -- # aerpid=3516036 00:23:11.808 01:59:00 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:11.808 01:59:00 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:11.808 01:59:00 -- common/autotest_common.sh@1254 -- # local i=0 00:23:11.808 01:59:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:11.808 01:59:00 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:11.808 01:59:00 -- common/autotest_common.sh@1257 -- # i=1 00:23:11.808 01:59:00 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:11.808 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.808 01:59:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:11.808 01:59:00 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:11.808 01:59:00 -- common/autotest_common.sh@1257 -- # i=2 00:23:11.808 01:59:00 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:12.066 01:59:00 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.066 01:59:00 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.066 01:59:00 -- common/autotest_common.sh@1265 -- # return 0 00:23:12.066 01:59:00 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:12.066 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.066 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:12.066 Malloc1 00:23:12.066 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.066 01:59:00 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:12.066 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.067 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:12.067 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.067 01:59:00 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:12.067 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.067 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:12.067 Asynchronous Event Request test 00:23:12.067 Attaching to 10.0.0.2 00:23:12.067 Attached to 10.0.0.2 00:23:12.067 Registering asynchronous event callbacks... 00:23:12.067 Starting namespace attribute notice tests for all controllers... 00:23:12.067 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:12.067 aer_cb - Changed Namespace 00:23:12.067 Cleaning up... 00:23:12.067 [ 00:23:12.067 { 00:23:12.067 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:12.067 "subtype": "Discovery", 00:23:12.067 "listen_addresses": [], 00:23:12.067 "allow_any_host": true, 00:23:12.067 "hosts": [] 00:23:12.067 }, 00:23:12.067 { 00:23:12.067 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:12.067 "subtype": "NVMe", 00:23:12.067 "listen_addresses": [ 00:23:12.067 { 00:23:12.067 "transport": "TCP", 00:23:12.067 "trtype": "TCP", 00:23:12.067 "adrfam": "IPv4", 00:23:12.067 "traddr": "10.0.0.2", 00:23:12.067 "trsvcid": "4420" 00:23:12.067 } 00:23:12.067 ], 00:23:12.067 "allow_any_host": true, 00:23:12.067 "hosts": [], 00:23:12.067 "serial_number": "SPDK00000000000001", 00:23:12.067 "model_number": "SPDK bdev Controller", 00:23:12.067 "max_namespaces": 2, 00:23:12.067 "min_cntlid": 1, 00:23:12.067 "max_cntlid": 65519, 00:23:12.067 "namespaces": [ 00:23:12.067 { 00:23:12.067 "nsid": 1, 00:23:12.067 "bdev_name": "Malloc0", 00:23:12.067 "name": "Malloc0", 00:23:12.067 "nguid": "76486C6D24614380A0A0E3CD93413EDB", 00:23:12.067 "uuid": "76486c6d-2461-4380-a0a0-e3cd93413edb" 00:23:12.067 }, 00:23:12.067 { 00:23:12.067 "nsid": 2, 00:23:12.067 "bdev_name": "Malloc1", 00:23:12.067 "name": "Malloc1", 00:23:12.067 "nguid": "571C5B8745F242B7B90006005E8C6AA4", 00:23:12.067 "uuid": "571c5b87-45f2-42b7-b900-06005e8c6aa4" 00:23:12.067 } 00:23:12.067 ] 00:23:12.067 } 00:23:12.067 ] 00:23:12.067 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.067 01:59:00 -- host/aer.sh@43 -- # wait 3516036 00:23:12.067 01:59:00 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:12.067 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.067 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:12.067 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.067 01:59:00 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:12.067 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.067 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:12.067 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.067 01:59:00 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:12.067 01:59:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.067 01:59:00 -- common/autotest_common.sh@10 -- # set +x 00:23:12.067 01:59:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.067 01:59:00 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:12.067 01:59:00 -- host/aer.sh@51 -- # nvmftestfini 00:23:12.067 01:59:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:12.067 01:59:00 -- nvmf/common.sh@116 -- # sync 00:23:12.067 01:59:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:12.067 01:59:00 -- nvmf/common.sh@119 -- # set +e 00:23:12.067 01:59:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:12.067 01:59:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:12.067 rmmod nvme_tcp 00:23:12.067 rmmod nvme_fabrics 00:23:12.067 rmmod nvme_keyring 00:23:12.067 01:59:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:12.067 01:59:00 -- nvmf/common.sh@123 -- # set -e 00:23:12.067 01:59:00 -- nvmf/common.sh@124 -- # return 0 00:23:12.067 01:59:00 -- nvmf/common.sh@477 -- # '[' -n 3515876 ']' 00:23:12.067 01:59:00 -- nvmf/common.sh@478 -- # killprocess 3515876 00:23:12.067 01:59:00 -- common/autotest_common.sh@936 -- # '[' -z 3515876 ']' 00:23:12.067 01:59:00 -- common/autotest_common.sh@940 -- # kill -0 3515876 00:23:12.067 01:59:00 -- common/autotest_common.sh@941 -- # uname 00:23:12.067 01:59:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:12.067 01:59:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3515876 00:23:12.067 01:59:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:12.067 01:59:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:12.067 01:59:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3515876' 00:23:12.067 killing process with pid 3515876 00:23:12.067 01:59:00 -- common/autotest_common.sh@955 -- # kill 3515876 00:23:12.067 [2024-11-19 01:59:00.592221] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:12.067 01:59:00 -- common/autotest_common.sh@960 -- # wait 3515876 00:23:12.326 01:59:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:12.326 01:59:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:12.326 01:59:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:12.326 01:59:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:12.326 01:59:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:12.327 01:59:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:12.327 01:59:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:12.327 01:59:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.863 01:59:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:14.863 00:23:14.863 real 0m6.267s 00:23:14.863 user 0m7.671s 00:23:14.863 sys 0m1.923s 00:23:14.863 01:59:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:14.863 01:59:02 -- common/autotest_common.sh@10 -- # set +x 00:23:14.863 ************************************ 00:23:14.863 END TEST nvmf_aer 00:23:14.863 ************************************ 00:23:14.863 01:59:02 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:14.863 01:59:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:14.863 01:59:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:14.863 01:59:02 -- common/autotest_common.sh@10 -- # set +x 00:23:14.863 ************************************ 00:23:14.863 START TEST nvmf_async_init 00:23:14.863 ************************************ 00:23:14.863 01:59:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:14.863 * Looking for test storage... 00:23:14.863 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:14.863 01:59:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:14.863 01:59:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:14.863 01:59:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:14.863 01:59:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:14.863 01:59:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:14.863 01:59:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:14.863 01:59:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:14.863 01:59:03 -- scripts/common.sh@335 -- # IFS=.-: 00:23:14.863 01:59:03 -- scripts/common.sh@335 -- # read -ra ver1 00:23:14.863 01:59:03 -- scripts/common.sh@336 -- # IFS=.-: 00:23:14.863 01:59:03 -- scripts/common.sh@336 -- # read -ra ver2 00:23:14.863 01:59:03 -- scripts/common.sh@337 -- # local 'op=<' 00:23:14.863 01:59:03 -- scripts/common.sh@339 -- # ver1_l=2 00:23:14.863 01:59:03 -- scripts/common.sh@340 -- # ver2_l=1 00:23:14.863 01:59:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:14.863 01:59:03 -- scripts/common.sh@343 -- # case "$op" in 00:23:14.863 01:59:03 -- scripts/common.sh@344 -- # : 1 00:23:14.863 01:59:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:14.863 01:59:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:14.863 01:59:03 -- scripts/common.sh@364 -- # decimal 1 00:23:14.863 01:59:03 -- scripts/common.sh@352 -- # local d=1 00:23:14.863 01:59:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:14.863 01:59:03 -- scripts/common.sh@354 -- # echo 1 00:23:14.863 01:59:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:14.863 01:59:03 -- scripts/common.sh@365 -- # decimal 2 00:23:14.863 01:59:03 -- scripts/common.sh@352 -- # local d=2 00:23:14.863 01:59:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:14.863 01:59:03 -- scripts/common.sh@354 -- # echo 2 00:23:14.863 01:59:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:14.863 01:59:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:14.863 01:59:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:14.863 01:59:03 -- scripts/common.sh@367 -- # return 0 00:23:14.863 01:59:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:14.863 01:59:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:14.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.863 --rc genhtml_branch_coverage=1 00:23:14.863 --rc genhtml_function_coverage=1 00:23:14.863 --rc genhtml_legend=1 00:23:14.863 --rc geninfo_all_blocks=1 00:23:14.863 --rc geninfo_unexecuted_blocks=1 00:23:14.863 00:23:14.863 ' 00:23:14.863 01:59:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:14.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.864 --rc genhtml_branch_coverage=1 00:23:14.864 --rc genhtml_function_coverage=1 00:23:14.864 --rc genhtml_legend=1 00:23:14.864 --rc geninfo_all_blocks=1 00:23:14.864 --rc geninfo_unexecuted_blocks=1 00:23:14.864 00:23:14.864 ' 00:23:14.864 01:59:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:14.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.864 --rc genhtml_branch_coverage=1 00:23:14.864 --rc genhtml_function_coverage=1 00:23:14.864 --rc genhtml_legend=1 00:23:14.864 --rc geninfo_all_blocks=1 00:23:14.864 --rc geninfo_unexecuted_blocks=1 00:23:14.864 00:23:14.864 ' 00:23:14.864 01:59:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:14.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.864 --rc genhtml_branch_coverage=1 00:23:14.864 --rc genhtml_function_coverage=1 00:23:14.864 --rc genhtml_legend=1 00:23:14.864 --rc geninfo_all_blocks=1 00:23:14.864 --rc geninfo_unexecuted_blocks=1 00:23:14.864 00:23:14.864 ' 00:23:14.864 01:59:03 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:14.864 01:59:03 -- nvmf/common.sh@7 -- # uname -s 00:23:14.864 01:59:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:14.864 01:59:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:14.864 01:59:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:14.864 01:59:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:14.864 01:59:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:14.864 01:59:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:14.864 01:59:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:14.864 01:59:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:14.864 01:59:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:14.864 01:59:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:14.864 01:59:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.864 01:59:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.864 01:59:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:14.864 01:59:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:14.864 01:59:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:14.864 01:59:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:14.864 01:59:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:14.864 01:59:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:14.864 01:59:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:14.864 01:59:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.864 01:59:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.864 01:59:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.864 01:59:03 -- paths/export.sh@5 -- # export PATH 00:23:14.864 01:59:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.864 01:59:03 -- nvmf/common.sh@46 -- # : 0 00:23:14.864 01:59:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:14.864 01:59:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:14.864 01:59:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:14.864 01:59:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:14.864 01:59:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:14.864 01:59:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:14.864 01:59:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:14.864 01:59:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:14.864 01:59:03 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:14.864 01:59:03 -- host/async_init.sh@14 -- # null_block_size=512 00:23:14.864 01:59:03 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:14.864 01:59:03 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:14.864 01:59:03 -- host/async_init.sh@20 -- # uuidgen 00:23:14.864 01:59:03 -- host/async_init.sh@20 -- # tr -d - 00:23:14.864 01:59:03 -- host/async_init.sh@20 -- # nguid=8e11879e074b4d4794de4106e0b080b7 00:23:14.864 01:59:03 -- host/async_init.sh@22 -- # nvmftestinit 00:23:14.864 01:59:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:14.864 01:59:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:14.864 01:59:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:14.864 01:59:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:14.864 01:59:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:14.864 01:59:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:14.864 01:59:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:14.864 01:59:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.864 01:59:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:14.864 01:59:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:14.864 01:59:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:14.864 01:59:03 -- common/autotest_common.sh@10 -- # set +x 00:23:16.766 01:59:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:16.766 01:59:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:16.766 01:59:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:16.766 01:59:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:16.766 01:59:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:16.766 01:59:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:16.766 01:59:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:16.766 01:59:05 -- nvmf/common.sh@294 -- # net_devs=() 00:23:16.766 01:59:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:16.766 01:59:05 -- nvmf/common.sh@295 -- # e810=() 00:23:16.766 01:59:05 -- nvmf/common.sh@295 -- # local -ga e810 00:23:16.766 01:59:05 -- nvmf/common.sh@296 -- # x722=() 00:23:16.766 01:59:05 -- nvmf/common.sh@296 -- # local -ga x722 00:23:16.766 01:59:05 -- nvmf/common.sh@297 -- # mlx=() 00:23:16.766 01:59:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:16.766 01:59:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:16.766 01:59:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:16.766 01:59:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:16.766 01:59:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:16.766 01:59:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.766 01:59:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:16.766 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:16.766 01:59:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.766 01:59:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:16.766 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:16.766 01:59:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:16.766 01:59:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.766 01:59:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.766 01:59:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.766 01:59:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.766 01:59:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:16.766 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:16.766 01:59:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.766 01:59:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.766 01:59:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.766 01:59:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.766 01:59:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.766 01:59:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:16.766 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:16.766 01:59:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.766 01:59:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:16.766 01:59:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:16.766 01:59:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:16.766 01:59:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:16.766 01:59:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:16.766 01:59:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:16.766 01:59:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:16.766 01:59:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:16.766 01:59:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:16.766 01:59:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:16.766 01:59:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:16.766 01:59:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:16.766 01:59:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:16.766 01:59:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:16.766 01:59:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:16.766 01:59:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:16.766 01:59:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:16.766 01:59:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:16.766 01:59:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:16.766 01:59:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:16.766 01:59:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:16.766 01:59:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:16.766 01:59:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:16.766 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:16.766 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.338 ms 00:23:16.766 00:23:16.766 --- 10.0.0.2 ping statistics --- 00:23:16.766 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.766 rtt min/avg/max/mdev = 0.338/0.338/0.338/0.000 ms 00:23:16.766 01:59:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:16.766 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:16.766 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:23:16.766 00:23:16.766 --- 10.0.0.1 ping statistics --- 00:23:16.766 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.766 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:23:16.766 01:59:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:16.766 01:59:05 -- nvmf/common.sh@410 -- # return 0 00:23:16.766 01:59:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:16.766 01:59:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:16.766 01:59:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:16.766 01:59:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:16.766 01:59:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:16.766 01:59:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:16.766 01:59:05 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:16.766 01:59:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:16.766 01:59:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:16.766 01:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:16.766 01:59:05 -- nvmf/common.sh@469 -- # nvmfpid=3518116 00:23:16.766 01:59:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:16.766 01:59:05 -- nvmf/common.sh@470 -- # waitforlisten 3518116 00:23:16.766 01:59:05 -- common/autotest_common.sh@829 -- # '[' -z 3518116 ']' 00:23:16.766 01:59:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:16.766 01:59:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:16.766 01:59:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:16.766 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:16.766 01:59:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:16.766 01:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:16.766 [2024-11-19 01:59:05.265140] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:16.766 [2024-11-19 01:59:05.265223] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:16.766 EAL: No free 2048 kB hugepages reported on node 1 00:23:17.025 [2024-11-19 01:59:05.327957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:17.025 [2024-11-19 01:59:05.431915] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:17.025 [2024-11-19 01:59:05.432069] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:17.025 [2024-11-19 01:59:05.432087] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:17.025 [2024-11-19 01:59:05.432099] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:17.025 [2024-11-19 01:59:05.432125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:17.959 01:59:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:17.959 01:59:06 -- common/autotest_common.sh@862 -- # return 0 00:23:17.959 01:59:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:17.959 01:59:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.959 01:59:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:17.959 01:59:06 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:17.959 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.959 [2024-11-19 01:59:06.243035] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:17.959 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.959 01:59:06 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:17.959 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.959 null0 00:23:17.959 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.959 01:59:06 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:17.959 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.959 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.959 01:59:06 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:17.959 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.959 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.959 01:59:06 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 8e11879e074b4d4794de4106e0b080b7 00:23:17.959 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.959 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.959 01:59:06 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:17.959 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.959 [2024-11-19 01:59:06.283341] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:17.959 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.959 01:59:06 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:17.959 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.959 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.218 nvme0n1 00:23:18.218 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.218 01:59:06 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:18.218 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.218 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.218 [ 00:23:18.218 { 00:23:18.218 "name": "nvme0n1", 00:23:18.218 "aliases": [ 00:23:18.218 "8e11879e-074b-4d47-94de-4106e0b080b7" 00:23:18.218 ], 00:23:18.218 "product_name": "NVMe disk", 00:23:18.218 "block_size": 512, 00:23:18.218 "num_blocks": 2097152, 00:23:18.218 "uuid": "8e11879e-074b-4d47-94de-4106e0b080b7", 00:23:18.218 "assigned_rate_limits": { 00:23:18.218 "rw_ios_per_sec": 0, 00:23:18.218 "rw_mbytes_per_sec": 0, 00:23:18.218 "r_mbytes_per_sec": 0, 00:23:18.218 "w_mbytes_per_sec": 0 00:23:18.218 }, 00:23:18.218 "claimed": false, 00:23:18.218 "zoned": false, 00:23:18.218 "supported_io_types": { 00:23:18.218 "read": true, 00:23:18.218 "write": true, 00:23:18.218 "unmap": false, 00:23:18.218 "write_zeroes": true, 00:23:18.218 "flush": true, 00:23:18.218 "reset": true, 00:23:18.218 "compare": true, 00:23:18.218 "compare_and_write": true, 00:23:18.218 "abort": true, 00:23:18.218 "nvme_admin": true, 00:23:18.218 "nvme_io": true 00:23:18.218 }, 00:23:18.218 "driver_specific": { 00:23:18.218 "nvme": [ 00:23:18.218 { 00:23:18.218 "trid": { 00:23:18.218 "trtype": "TCP", 00:23:18.218 "adrfam": "IPv4", 00:23:18.218 "traddr": "10.0.0.2", 00:23:18.218 "trsvcid": "4420", 00:23:18.218 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:18.218 }, 00:23:18.218 "ctrlr_data": { 00:23:18.218 "cntlid": 1, 00:23:18.218 "vendor_id": "0x8086", 00:23:18.218 "model_number": "SPDK bdev Controller", 00:23:18.218 "serial_number": "00000000000000000000", 00:23:18.218 "firmware_revision": "24.01.1", 00:23:18.218 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:18.218 "oacs": { 00:23:18.218 "security": 0, 00:23:18.218 "format": 0, 00:23:18.218 "firmware": 0, 00:23:18.218 "ns_manage": 0 00:23:18.218 }, 00:23:18.218 "multi_ctrlr": true, 00:23:18.218 "ana_reporting": false 00:23:18.218 }, 00:23:18.218 "vs": { 00:23:18.218 "nvme_version": "1.3" 00:23:18.218 }, 00:23:18.218 "ns_data": { 00:23:18.218 "id": 1, 00:23:18.218 "can_share": true 00:23:18.218 } 00:23:18.218 } 00:23:18.218 ], 00:23:18.218 "mp_policy": "active_passive" 00:23:18.218 } 00:23:18.218 } 00:23:18.218 ] 00:23:18.218 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.218 01:59:06 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:18.218 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.218 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.218 [2024-11-19 01:59:06.531840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:18.218 [2024-11-19 01:59:06.531928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a7ba0 (9): Bad file descriptor 00:23:18.218 [2024-11-19 01:59:06.663778] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:18.218 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.218 01:59:06 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:18.218 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.218 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.218 [ 00:23:18.218 { 00:23:18.218 "name": "nvme0n1", 00:23:18.218 "aliases": [ 00:23:18.218 "8e11879e-074b-4d47-94de-4106e0b080b7" 00:23:18.218 ], 00:23:18.218 "product_name": "NVMe disk", 00:23:18.218 "block_size": 512, 00:23:18.218 "num_blocks": 2097152, 00:23:18.218 "uuid": "8e11879e-074b-4d47-94de-4106e0b080b7", 00:23:18.218 "assigned_rate_limits": { 00:23:18.218 "rw_ios_per_sec": 0, 00:23:18.218 "rw_mbytes_per_sec": 0, 00:23:18.218 "r_mbytes_per_sec": 0, 00:23:18.218 "w_mbytes_per_sec": 0 00:23:18.218 }, 00:23:18.218 "claimed": false, 00:23:18.218 "zoned": false, 00:23:18.218 "supported_io_types": { 00:23:18.218 "read": true, 00:23:18.218 "write": true, 00:23:18.218 "unmap": false, 00:23:18.218 "write_zeroes": true, 00:23:18.218 "flush": true, 00:23:18.218 "reset": true, 00:23:18.218 "compare": true, 00:23:18.218 "compare_and_write": true, 00:23:18.218 "abort": true, 00:23:18.218 "nvme_admin": true, 00:23:18.218 "nvme_io": true 00:23:18.218 }, 00:23:18.218 "driver_specific": { 00:23:18.218 "nvme": [ 00:23:18.218 { 00:23:18.218 "trid": { 00:23:18.218 "trtype": "TCP", 00:23:18.218 "adrfam": "IPv4", 00:23:18.218 "traddr": "10.0.0.2", 00:23:18.218 "trsvcid": "4420", 00:23:18.218 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:18.218 }, 00:23:18.218 "ctrlr_data": { 00:23:18.218 "cntlid": 2, 00:23:18.218 "vendor_id": "0x8086", 00:23:18.218 "model_number": "SPDK bdev Controller", 00:23:18.218 "serial_number": "00000000000000000000", 00:23:18.218 "firmware_revision": "24.01.1", 00:23:18.218 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:18.218 "oacs": { 00:23:18.218 "security": 0, 00:23:18.218 "format": 0, 00:23:18.218 "firmware": 0, 00:23:18.218 "ns_manage": 0 00:23:18.218 }, 00:23:18.218 "multi_ctrlr": true, 00:23:18.218 "ana_reporting": false 00:23:18.218 }, 00:23:18.218 "vs": { 00:23:18.218 "nvme_version": "1.3" 00:23:18.218 }, 00:23:18.218 "ns_data": { 00:23:18.218 "id": 1, 00:23:18.218 "can_share": true 00:23:18.218 } 00:23:18.218 } 00:23:18.218 ], 00:23:18.218 "mp_policy": "active_passive" 00:23:18.218 } 00:23:18.218 } 00:23:18.218 ] 00:23:18.218 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.218 01:59:06 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.218 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.218 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.218 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.218 01:59:06 -- host/async_init.sh@53 -- # mktemp 00:23:18.218 01:59:06 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.TblAWLrfke 00:23:18.218 01:59:06 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:18.218 01:59:06 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.TblAWLrfke 00:23:18.218 01:59:06 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:18.218 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.218 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.218 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.219 01:59:06 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:18.219 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.219 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.219 [2024-11-19 01:59:06.708456] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:18.219 [2024-11-19 01:59:06.708588] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:18.219 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.219 01:59:06 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.TblAWLrfke 00:23:18.219 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.219 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.219 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.219 01:59:06 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.TblAWLrfke 00:23:18.219 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.219 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.219 [2024-11-19 01:59:06.724495] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:18.477 nvme0n1 00:23:18.477 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.477 01:59:06 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:18.477 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.477 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.477 [ 00:23:18.477 { 00:23:18.477 "name": "nvme0n1", 00:23:18.477 "aliases": [ 00:23:18.477 "8e11879e-074b-4d47-94de-4106e0b080b7" 00:23:18.477 ], 00:23:18.477 "product_name": "NVMe disk", 00:23:18.477 "block_size": 512, 00:23:18.477 "num_blocks": 2097152, 00:23:18.477 "uuid": "8e11879e-074b-4d47-94de-4106e0b080b7", 00:23:18.477 "assigned_rate_limits": { 00:23:18.477 "rw_ios_per_sec": 0, 00:23:18.477 "rw_mbytes_per_sec": 0, 00:23:18.477 "r_mbytes_per_sec": 0, 00:23:18.477 "w_mbytes_per_sec": 0 00:23:18.477 }, 00:23:18.477 "claimed": false, 00:23:18.477 "zoned": false, 00:23:18.477 "supported_io_types": { 00:23:18.477 "read": true, 00:23:18.477 "write": true, 00:23:18.477 "unmap": false, 00:23:18.477 "write_zeroes": true, 00:23:18.477 "flush": true, 00:23:18.477 "reset": true, 00:23:18.477 "compare": true, 00:23:18.477 "compare_and_write": true, 00:23:18.477 "abort": true, 00:23:18.477 "nvme_admin": true, 00:23:18.477 "nvme_io": true 00:23:18.477 }, 00:23:18.477 "driver_specific": { 00:23:18.477 "nvme": [ 00:23:18.477 { 00:23:18.477 "trid": { 00:23:18.477 "trtype": "TCP", 00:23:18.477 "adrfam": "IPv4", 00:23:18.477 "traddr": "10.0.0.2", 00:23:18.477 "trsvcid": "4421", 00:23:18.478 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:18.478 }, 00:23:18.478 "ctrlr_data": { 00:23:18.478 "cntlid": 3, 00:23:18.478 "vendor_id": "0x8086", 00:23:18.478 "model_number": "SPDK bdev Controller", 00:23:18.478 "serial_number": "00000000000000000000", 00:23:18.478 "firmware_revision": "24.01.1", 00:23:18.478 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:18.478 "oacs": { 00:23:18.478 "security": 0, 00:23:18.478 "format": 0, 00:23:18.478 "firmware": 0, 00:23:18.478 "ns_manage": 0 00:23:18.478 }, 00:23:18.478 "multi_ctrlr": true, 00:23:18.478 "ana_reporting": false 00:23:18.478 }, 00:23:18.478 "vs": { 00:23:18.478 "nvme_version": "1.3" 00:23:18.478 }, 00:23:18.478 "ns_data": { 00:23:18.478 "id": 1, 00:23:18.478 "can_share": true 00:23:18.478 } 00:23:18.478 } 00:23:18.478 ], 00:23:18.478 "mp_policy": "active_passive" 00:23:18.478 } 00:23:18.478 } 00:23:18.478 ] 00:23:18.478 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.478 01:59:06 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.478 01:59:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.478 01:59:06 -- common/autotest_common.sh@10 -- # set +x 00:23:18.478 01:59:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.478 01:59:06 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.TblAWLrfke 00:23:18.478 01:59:06 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:18.478 01:59:06 -- host/async_init.sh@78 -- # nvmftestfini 00:23:18.478 01:59:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:18.478 01:59:06 -- nvmf/common.sh@116 -- # sync 00:23:18.478 01:59:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:18.478 01:59:06 -- nvmf/common.sh@119 -- # set +e 00:23:18.478 01:59:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:18.478 01:59:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:18.478 rmmod nvme_tcp 00:23:18.478 rmmod nvme_fabrics 00:23:18.478 rmmod nvme_keyring 00:23:18.478 01:59:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:18.478 01:59:06 -- nvmf/common.sh@123 -- # set -e 00:23:18.478 01:59:06 -- nvmf/common.sh@124 -- # return 0 00:23:18.478 01:59:06 -- nvmf/common.sh@477 -- # '[' -n 3518116 ']' 00:23:18.478 01:59:06 -- nvmf/common.sh@478 -- # killprocess 3518116 00:23:18.478 01:59:06 -- common/autotest_common.sh@936 -- # '[' -z 3518116 ']' 00:23:18.478 01:59:06 -- common/autotest_common.sh@940 -- # kill -0 3518116 00:23:18.478 01:59:06 -- common/autotest_common.sh@941 -- # uname 00:23:18.478 01:59:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:18.478 01:59:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3518116 00:23:18.478 01:59:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:18.478 01:59:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:18.478 01:59:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3518116' 00:23:18.478 killing process with pid 3518116 00:23:18.478 01:59:06 -- common/autotest_common.sh@955 -- # kill 3518116 00:23:18.478 01:59:06 -- common/autotest_common.sh@960 -- # wait 3518116 00:23:18.737 01:59:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:18.737 01:59:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:18.737 01:59:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:18.737 01:59:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:18.737 01:59:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:18.737 01:59:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:18.737 01:59:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:18.737 01:59:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.272 01:59:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:21.272 00:23:21.272 real 0m6.280s 00:23:21.272 user 0m3.014s 00:23:21.272 sys 0m1.870s 00:23:21.272 01:59:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:21.272 01:59:09 -- common/autotest_common.sh@10 -- # set +x 00:23:21.272 ************************************ 00:23:21.272 END TEST nvmf_async_init 00:23:21.272 ************************************ 00:23:21.272 01:59:09 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:21.272 01:59:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:21.272 01:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:21.272 01:59:09 -- common/autotest_common.sh@10 -- # set +x 00:23:21.272 ************************************ 00:23:21.272 START TEST dma 00:23:21.272 ************************************ 00:23:21.272 01:59:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:21.272 * Looking for test storage... 00:23:21.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:21.272 01:59:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:21.272 01:59:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:21.272 01:59:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:21.272 01:59:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:21.272 01:59:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:21.272 01:59:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:21.272 01:59:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:21.272 01:59:09 -- scripts/common.sh@335 -- # IFS=.-: 00:23:21.272 01:59:09 -- scripts/common.sh@335 -- # read -ra ver1 00:23:21.272 01:59:09 -- scripts/common.sh@336 -- # IFS=.-: 00:23:21.272 01:59:09 -- scripts/common.sh@336 -- # read -ra ver2 00:23:21.272 01:59:09 -- scripts/common.sh@337 -- # local 'op=<' 00:23:21.272 01:59:09 -- scripts/common.sh@339 -- # ver1_l=2 00:23:21.272 01:59:09 -- scripts/common.sh@340 -- # ver2_l=1 00:23:21.272 01:59:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:21.272 01:59:09 -- scripts/common.sh@343 -- # case "$op" in 00:23:21.272 01:59:09 -- scripts/common.sh@344 -- # : 1 00:23:21.272 01:59:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:21.272 01:59:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:21.272 01:59:09 -- scripts/common.sh@364 -- # decimal 1 00:23:21.272 01:59:09 -- scripts/common.sh@352 -- # local d=1 00:23:21.272 01:59:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:21.272 01:59:09 -- scripts/common.sh@354 -- # echo 1 00:23:21.272 01:59:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:21.272 01:59:09 -- scripts/common.sh@365 -- # decimal 2 00:23:21.272 01:59:09 -- scripts/common.sh@352 -- # local d=2 00:23:21.272 01:59:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:21.272 01:59:09 -- scripts/common.sh@354 -- # echo 2 00:23:21.272 01:59:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:21.272 01:59:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:21.272 01:59:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:21.272 01:59:09 -- scripts/common.sh@367 -- # return 0 00:23:21.272 01:59:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:21.272 01:59:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.272 --rc genhtml_branch_coverage=1 00:23:21.272 --rc genhtml_function_coverage=1 00:23:21.272 --rc genhtml_legend=1 00:23:21.272 --rc geninfo_all_blocks=1 00:23:21.272 --rc geninfo_unexecuted_blocks=1 00:23:21.272 00:23:21.272 ' 00:23:21.272 01:59:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.272 --rc genhtml_branch_coverage=1 00:23:21.272 --rc genhtml_function_coverage=1 00:23:21.272 --rc genhtml_legend=1 00:23:21.272 --rc geninfo_all_blocks=1 00:23:21.272 --rc geninfo_unexecuted_blocks=1 00:23:21.272 00:23:21.272 ' 00:23:21.272 01:59:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.272 --rc genhtml_branch_coverage=1 00:23:21.272 --rc genhtml_function_coverage=1 00:23:21.272 --rc genhtml_legend=1 00:23:21.272 --rc geninfo_all_blocks=1 00:23:21.272 --rc geninfo_unexecuted_blocks=1 00:23:21.272 00:23:21.272 ' 00:23:21.272 01:59:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:21.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.272 --rc genhtml_branch_coverage=1 00:23:21.272 --rc genhtml_function_coverage=1 00:23:21.272 --rc genhtml_legend=1 00:23:21.272 --rc geninfo_all_blocks=1 00:23:21.272 --rc geninfo_unexecuted_blocks=1 00:23:21.272 00:23:21.272 ' 00:23:21.272 01:59:09 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:21.273 01:59:09 -- nvmf/common.sh@7 -- # uname -s 00:23:21.273 01:59:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:21.273 01:59:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:21.273 01:59:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:21.273 01:59:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:21.273 01:59:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:21.273 01:59:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:21.273 01:59:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:21.273 01:59:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:21.273 01:59:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:21.273 01:59:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:21.273 01:59:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.273 01:59:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.273 01:59:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:21.273 01:59:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:21.273 01:59:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:21.273 01:59:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:21.273 01:59:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:21.273 01:59:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:21.273 01:59:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:21.273 01:59:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.273 01:59:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.273 01:59:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.273 01:59:09 -- paths/export.sh@5 -- # export PATH 00:23:21.273 01:59:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.273 01:59:09 -- nvmf/common.sh@46 -- # : 0 00:23:21.273 01:59:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:21.273 01:59:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:21.273 01:59:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:21.273 01:59:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:21.273 01:59:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:21.273 01:59:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:21.273 01:59:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:21.273 01:59:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:21.273 01:59:09 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:21.273 01:59:09 -- host/dma.sh@13 -- # exit 0 00:23:21.273 00:23:21.273 real 0m0.149s 00:23:21.273 user 0m0.098s 00:23:21.273 sys 0m0.059s 00:23:21.273 01:59:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:21.273 01:59:09 -- common/autotest_common.sh@10 -- # set +x 00:23:21.273 ************************************ 00:23:21.273 END TEST dma 00:23:21.273 ************************************ 00:23:21.273 01:59:09 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:21.273 01:59:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:21.273 01:59:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:21.273 01:59:09 -- common/autotest_common.sh@10 -- # set +x 00:23:21.273 ************************************ 00:23:21.273 START TEST nvmf_identify 00:23:21.273 ************************************ 00:23:21.273 01:59:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:21.273 * Looking for test storage... 00:23:21.273 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:21.273 01:59:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:21.273 01:59:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:21.273 01:59:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:21.273 01:59:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:21.273 01:59:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:21.273 01:59:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:21.273 01:59:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:21.273 01:59:09 -- scripts/common.sh@335 -- # IFS=.-: 00:23:21.273 01:59:09 -- scripts/common.sh@335 -- # read -ra ver1 00:23:21.273 01:59:09 -- scripts/common.sh@336 -- # IFS=.-: 00:23:21.273 01:59:09 -- scripts/common.sh@336 -- # read -ra ver2 00:23:21.273 01:59:09 -- scripts/common.sh@337 -- # local 'op=<' 00:23:21.273 01:59:09 -- scripts/common.sh@339 -- # ver1_l=2 00:23:21.273 01:59:09 -- scripts/common.sh@340 -- # ver2_l=1 00:23:21.273 01:59:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:21.273 01:59:09 -- scripts/common.sh@343 -- # case "$op" in 00:23:21.273 01:59:09 -- scripts/common.sh@344 -- # : 1 00:23:21.273 01:59:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:21.273 01:59:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:21.273 01:59:09 -- scripts/common.sh@364 -- # decimal 1 00:23:21.273 01:59:09 -- scripts/common.sh@352 -- # local d=1 00:23:21.273 01:59:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:21.273 01:59:09 -- scripts/common.sh@354 -- # echo 1 00:23:21.273 01:59:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:21.273 01:59:09 -- scripts/common.sh@365 -- # decimal 2 00:23:21.273 01:59:09 -- scripts/common.sh@352 -- # local d=2 00:23:21.273 01:59:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:21.273 01:59:09 -- scripts/common.sh@354 -- # echo 2 00:23:21.273 01:59:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:21.273 01:59:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:21.273 01:59:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:21.273 01:59:09 -- scripts/common.sh@367 -- # return 0 00:23:21.273 01:59:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:21.273 01:59:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:21.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.273 --rc genhtml_branch_coverage=1 00:23:21.273 --rc genhtml_function_coverage=1 00:23:21.273 --rc genhtml_legend=1 00:23:21.273 --rc geninfo_all_blocks=1 00:23:21.273 --rc geninfo_unexecuted_blocks=1 00:23:21.273 00:23:21.273 ' 00:23:21.273 01:59:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:21.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.273 --rc genhtml_branch_coverage=1 00:23:21.273 --rc genhtml_function_coverage=1 00:23:21.273 --rc genhtml_legend=1 00:23:21.273 --rc geninfo_all_blocks=1 00:23:21.273 --rc geninfo_unexecuted_blocks=1 00:23:21.273 00:23:21.273 ' 00:23:21.273 01:59:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:21.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.273 --rc genhtml_branch_coverage=1 00:23:21.273 --rc genhtml_function_coverage=1 00:23:21.273 --rc genhtml_legend=1 00:23:21.273 --rc geninfo_all_blocks=1 00:23:21.273 --rc geninfo_unexecuted_blocks=1 00:23:21.273 00:23:21.273 ' 00:23:21.273 01:59:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:21.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.273 --rc genhtml_branch_coverage=1 00:23:21.273 --rc genhtml_function_coverage=1 00:23:21.273 --rc genhtml_legend=1 00:23:21.273 --rc geninfo_all_blocks=1 00:23:21.273 --rc geninfo_unexecuted_blocks=1 00:23:21.273 00:23:21.273 ' 00:23:21.273 01:59:09 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:21.273 01:59:09 -- nvmf/common.sh@7 -- # uname -s 00:23:21.273 01:59:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:21.273 01:59:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:21.273 01:59:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:21.273 01:59:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:21.273 01:59:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:21.273 01:59:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:21.273 01:59:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:21.273 01:59:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:21.273 01:59:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:21.273 01:59:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:21.273 01:59:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.273 01:59:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.273 01:59:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:21.273 01:59:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:21.273 01:59:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:21.273 01:59:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:21.273 01:59:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:21.273 01:59:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:21.273 01:59:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:21.274 01:59:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.274 01:59:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.274 01:59:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.274 01:59:09 -- paths/export.sh@5 -- # export PATH 00:23:21.274 01:59:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.274 01:59:09 -- nvmf/common.sh@46 -- # : 0 00:23:21.274 01:59:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:21.274 01:59:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:21.274 01:59:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:21.274 01:59:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:21.274 01:59:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:21.274 01:59:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:21.274 01:59:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:21.274 01:59:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:21.274 01:59:09 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:21.274 01:59:09 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:21.274 01:59:09 -- host/identify.sh@14 -- # nvmftestinit 00:23:21.274 01:59:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:21.274 01:59:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:21.274 01:59:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:21.274 01:59:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:21.274 01:59:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:21.274 01:59:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.274 01:59:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:21.274 01:59:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.274 01:59:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:21.274 01:59:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:21.274 01:59:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:21.274 01:59:09 -- common/autotest_common.sh@10 -- # set +x 00:23:23.237 01:59:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:23.237 01:59:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:23.237 01:59:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:23.237 01:59:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:23.237 01:59:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:23.237 01:59:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:23.237 01:59:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:23.237 01:59:11 -- nvmf/common.sh@294 -- # net_devs=() 00:23:23.237 01:59:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:23.237 01:59:11 -- nvmf/common.sh@295 -- # e810=() 00:23:23.237 01:59:11 -- nvmf/common.sh@295 -- # local -ga e810 00:23:23.237 01:59:11 -- nvmf/common.sh@296 -- # x722=() 00:23:23.237 01:59:11 -- nvmf/common.sh@296 -- # local -ga x722 00:23:23.237 01:59:11 -- nvmf/common.sh@297 -- # mlx=() 00:23:23.237 01:59:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:23.237 01:59:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:23.237 01:59:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:23.237 01:59:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:23.237 01:59:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:23.237 01:59:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.237 01:59:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:23.237 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:23.237 01:59:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.237 01:59:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:23.237 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:23.237 01:59:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:23.237 01:59:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.237 01:59:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.237 01:59:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.237 01:59:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.237 01:59:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:23.237 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:23.237 01:59:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.237 01:59:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.237 01:59:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.237 01:59:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.237 01:59:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.237 01:59:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:23.237 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:23.237 01:59:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.237 01:59:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:23.237 01:59:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:23.237 01:59:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:23.237 01:59:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:23.237 01:59:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:23.237 01:59:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:23.237 01:59:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:23.237 01:59:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:23.237 01:59:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:23.237 01:59:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:23.237 01:59:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:23.237 01:59:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:23.237 01:59:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:23.237 01:59:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:23.237 01:59:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:23.237 01:59:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:23.237 01:59:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:23.237 01:59:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:23.237 01:59:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:23.237 01:59:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:23.237 01:59:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:23.237 01:59:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:23.237 01:59:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:23.237 01:59:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:23.237 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:23.237 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:23:23.237 00:23:23.237 --- 10.0.0.2 ping statistics --- 00:23:23.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:23.237 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:23:23.237 01:59:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:23.237 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:23.237 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:23:23.237 00:23:23.237 --- 10.0.0.1 ping statistics --- 00:23:23.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:23.237 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:23:23.237 01:59:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:23.237 01:59:11 -- nvmf/common.sh@410 -- # return 0 00:23:23.237 01:59:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:23.237 01:59:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:23.238 01:59:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:23.238 01:59:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:23.238 01:59:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:23.238 01:59:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:23.238 01:59:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:23.238 01:59:11 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:23.238 01:59:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:23.238 01:59:11 -- common/autotest_common.sh@10 -- # set +x 00:23:23.238 01:59:11 -- host/identify.sh@19 -- # nvmfpid=3520366 00:23:23.238 01:59:11 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:23.238 01:59:11 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:23.238 01:59:11 -- host/identify.sh@23 -- # waitforlisten 3520366 00:23:23.238 01:59:11 -- common/autotest_common.sh@829 -- # '[' -z 3520366 ']' 00:23:23.238 01:59:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:23.238 01:59:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:23.238 01:59:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:23.238 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:23.238 01:59:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:23.238 01:59:11 -- common/autotest_common.sh@10 -- # set +x 00:23:23.496 [2024-11-19 01:59:11.798019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:23.496 [2024-11-19 01:59:11.798104] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:23.496 EAL: No free 2048 kB hugepages reported on node 1 00:23:23.496 [2024-11-19 01:59:11.868308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:23.496 [2024-11-19 01:59:11.987562] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:23.496 [2024-11-19 01:59:11.987734] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:23.496 [2024-11-19 01:59:11.987756] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:23.496 [2024-11-19 01:59:11.987771] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:23.496 [2024-11-19 01:59:11.987841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:23.496 [2024-11-19 01:59:11.987896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:23.496 [2024-11-19 01:59:11.987944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:23.496 [2024-11-19 01:59:11.987947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:24.432 01:59:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:24.432 01:59:12 -- common/autotest_common.sh@862 -- # return 0 00:23:24.432 01:59:12 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:24.432 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 [2024-11-19 01:59:12.763098] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:24.432 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.432 01:59:12 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:24.432 01:59:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 01:59:12 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:24.432 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 Malloc0 00:23:24.432 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.432 01:59:12 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:24.432 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.432 01:59:12 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:24.432 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.432 01:59:12 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:24.432 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 [2024-11-19 01:59:12.835205] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:24.432 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.432 01:59:12 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:24.432 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.432 01:59:12 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:24.432 01:59:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.432 01:59:12 -- common/autotest_common.sh@10 -- # set +x 00:23:24.432 [2024-11-19 01:59:12.850946] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:24.432 [ 00:23:24.432 { 00:23:24.432 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:24.432 "subtype": "Discovery", 00:23:24.432 "listen_addresses": [ 00:23:24.432 { 00:23:24.432 "transport": "TCP", 00:23:24.432 "trtype": "TCP", 00:23:24.432 "adrfam": "IPv4", 00:23:24.432 "traddr": "10.0.0.2", 00:23:24.432 "trsvcid": "4420" 00:23:24.432 } 00:23:24.432 ], 00:23:24.432 "allow_any_host": true, 00:23:24.432 "hosts": [] 00:23:24.432 }, 00:23:24.432 { 00:23:24.432 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:24.433 "subtype": "NVMe", 00:23:24.433 "listen_addresses": [ 00:23:24.433 { 00:23:24.433 "transport": "TCP", 00:23:24.433 "trtype": "TCP", 00:23:24.433 "adrfam": "IPv4", 00:23:24.433 "traddr": "10.0.0.2", 00:23:24.433 "trsvcid": "4420" 00:23:24.433 } 00:23:24.433 ], 00:23:24.433 "allow_any_host": true, 00:23:24.433 "hosts": [], 00:23:24.433 "serial_number": "SPDK00000000000001", 00:23:24.433 "model_number": "SPDK bdev Controller", 00:23:24.433 "max_namespaces": 32, 00:23:24.433 "min_cntlid": 1, 00:23:24.433 "max_cntlid": 65519, 00:23:24.433 "namespaces": [ 00:23:24.433 { 00:23:24.433 "nsid": 1, 00:23:24.433 "bdev_name": "Malloc0", 00:23:24.433 "name": "Malloc0", 00:23:24.433 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:24.433 "eui64": "ABCDEF0123456789", 00:23:24.433 "uuid": "276bf030-8766-4e8e-ab04-7dffc27ce158" 00:23:24.433 } 00:23:24.433 ] 00:23:24.433 } 00:23:24.433 ] 00:23:24.433 01:59:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.433 01:59:12 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:24.433 [2024-11-19 01:59:12.874413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:24.433 [2024-11-19 01:59:12.874452] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3520512 ] 00:23:24.433 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.433 [2024-11-19 01:59:12.906099] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:24.433 [2024-11-19 01:59:12.906154] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:24.433 [2024-11-19 01:59:12.906164] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:24.433 [2024-11-19 01:59:12.906183] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:24.433 [2024-11-19 01:59:12.906195] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:24.433 [2024-11-19 01:59:12.909683] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:24.433 [2024-11-19 01:59:12.909746] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xfa3e10 0 00:23:24.433 [2024-11-19 01:59:12.917656] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:24.433 [2024-11-19 01:59:12.917677] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:24.433 [2024-11-19 01:59:12.917686] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:24.433 [2024-11-19 01:59:12.917692] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:24.433 [2024-11-19 01:59:12.917747] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.917760] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.917768] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.433 [2024-11-19 01:59:12.917786] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:24.433 [2024-11-19 01:59:12.917812] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.433 [2024-11-19 01:59:12.924649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.433 [2024-11-19 01:59:12.924667] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.433 [2024-11-19 01:59:12.924674] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.924686] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.433 [2024-11-19 01:59:12.924716] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:24.433 [2024-11-19 01:59:12.924744] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:24.433 [2024-11-19 01:59:12.924753] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:24.433 [2024-11-19 01:59:12.924772] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.924781] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.924787] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.433 [2024-11-19 01:59:12.924799] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.433 [2024-11-19 01:59:12.924823] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.433 [2024-11-19 01:59:12.924957] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.433 [2024-11-19 01:59:12.924976] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.433 [2024-11-19 01:59:12.924982] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.924989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.433 [2024-11-19 01:59:12.924999] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:24.433 [2024-11-19 01:59:12.925011] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:24.433 [2024-11-19 01:59:12.925024] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925032] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925038] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.433 [2024-11-19 01:59:12.925049] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.433 [2024-11-19 01:59:12.925069] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.433 [2024-11-19 01:59:12.925160] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.433 [2024-11-19 01:59:12.925172] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.433 [2024-11-19 01:59:12.925179] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925186] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.433 [2024-11-19 01:59:12.925195] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:24.433 [2024-11-19 01:59:12.925208] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:24.433 [2024-11-19 01:59:12.925220] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925228] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925234] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.433 [2024-11-19 01:59:12.925245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.433 [2024-11-19 01:59:12.925265] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.433 [2024-11-19 01:59:12.925354] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.433 [2024-11-19 01:59:12.925366] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.433 [2024-11-19 01:59:12.925373] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925383] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.433 [2024-11-19 01:59:12.925394] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:24.433 [2024-11-19 01:59:12.925410] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925419] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925425] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.433 [2024-11-19 01:59:12.925436] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.433 [2024-11-19 01:59:12.925456] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.433 [2024-11-19 01:59:12.925536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.433 [2024-11-19 01:59:12.925550] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.433 [2024-11-19 01:59:12.925557] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925563] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.433 [2024-11-19 01:59:12.925572] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:24.433 [2024-11-19 01:59:12.925581] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:24.433 [2024-11-19 01:59:12.925593] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:24.433 [2024-11-19 01:59:12.925703] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:24.433 [2024-11-19 01:59:12.925714] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:24.433 [2024-11-19 01:59:12.925729] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925736] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925743] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.433 [2024-11-19 01:59:12.925753] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.433 [2024-11-19 01:59:12.925775] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.433 [2024-11-19 01:59:12.925903] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.433 [2024-11-19 01:59:12.925915] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.433 [2024-11-19 01:59:12.925922] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.433 [2024-11-19 01:59:12.925928] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.433 [2024-11-19 01:59:12.925937] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:24.433 [2024-11-19 01:59:12.925953] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.925961] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.925968] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.925978] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.434 [2024-11-19 01:59:12.925998] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.434 [2024-11-19 01:59:12.926078] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.434 [2024-11-19 01:59:12.926092] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.434 [2024-11-19 01:59:12.926103] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.926110] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.434 [2024-11-19 01:59:12.926119] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:24.434 [2024-11-19 01:59:12.926128] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:24.434 [2024-11-19 01:59:12.926141] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:24.434 [2024-11-19 01:59:12.926159] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:24.434 [2024-11-19 01:59:12.926175] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.926183] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.926189] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.926200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.434 [2024-11-19 01:59:12.926221] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.434 [2024-11-19 01:59:12.926348] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.434 [2024-11-19 01:59:12.926362] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.434 [2024-11-19 01:59:12.926369] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.926376] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xfa3e10): datao=0, datal=4096, cccid=0 00:23:24.434 [2024-11-19 01:59:12.926383] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1023b30) on tqpair(0xfa3e10): expected_datao=0, payload_size=4096 00:23:24.434 [2024-11-19 01:59:12.926402] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.926412] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.966732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.434 [2024-11-19 01:59:12.966753] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.434 [2024-11-19 01:59:12.966761] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.966768] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.434 [2024-11-19 01:59:12.966782] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:24.434 [2024-11-19 01:59:12.966791] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:24.434 [2024-11-19 01:59:12.966798] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:24.434 [2024-11-19 01:59:12.966806] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:24.434 [2024-11-19 01:59:12.966814] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:24.434 [2024-11-19 01:59:12.966822] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:24.434 [2024-11-19 01:59:12.966842] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:24.434 [2024-11-19 01:59:12.966855] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.966863] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.966869] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.966885] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.434 [2024-11-19 01:59:12.966909] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.434 [2024-11-19 01:59:12.967046] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.434 [2024-11-19 01:59:12.967059] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.434 [2024-11-19 01:59:12.967067] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967073] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023b30) on tqpair=0xfa3e10 00:23:24.434 [2024-11-19 01:59:12.967086] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967093] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967100] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.967110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.434 [2024-11-19 01:59:12.967120] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967127] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967134] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.967143] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.434 [2024-11-19 01:59:12.967153] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967160] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967166] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.967174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.434 [2024-11-19 01:59:12.967184] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967191] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967197] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.967206] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.434 [2024-11-19 01:59:12.967215] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:24.434 [2024-11-19 01:59:12.967234] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:24.434 [2024-11-19 01:59:12.967246] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967268] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967274] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.967285] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.434 [2024-11-19 01:59:12.967307] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023b30, cid 0, qid 0 00:23:24.434 [2024-11-19 01:59:12.967333] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023c90, cid 1, qid 0 00:23:24.434 [2024-11-19 01:59:12.967341] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023df0, cid 2, qid 0 00:23:24.434 [2024-11-19 01:59:12.967349] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.434 [2024-11-19 01:59:12.967356] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10240b0, cid 4, qid 0 00:23:24.434 [2024-11-19 01:59:12.967496] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.434 [2024-11-19 01:59:12.967510] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.434 [2024-11-19 01:59:12.967517] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967524] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10240b0) on tqpair=0xfa3e10 00:23:24.434 [2024-11-19 01:59:12.967534] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:24.434 [2024-11-19 01:59:12.967543] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:24.434 [2024-11-19 01:59:12.967562] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967571] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967577] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.967588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.434 [2024-11-19 01:59:12.967609] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10240b0, cid 4, qid 0 00:23:24.434 [2024-11-19 01:59:12.967798] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.434 [2024-11-19 01:59:12.967812] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.434 [2024-11-19 01:59:12.967819] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967825] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xfa3e10): datao=0, datal=4096, cccid=4 00:23:24.434 [2024-11-19 01:59:12.967832] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10240b0) on tqpair(0xfa3e10): expected_datao=0, payload_size=4096 00:23:24.434 [2024-11-19 01:59:12.967844] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967852] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967864] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.434 [2024-11-19 01:59:12.967874] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.434 [2024-11-19 01:59:12.967881] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967887] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10240b0) on tqpair=0xfa3e10 00:23:24.434 [2024-11-19 01:59:12.967906] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:24.434 [2024-11-19 01:59:12.967953] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967964] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.434 [2024-11-19 01:59:12.967970] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xfa3e10) 00:23:24.434 [2024-11-19 01:59:12.967981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.435 [2024-11-19 01:59:12.967993] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.435 [2024-11-19 01:59:12.968000] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.435 [2024-11-19 01:59:12.968006] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xfa3e10) 00:23:24.435 [2024-11-19 01:59:12.968016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.435 [2024-11-19 01:59:12.968042] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10240b0, cid 4, qid 0 00:23:24.435 [2024-11-19 01:59:12.968055] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1024210, cid 5, qid 0 00:23:24.435 [2024-11-19 01:59:12.968181] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.435 [2024-11-19 01:59:12.968193] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.435 [2024-11-19 01:59:12.968203] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.435 [2024-11-19 01:59:12.968210] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xfa3e10): datao=0, datal=1024, cccid=4 00:23:24.435 [2024-11-19 01:59:12.968218] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10240b0) on tqpair(0xfa3e10): expected_datao=0, payload_size=1024 00:23:24.435 [2024-11-19 01:59:12.968229] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.435 [2024-11-19 01:59:12.968236] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.435 [2024-11-19 01:59:12.968245] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.435 [2024-11-19 01:59:12.968254] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.435 [2024-11-19 01:59:12.968260] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.435 [2024-11-19 01:59:12.968266] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1024210) on tqpair=0xfa3e10 00:23:24.695 [2024-11-19 01:59:13.008830] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.695 [2024-11-19 01:59:13.008852] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.695 [2024-11-19 01:59:13.008861] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.008868] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10240b0) on tqpair=0xfa3e10 00:23:24.695 [2024-11-19 01:59:13.008889] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.008898] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.008905] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xfa3e10) 00:23:24.695 [2024-11-19 01:59:13.008916] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.695 [2024-11-19 01:59:13.008947] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10240b0, cid 4, qid 0 00:23:24.695 [2024-11-19 01:59:13.009130] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.695 [2024-11-19 01:59:13.009146] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.695 [2024-11-19 01:59:13.009153] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.009159] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xfa3e10): datao=0, datal=3072, cccid=4 00:23:24.695 [2024-11-19 01:59:13.009167] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10240b0) on tqpair(0xfa3e10): expected_datao=0, payload_size=3072 00:23:24.695 [2024-11-19 01:59:13.009188] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.009198] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.049780] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.695 [2024-11-19 01:59:13.049799] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.695 [2024-11-19 01:59:13.049806] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.049813] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10240b0) on tqpair=0xfa3e10 00:23:24.695 [2024-11-19 01:59:13.049830] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.049839] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.049845] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xfa3e10) 00:23:24.695 [2024-11-19 01:59:13.049856] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.695 [2024-11-19 01:59:13.049885] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10240b0, cid 4, qid 0 00:23:24.695 [2024-11-19 01:59:13.049986] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.695 [2024-11-19 01:59:13.049998] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.695 [2024-11-19 01:59:13.050011] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.695 [2024-11-19 01:59:13.050018] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xfa3e10): datao=0, datal=8, cccid=4 00:23:24.696 [2024-11-19 01:59:13.050026] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x10240b0) on tqpair(0xfa3e10): expected_datao=0, payload_size=8 00:23:24.696 [2024-11-19 01:59:13.050037] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.696 [2024-11-19 01:59:13.050044] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.696 [2024-11-19 01:59:13.090731] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.696 [2024-11-19 01:59:13.090751] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.696 [2024-11-19 01:59:13.090759] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.696 [2024-11-19 01:59:13.090766] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10240b0) on tqpair=0xfa3e10 00:23:24.696 ===================================================== 00:23:24.696 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:24.696 ===================================================== 00:23:24.696 Controller Capabilities/Features 00:23:24.696 ================================ 00:23:24.696 Vendor ID: 0000 00:23:24.696 Subsystem Vendor ID: 0000 00:23:24.696 Serial Number: .................... 00:23:24.696 Model Number: ........................................ 00:23:24.696 Firmware Version: 24.01.1 00:23:24.696 Recommended Arb Burst: 0 00:23:24.696 IEEE OUI Identifier: 00 00 00 00:23:24.696 Multi-path I/O 00:23:24.696 May have multiple subsystem ports: No 00:23:24.696 May have multiple controllers: No 00:23:24.696 Associated with SR-IOV VF: No 00:23:24.696 Max Data Transfer Size: 131072 00:23:24.696 Max Number of Namespaces: 0 00:23:24.696 Max Number of I/O Queues: 1024 00:23:24.696 NVMe Specification Version (VS): 1.3 00:23:24.696 NVMe Specification Version (Identify): 1.3 00:23:24.696 Maximum Queue Entries: 128 00:23:24.696 Contiguous Queues Required: Yes 00:23:24.696 Arbitration Mechanisms Supported 00:23:24.696 Weighted Round Robin: Not Supported 00:23:24.696 Vendor Specific: Not Supported 00:23:24.696 Reset Timeout: 15000 ms 00:23:24.696 Doorbell Stride: 4 bytes 00:23:24.696 NVM Subsystem Reset: Not Supported 00:23:24.696 Command Sets Supported 00:23:24.696 NVM Command Set: Supported 00:23:24.696 Boot Partition: Not Supported 00:23:24.696 Memory Page Size Minimum: 4096 bytes 00:23:24.696 Memory Page Size Maximum: 4096 bytes 00:23:24.696 Persistent Memory Region: Not Supported 00:23:24.696 Optional Asynchronous Events Supported 00:23:24.696 Namespace Attribute Notices: Not Supported 00:23:24.696 Firmware Activation Notices: Not Supported 00:23:24.696 ANA Change Notices: Not Supported 00:23:24.696 PLE Aggregate Log Change Notices: Not Supported 00:23:24.696 LBA Status Info Alert Notices: Not Supported 00:23:24.696 EGE Aggregate Log Change Notices: Not Supported 00:23:24.696 Normal NVM Subsystem Shutdown event: Not Supported 00:23:24.696 Zone Descriptor Change Notices: Not Supported 00:23:24.696 Discovery Log Change Notices: Supported 00:23:24.696 Controller Attributes 00:23:24.696 128-bit Host Identifier: Not Supported 00:23:24.696 Non-Operational Permissive Mode: Not Supported 00:23:24.696 NVM Sets: Not Supported 00:23:24.696 Read Recovery Levels: Not Supported 00:23:24.696 Endurance Groups: Not Supported 00:23:24.696 Predictable Latency Mode: Not Supported 00:23:24.696 Traffic Based Keep ALive: Not Supported 00:23:24.696 Namespace Granularity: Not Supported 00:23:24.696 SQ Associations: Not Supported 00:23:24.696 UUID List: Not Supported 00:23:24.696 Multi-Domain Subsystem: Not Supported 00:23:24.696 Fixed Capacity Management: Not Supported 00:23:24.696 Variable Capacity Management: Not Supported 00:23:24.696 Delete Endurance Group: Not Supported 00:23:24.696 Delete NVM Set: Not Supported 00:23:24.696 Extended LBA Formats Supported: Not Supported 00:23:24.696 Flexible Data Placement Supported: Not Supported 00:23:24.696 00:23:24.696 Controller Memory Buffer Support 00:23:24.696 ================================ 00:23:24.696 Supported: No 00:23:24.696 00:23:24.696 Persistent Memory Region Support 00:23:24.696 ================================ 00:23:24.696 Supported: No 00:23:24.696 00:23:24.696 Admin Command Set Attributes 00:23:24.696 ============================ 00:23:24.696 Security Send/Receive: Not Supported 00:23:24.696 Format NVM: Not Supported 00:23:24.696 Firmware Activate/Download: Not Supported 00:23:24.696 Namespace Management: Not Supported 00:23:24.696 Device Self-Test: Not Supported 00:23:24.696 Directives: Not Supported 00:23:24.696 NVMe-MI: Not Supported 00:23:24.696 Virtualization Management: Not Supported 00:23:24.696 Doorbell Buffer Config: Not Supported 00:23:24.696 Get LBA Status Capability: Not Supported 00:23:24.696 Command & Feature Lockdown Capability: Not Supported 00:23:24.696 Abort Command Limit: 1 00:23:24.696 Async Event Request Limit: 4 00:23:24.696 Number of Firmware Slots: N/A 00:23:24.696 Firmware Slot 1 Read-Only: N/A 00:23:24.696 Firmware Activation Without Reset: N/A 00:23:24.696 Multiple Update Detection Support: N/A 00:23:24.696 Firmware Update Granularity: No Information Provided 00:23:24.696 Per-Namespace SMART Log: No 00:23:24.696 Asymmetric Namespace Access Log Page: Not Supported 00:23:24.696 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:24.696 Command Effects Log Page: Not Supported 00:23:24.696 Get Log Page Extended Data: Supported 00:23:24.696 Telemetry Log Pages: Not Supported 00:23:24.696 Persistent Event Log Pages: Not Supported 00:23:24.696 Supported Log Pages Log Page: May Support 00:23:24.696 Commands Supported & Effects Log Page: Not Supported 00:23:24.696 Feature Identifiers & Effects Log Page:May Support 00:23:24.696 NVMe-MI Commands & Effects Log Page: May Support 00:23:24.696 Data Area 4 for Telemetry Log: Not Supported 00:23:24.696 Error Log Page Entries Supported: 128 00:23:24.696 Keep Alive: Not Supported 00:23:24.696 00:23:24.696 NVM Command Set Attributes 00:23:24.696 ========================== 00:23:24.696 Submission Queue Entry Size 00:23:24.696 Max: 1 00:23:24.696 Min: 1 00:23:24.696 Completion Queue Entry Size 00:23:24.696 Max: 1 00:23:24.696 Min: 1 00:23:24.696 Number of Namespaces: 0 00:23:24.696 Compare Command: Not Supported 00:23:24.696 Write Uncorrectable Command: Not Supported 00:23:24.696 Dataset Management Command: Not Supported 00:23:24.696 Write Zeroes Command: Not Supported 00:23:24.696 Set Features Save Field: Not Supported 00:23:24.696 Reservations: Not Supported 00:23:24.696 Timestamp: Not Supported 00:23:24.696 Copy: Not Supported 00:23:24.696 Volatile Write Cache: Not Present 00:23:24.696 Atomic Write Unit (Normal): 1 00:23:24.696 Atomic Write Unit (PFail): 1 00:23:24.696 Atomic Compare & Write Unit: 1 00:23:24.696 Fused Compare & Write: Supported 00:23:24.696 Scatter-Gather List 00:23:24.696 SGL Command Set: Supported 00:23:24.696 SGL Keyed: Supported 00:23:24.696 SGL Bit Bucket Descriptor: Not Supported 00:23:24.696 SGL Metadata Pointer: Not Supported 00:23:24.696 Oversized SGL: Not Supported 00:23:24.696 SGL Metadata Address: Not Supported 00:23:24.696 SGL Offset: Supported 00:23:24.696 Transport SGL Data Block: Not Supported 00:23:24.696 Replay Protected Memory Block: Not Supported 00:23:24.696 00:23:24.696 Firmware Slot Information 00:23:24.696 ========================= 00:23:24.696 Active slot: 0 00:23:24.696 00:23:24.696 00:23:24.696 Error Log 00:23:24.696 ========= 00:23:24.696 00:23:24.696 Active Namespaces 00:23:24.696 ================= 00:23:24.696 Discovery Log Page 00:23:24.696 ================== 00:23:24.696 Generation Counter: 2 00:23:24.696 Number of Records: 2 00:23:24.696 Record Format: 0 00:23:24.696 00:23:24.696 Discovery Log Entry 0 00:23:24.696 ---------------------- 00:23:24.696 Transport Type: 3 (TCP) 00:23:24.696 Address Family: 1 (IPv4) 00:23:24.696 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:24.696 Entry Flags: 00:23:24.696 Duplicate Returned Information: 1 00:23:24.696 Explicit Persistent Connection Support for Discovery: 1 00:23:24.696 Transport Requirements: 00:23:24.696 Secure Channel: Not Required 00:23:24.696 Port ID: 0 (0x0000) 00:23:24.696 Controller ID: 65535 (0xffff) 00:23:24.696 Admin Max SQ Size: 128 00:23:24.696 Transport Service Identifier: 4420 00:23:24.696 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:24.696 Transport Address: 10.0.0.2 00:23:24.696 Discovery Log Entry 1 00:23:24.696 ---------------------- 00:23:24.696 Transport Type: 3 (TCP) 00:23:24.696 Address Family: 1 (IPv4) 00:23:24.697 Subsystem Type: 2 (NVM Subsystem) 00:23:24.697 Entry Flags: 00:23:24.697 Duplicate Returned Information: 0 00:23:24.697 Explicit Persistent Connection Support for Discovery: 0 00:23:24.697 Transport Requirements: 00:23:24.697 Secure Channel: Not Required 00:23:24.697 Port ID: 0 (0x0000) 00:23:24.697 Controller ID: 65535 (0xffff) 00:23:24.697 Admin Max SQ Size: 128 00:23:24.697 Transport Service Identifier: 4420 00:23:24.697 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:24.697 Transport Address: 10.0.0.2 [2024-11-19 01:59:13.090883] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:24.697 [2024-11-19 01:59:13.090908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.697 [2024-11-19 01:59:13.090921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.697 [2024-11-19 01:59:13.090930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.697 [2024-11-19 01:59:13.090940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.697 [2024-11-19 01:59:13.090953] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.090961] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.090968] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.090979] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.091005] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.091141] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.091154] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.091162] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091168] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.091181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091189] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091195] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.091206] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.091232] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.091385] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.091398] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.091405] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091411] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.091421] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:24.697 [2024-11-19 01:59:13.091429] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:24.697 [2024-11-19 01:59:13.091444] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091456] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091463] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.091474] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.091495] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.091621] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.091633] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.091649] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091657] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.091674] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091683] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091690] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.091700] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.091721] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.091803] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.091818] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.091825] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091832] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.091849] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091858] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.091864] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.091875] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.091895] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.092001] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.092013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.092020] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092027] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.092043] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092052] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092059] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.092069] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.092089] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.092169] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.092183] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.092190] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092197] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.092214] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092223] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092233] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.092245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.092266] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.092367] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.092379] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.092386] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092392] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.092409] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092418] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092424] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.092435] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.092455] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.092530] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.092542] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.092549] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092555] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.092572] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092581] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.092587] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.092598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.092618] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.096648] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.096665] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.096673] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.096680] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.697 [2024-11-19 01:59:13.096699] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.096709] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.697 [2024-11-19 01:59:13.096716] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xfa3e10) 00:23:24.697 [2024-11-19 01:59:13.096726] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.697 [2024-11-19 01:59:13.096749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1023f50, cid 3, qid 0 00:23:24.697 [2024-11-19 01:59:13.096877] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.697 [2024-11-19 01:59:13.096890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.697 [2024-11-19 01:59:13.096897] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.096903] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1023f50) on tqpair=0xfa3e10 00:23:24.698 [2024-11-19 01:59:13.096917] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:23:24.698 00:23:24.698 01:59:13 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:24.698 [2024-11-19 01:59:13.127074] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:24.698 [2024-11-19 01:59:13.127112] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3520566 ] 00:23:24.698 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.698 [2024-11-19 01:59:13.156936] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:24.698 [2024-11-19 01:59:13.156996] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:24.698 [2024-11-19 01:59:13.157006] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:24.698 [2024-11-19 01:59:13.157020] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:24.698 [2024-11-19 01:59:13.157032] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:24.698 [2024-11-19 01:59:13.160676] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:24.698 [2024-11-19 01:59:13.160729] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xbe7e10 0 00:23:24.698 [2024-11-19 01:59:13.167665] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:24.698 [2024-11-19 01:59:13.167686] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:24.698 [2024-11-19 01:59:13.167694] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:24.698 [2024-11-19 01:59:13.167700] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:24.698 [2024-11-19 01:59:13.167739] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.167751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.167758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.698 [2024-11-19 01:59:13.167772] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:24.698 [2024-11-19 01:59:13.167798] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.698 [2024-11-19 01:59:13.174649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.698 [2024-11-19 01:59:13.174667] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.698 [2024-11-19 01:59:13.174674] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.174681] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.698 [2024-11-19 01:59:13.174695] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:24.698 [2024-11-19 01:59:13.174720] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:24.698 [2024-11-19 01:59:13.174730] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:24.698 [2024-11-19 01:59:13.174747] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.174756] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.174762] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.698 [2024-11-19 01:59:13.174773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.698 [2024-11-19 01:59:13.174797] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.698 [2024-11-19 01:59:13.174923] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.698 [2024-11-19 01:59:13.174938] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.698 [2024-11-19 01:59:13.174944] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.174951] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.698 [2024-11-19 01:59:13.174959] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:24.698 [2024-11-19 01:59:13.174972] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:24.698 [2024-11-19 01:59:13.174984] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.174992] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.174998] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.698 [2024-11-19 01:59:13.175009] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.698 [2024-11-19 01:59:13.175031] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.698 [2024-11-19 01:59:13.175111] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.698 [2024-11-19 01:59:13.175125] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.698 [2024-11-19 01:59:13.175131] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175138] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.698 [2024-11-19 01:59:13.175146] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:24.698 [2024-11-19 01:59:13.175160] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:24.698 [2024-11-19 01:59:13.175172] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175179] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175185] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.698 [2024-11-19 01:59:13.175196] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.698 [2024-11-19 01:59:13.175217] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.698 [2024-11-19 01:59:13.175295] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.698 [2024-11-19 01:59:13.175309] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.698 [2024-11-19 01:59:13.175316] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175322] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.698 [2024-11-19 01:59:13.175331] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:24.698 [2024-11-19 01:59:13.175347] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175356] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175362] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.698 [2024-11-19 01:59:13.175373] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.698 [2024-11-19 01:59:13.175394] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.698 [2024-11-19 01:59:13.175475] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.698 [2024-11-19 01:59:13.175487] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.698 [2024-11-19 01:59:13.175494] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175500] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.698 [2024-11-19 01:59:13.175511] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:24.698 [2024-11-19 01:59:13.175520] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:24.698 [2024-11-19 01:59:13.175533] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:24.698 [2024-11-19 01:59:13.175643] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:24.698 [2024-11-19 01:59:13.175652] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:24.698 [2024-11-19 01:59:13.175665] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175672] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175678] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.698 [2024-11-19 01:59:13.175689] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.698 [2024-11-19 01:59:13.175711] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.698 [2024-11-19 01:59:13.175819] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.698 [2024-11-19 01:59:13.175834] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.698 [2024-11-19 01:59:13.175840] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175846] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.698 [2024-11-19 01:59:13.175855] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:24.698 [2024-11-19 01:59:13.175871] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175880] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.175886] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.698 [2024-11-19 01:59:13.175896] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.698 [2024-11-19 01:59:13.175917] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.698 [2024-11-19 01:59:13.176002] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.698 [2024-11-19 01:59:13.176016] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.698 [2024-11-19 01:59:13.176023] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.698 [2024-11-19 01:59:13.176029] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.698 [2024-11-19 01:59:13.176037] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:24.698 [2024-11-19 01:59:13.176045] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:24.698 [2024-11-19 01:59:13.176057] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:24.699 [2024-11-19 01:59:13.176071] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.176085] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.176093] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.176099] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.176109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.699 [2024-11-19 01:59:13.176135] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.699 [2024-11-19 01:59:13.176254] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.699 [2024-11-19 01:59:13.176268] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.699 [2024-11-19 01:59:13.176275] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.176281] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=4096, cccid=0 00:23:24.699 [2024-11-19 01:59:13.176289] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc67b30) on tqpair(0xbe7e10): expected_datao=0, payload_size=4096 00:23:24.699 [2024-11-19 01:59:13.176312] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.176322] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.217648] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.699 [2024-11-19 01:59:13.217667] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.699 [2024-11-19 01:59:13.217675] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.217682] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.699 [2024-11-19 01:59:13.217694] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:24.699 [2024-11-19 01:59:13.217703] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:24.699 [2024-11-19 01:59:13.217711] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:24.699 [2024-11-19 01:59:13.217717] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:24.699 [2024-11-19 01:59:13.217725] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:24.699 [2024-11-19 01:59:13.217733] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.217753] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.217767] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.217775] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.217781] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.217792] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.699 [2024-11-19 01:59:13.217817] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.699 [2024-11-19 01:59:13.217938] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.699 [2024-11-19 01:59:13.217952] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.699 [2024-11-19 01:59:13.217958] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.217965] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67b30) on tqpair=0xbe7e10 00:23:24.699 [2024-11-19 01:59:13.217975] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.217982] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.217989] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.217999] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.699 [2024-11-19 01:59:13.218009] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218016] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.218036] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.699 [2024-11-19 01:59:13.218046] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218053] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218059] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.218068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.699 [2024-11-19 01:59:13.218078] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.218100] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.699 [2024-11-19 01:59:13.218108] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.218127] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.218154] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218162] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.218178] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.699 [2024-11-19 01:59:13.218200] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67b30, cid 0, qid 0 00:23:24.699 [2024-11-19 01:59:13.218227] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67c90, cid 1, qid 0 00:23:24.699 [2024-11-19 01:59:13.218234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67df0, cid 2, qid 0 00:23:24.699 [2024-11-19 01:59:13.218241] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.699 [2024-11-19 01:59:13.218249] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc680b0, cid 4, qid 0 00:23:24.699 [2024-11-19 01:59:13.218392] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.699 [2024-11-19 01:59:13.218405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.699 [2024-11-19 01:59:13.218411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc680b0) on tqpair=0xbe7e10 00:23:24.699 [2024-11-19 01:59:13.218426] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:24.699 [2024-11-19 01:59:13.218434] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.218447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.218462] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.218474] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218481] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218487] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.218501] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.699 [2024-11-19 01:59:13.218538] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc680b0, cid 4, qid 0 00:23:24.699 [2024-11-19 01:59:13.218710] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.699 [2024-11-19 01:59:13.218725] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.699 [2024-11-19 01:59:13.218732] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218738] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc680b0) on tqpair=0xbe7e10 00:23:24.699 [2024-11-19 01:59:13.218803] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.218822] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:24.699 [2024-11-19 01:59:13.218836] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218844] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.218850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xbe7e10) 00:23:24.699 [2024-11-19 01:59:13.218860] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.699 [2024-11-19 01:59:13.218882] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc680b0, cid 4, qid 0 00:23:24.699 [2024-11-19 01:59:13.219014] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.699 [2024-11-19 01:59:13.219026] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.699 [2024-11-19 01:59:13.219033] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.219039] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=4096, cccid=4 00:23:24.699 [2024-11-19 01:59:13.219046] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc680b0) on tqpair(0xbe7e10): expected_datao=0, payload_size=4096 00:23:24.699 [2024-11-19 01:59:13.219063] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.699 [2024-11-19 01:59:13.219072] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.259738] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.259760] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.259768] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.259775] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc680b0) on tqpair=0xbe7e10 00:23:24.961 [2024-11-19 01:59:13.259797] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:24.961 [2024-11-19 01:59:13.259814] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.259832] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.259846] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.259854] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.259860] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xbe7e10) 00:23:24.961 [2024-11-19 01:59:13.259872] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.961 [2024-11-19 01:59:13.259896] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc680b0, cid 4, qid 0 00:23:24.961 [2024-11-19 01:59:13.260010] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.961 [2024-11-19 01:59:13.260023] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.961 [2024-11-19 01:59:13.260034] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.260041] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=4096, cccid=4 00:23:24.961 [2024-11-19 01:59:13.260048] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc680b0) on tqpair(0xbe7e10): expected_datao=0, payload_size=4096 00:23:24.961 [2024-11-19 01:59:13.260065] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.260075] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.304654] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.304674] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.304682] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.304689] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc680b0) on tqpair=0xbe7e10 00:23:24.961 [2024-11-19 01:59:13.304713] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.304733] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.304748] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.304756] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.304762] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xbe7e10) 00:23:24.961 [2024-11-19 01:59:13.304774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.961 [2024-11-19 01:59:13.304798] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc680b0, cid 4, qid 0 00:23:24.961 [2024-11-19 01:59:13.304930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.961 [2024-11-19 01:59:13.304942] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.961 [2024-11-19 01:59:13.304948] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.304955] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=4096, cccid=4 00:23:24.961 [2024-11-19 01:59:13.304962] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc680b0) on tqpair(0xbe7e10): expected_datao=0, payload_size=4096 00:23:24.961 [2024-11-19 01:59:13.304979] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.304988] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.348651] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.348670] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.348678] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.348684] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc680b0) on tqpair=0xbe7e10 00:23:24.961 [2024-11-19 01:59:13.348698] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.348714] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.348730] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.348741] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.348750] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.348758] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:24.961 [2024-11-19 01:59:13.348769] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:24.961 [2024-11-19 01:59:13.348778] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:24.961 [2024-11-19 01:59:13.348798] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.348807] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.348813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xbe7e10) 00:23:24.961 [2024-11-19 01:59:13.348824] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.961 [2024-11-19 01:59:13.348837] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.348844] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.348850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xbe7e10) 00:23:24.961 [2024-11-19 01:59:13.348859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.961 [2024-11-19 01:59:13.348887] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc680b0, cid 4, qid 0 00:23:24.961 [2024-11-19 01:59:13.348899] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc68210, cid 5, qid 0 00:23:24.961 [2024-11-19 01:59:13.348990] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.349002] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.349008] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349015] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc680b0) on tqpair=0xbe7e10 00:23:24.961 [2024-11-19 01:59:13.349026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.349035] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.349041] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349047] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc68210) on tqpair=0xbe7e10 00:23:24.961 [2024-11-19 01:59:13.349062] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349071] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349077] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xbe7e10) 00:23:24.961 [2024-11-19 01:59:13.349088] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.961 [2024-11-19 01:59:13.349109] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc68210, cid 5, qid 0 00:23:24.961 [2024-11-19 01:59:13.349198] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.349213] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.349219] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349225] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc68210) on tqpair=0xbe7e10 00:23:24.961 [2024-11-19 01:59:13.349241] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349250] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349256] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xbe7e10) 00:23:24.961 [2024-11-19 01:59:13.349266] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.961 [2024-11-19 01:59:13.349286] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc68210, cid 5, qid 0 00:23:24.961 [2024-11-19 01:59:13.349365] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.349384] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.349391] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349398] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc68210) on tqpair=0xbe7e10 00:23:24.961 [2024-11-19 01:59:13.349413] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349422] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.961 [2024-11-19 01:59:13.349428] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xbe7e10) 00:23:24.961 [2024-11-19 01:59:13.349439] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.961 [2024-11-19 01:59:13.349460] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc68210, cid 5, qid 0 00:23:24.961 [2024-11-19 01:59:13.349539] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.961 [2024-11-19 01:59:13.349553] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.961 [2024-11-19 01:59:13.349559] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349566] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc68210) on tqpair=0xbe7e10 00:23:24.962 [2024-11-19 01:59:13.349585] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349595] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349601] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xbe7e10) 00:23:24.962 [2024-11-19 01:59:13.349612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.962 [2024-11-19 01:59:13.349625] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349632] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xbe7e10) 00:23:24.962 [2024-11-19 01:59:13.349658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.962 [2024-11-19 01:59:13.349671] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349678] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349684] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xbe7e10) 00:23:24.962 [2024-11-19 01:59:13.349694] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.962 [2024-11-19 01:59:13.349706] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349713] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349720] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xbe7e10) 00:23:24.962 [2024-11-19 01:59:13.349729] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.962 [2024-11-19 01:59:13.349752] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc68210, cid 5, qid 0 00:23:24.962 [2024-11-19 01:59:13.349764] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc680b0, cid 4, qid 0 00:23:24.962 [2024-11-19 01:59:13.349771] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc68370, cid 6, qid 0 00:23:24.962 [2024-11-19 01:59:13.349778] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc684d0, cid 7, qid 0 00:23:24.962 [2024-11-19 01:59:13.349964] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.962 [2024-11-19 01:59:13.349979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.962 [2024-11-19 01:59:13.349985] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.349996] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=8192, cccid=5 00:23:24.962 [2024-11-19 01:59:13.350004] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc68210) on tqpair(0xbe7e10): expected_datao=0, payload_size=8192 00:23:24.962 [2024-11-19 01:59:13.350036] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350045] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350054] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.962 [2024-11-19 01:59:13.350063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.962 [2024-11-19 01:59:13.350070] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350076] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=512, cccid=4 00:23:24.962 [2024-11-19 01:59:13.350083] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc680b0) on tqpair(0xbe7e10): expected_datao=0, payload_size=512 00:23:24.962 [2024-11-19 01:59:13.350093] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350100] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350109] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.962 [2024-11-19 01:59:13.350117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.962 [2024-11-19 01:59:13.350123] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350129] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=512, cccid=6 00:23:24.962 [2024-11-19 01:59:13.350137] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc68370) on tqpair(0xbe7e10): expected_datao=0, payload_size=512 00:23:24.962 [2024-11-19 01:59:13.350147] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350154] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350162] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.962 [2024-11-19 01:59:13.350171] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.962 [2024-11-19 01:59:13.350177] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350183] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xbe7e10): datao=0, datal=4096, cccid=7 00:23:24.962 [2024-11-19 01:59:13.350190] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc684d0) on tqpair(0xbe7e10): expected_datao=0, payload_size=4096 00:23:24.962 [2024-11-19 01:59:13.350201] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350208] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350219] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.962 [2024-11-19 01:59:13.350228] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.962 [2024-11-19 01:59:13.350235] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350241] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc68210) on tqpair=0xbe7e10 00:23:24.962 [2024-11-19 01:59:13.350261] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.962 [2024-11-19 01:59:13.350272] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.962 [2024-11-19 01:59:13.350278] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350284] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc680b0) on tqpair=0xbe7e10 00:23:24.962 [2024-11-19 01:59:13.350298] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.962 [2024-11-19 01:59:13.350309] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.962 [2024-11-19 01:59:13.350315] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350322] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc68370) on tqpair=0xbe7e10 00:23:24.962 [2024-11-19 01:59:13.350332] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.962 [2024-11-19 01:59:13.350360] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.962 [2024-11-19 01:59:13.350367] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.962 [2024-11-19 01:59:13.350374] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc684d0) on tqpair=0xbe7e10 00:23:24.962 ===================================================== 00:23:24.962 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:24.962 ===================================================== 00:23:24.962 Controller Capabilities/Features 00:23:24.962 ================================ 00:23:24.962 Vendor ID: 8086 00:23:24.962 Subsystem Vendor ID: 8086 00:23:24.962 Serial Number: SPDK00000000000001 00:23:24.962 Model Number: SPDK bdev Controller 00:23:24.962 Firmware Version: 24.01.1 00:23:24.962 Recommended Arb Burst: 6 00:23:24.962 IEEE OUI Identifier: e4 d2 5c 00:23:24.962 Multi-path I/O 00:23:24.962 May have multiple subsystem ports: Yes 00:23:24.962 May have multiple controllers: Yes 00:23:24.962 Associated with SR-IOV VF: No 00:23:24.962 Max Data Transfer Size: 131072 00:23:24.962 Max Number of Namespaces: 32 00:23:24.962 Max Number of I/O Queues: 127 00:23:24.962 NVMe Specification Version (VS): 1.3 00:23:24.962 NVMe Specification Version (Identify): 1.3 00:23:24.962 Maximum Queue Entries: 128 00:23:24.962 Contiguous Queues Required: Yes 00:23:24.962 Arbitration Mechanisms Supported 00:23:24.962 Weighted Round Robin: Not Supported 00:23:24.962 Vendor Specific: Not Supported 00:23:24.962 Reset Timeout: 15000 ms 00:23:24.962 Doorbell Stride: 4 bytes 00:23:24.962 NVM Subsystem Reset: Not Supported 00:23:24.962 Command Sets Supported 00:23:24.962 NVM Command Set: Supported 00:23:24.962 Boot Partition: Not Supported 00:23:24.962 Memory Page Size Minimum: 4096 bytes 00:23:24.962 Memory Page Size Maximum: 4096 bytes 00:23:24.962 Persistent Memory Region: Not Supported 00:23:24.962 Optional Asynchronous Events Supported 00:23:24.962 Namespace Attribute Notices: Supported 00:23:24.962 Firmware Activation Notices: Not Supported 00:23:24.962 ANA Change Notices: Not Supported 00:23:24.962 PLE Aggregate Log Change Notices: Not Supported 00:23:24.962 LBA Status Info Alert Notices: Not Supported 00:23:24.962 EGE Aggregate Log Change Notices: Not Supported 00:23:24.962 Normal NVM Subsystem Shutdown event: Not Supported 00:23:24.962 Zone Descriptor Change Notices: Not Supported 00:23:24.962 Discovery Log Change Notices: Not Supported 00:23:24.962 Controller Attributes 00:23:24.962 128-bit Host Identifier: Supported 00:23:24.962 Non-Operational Permissive Mode: Not Supported 00:23:24.962 NVM Sets: Not Supported 00:23:24.962 Read Recovery Levels: Not Supported 00:23:24.962 Endurance Groups: Not Supported 00:23:24.962 Predictable Latency Mode: Not Supported 00:23:24.962 Traffic Based Keep ALive: Not Supported 00:23:24.962 Namespace Granularity: Not Supported 00:23:24.962 SQ Associations: Not Supported 00:23:24.962 UUID List: Not Supported 00:23:24.962 Multi-Domain Subsystem: Not Supported 00:23:24.962 Fixed Capacity Management: Not Supported 00:23:24.962 Variable Capacity Management: Not Supported 00:23:24.962 Delete Endurance Group: Not Supported 00:23:24.962 Delete NVM Set: Not Supported 00:23:24.962 Extended LBA Formats Supported: Not Supported 00:23:24.962 Flexible Data Placement Supported: Not Supported 00:23:24.962 00:23:24.962 Controller Memory Buffer Support 00:23:24.963 ================================ 00:23:24.963 Supported: No 00:23:24.963 00:23:24.963 Persistent Memory Region Support 00:23:24.963 ================================ 00:23:24.963 Supported: No 00:23:24.963 00:23:24.963 Admin Command Set Attributes 00:23:24.963 ============================ 00:23:24.963 Security Send/Receive: Not Supported 00:23:24.963 Format NVM: Not Supported 00:23:24.963 Firmware Activate/Download: Not Supported 00:23:24.963 Namespace Management: Not Supported 00:23:24.963 Device Self-Test: Not Supported 00:23:24.963 Directives: Not Supported 00:23:24.963 NVMe-MI: Not Supported 00:23:24.963 Virtualization Management: Not Supported 00:23:24.963 Doorbell Buffer Config: Not Supported 00:23:24.963 Get LBA Status Capability: Not Supported 00:23:24.963 Command & Feature Lockdown Capability: Not Supported 00:23:24.963 Abort Command Limit: 4 00:23:24.963 Async Event Request Limit: 4 00:23:24.963 Number of Firmware Slots: N/A 00:23:24.963 Firmware Slot 1 Read-Only: N/A 00:23:24.963 Firmware Activation Without Reset: N/A 00:23:24.963 Multiple Update Detection Support: N/A 00:23:24.963 Firmware Update Granularity: No Information Provided 00:23:24.963 Per-Namespace SMART Log: No 00:23:24.963 Asymmetric Namespace Access Log Page: Not Supported 00:23:24.963 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:24.963 Command Effects Log Page: Supported 00:23:24.963 Get Log Page Extended Data: Supported 00:23:24.963 Telemetry Log Pages: Not Supported 00:23:24.963 Persistent Event Log Pages: Not Supported 00:23:24.963 Supported Log Pages Log Page: May Support 00:23:24.963 Commands Supported & Effects Log Page: Not Supported 00:23:24.963 Feature Identifiers & Effects Log Page:May Support 00:23:24.963 NVMe-MI Commands & Effects Log Page: May Support 00:23:24.963 Data Area 4 for Telemetry Log: Not Supported 00:23:24.963 Error Log Page Entries Supported: 128 00:23:24.963 Keep Alive: Supported 00:23:24.963 Keep Alive Granularity: 10000 ms 00:23:24.963 00:23:24.963 NVM Command Set Attributes 00:23:24.963 ========================== 00:23:24.963 Submission Queue Entry Size 00:23:24.963 Max: 64 00:23:24.963 Min: 64 00:23:24.963 Completion Queue Entry Size 00:23:24.963 Max: 16 00:23:24.963 Min: 16 00:23:24.963 Number of Namespaces: 32 00:23:24.963 Compare Command: Supported 00:23:24.963 Write Uncorrectable Command: Not Supported 00:23:24.963 Dataset Management Command: Supported 00:23:24.963 Write Zeroes Command: Supported 00:23:24.963 Set Features Save Field: Not Supported 00:23:24.963 Reservations: Supported 00:23:24.963 Timestamp: Not Supported 00:23:24.963 Copy: Supported 00:23:24.963 Volatile Write Cache: Present 00:23:24.963 Atomic Write Unit (Normal): 1 00:23:24.963 Atomic Write Unit (PFail): 1 00:23:24.963 Atomic Compare & Write Unit: 1 00:23:24.963 Fused Compare & Write: Supported 00:23:24.963 Scatter-Gather List 00:23:24.963 SGL Command Set: Supported 00:23:24.963 SGL Keyed: Supported 00:23:24.963 SGL Bit Bucket Descriptor: Not Supported 00:23:24.963 SGL Metadata Pointer: Not Supported 00:23:24.963 Oversized SGL: Not Supported 00:23:24.963 SGL Metadata Address: Not Supported 00:23:24.963 SGL Offset: Supported 00:23:24.963 Transport SGL Data Block: Not Supported 00:23:24.963 Replay Protected Memory Block: Not Supported 00:23:24.963 00:23:24.963 Firmware Slot Information 00:23:24.963 ========================= 00:23:24.963 Active slot: 1 00:23:24.963 Slot 1 Firmware Revision: 24.01.1 00:23:24.963 00:23:24.963 00:23:24.963 Commands Supported and Effects 00:23:24.963 ============================== 00:23:24.963 Admin Commands 00:23:24.963 -------------- 00:23:24.963 Get Log Page (02h): Supported 00:23:24.963 Identify (06h): Supported 00:23:24.963 Abort (08h): Supported 00:23:24.963 Set Features (09h): Supported 00:23:24.963 Get Features (0Ah): Supported 00:23:24.963 Asynchronous Event Request (0Ch): Supported 00:23:24.963 Keep Alive (18h): Supported 00:23:24.963 I/O Commands 00:23:24.963 ------------ 00:23:24.963 Flush (00h): Supported LBA-Change 00:23:24.963 Write (01h): Supported LBA-Change 00:23:24.963 Read (02h): Supported 00:23:24.963 Compare (05h): Supported 00:23:24.963 Write Zeroes (08h): Supported LBA-Change 00:23:24.963 Dataset Management (09h): Supported LBA-Change 00:23:24.963 Copy (19h): Supported LBA-Change 00:23:24.963 Unknown (79h): Supported LBA-Change 00:23:24.963 Unknown (7Ah): Supported 00:23:24.963 00:23:24.963 Error Log 00:23:24.963 ========= 00:23:24.963 00:23:24.963 Arbitration 00:23:24.963 =========== 00:23:24.963 Arbitration Burst: 1 00:23:24.963 00:23:24.963 Power Management 00:23:24.963 ================ 00:23:24.963 Number of Power States: 1 00:23:24.963 Current Power State: Power State #0 00:23:24.963 Power State #0: 00:23:24.963 Max Power: 0.00 W 00:23:24.963 Non-Operational State: Operational 00:23:24.963 Entry Latency: Not Reported 00:23:24.963 Exit Latency: Not Reported 00:23:24.963 Relative Read Throughput: 0 00:23:24.963 Relative Read Latency: 0 00:23:24.963 Relative Write Throughput: 0 00:23:24.963 Relative Write Latency: 0 00:23:24.963 Idle Power: Not Reported 00:23:24.963 Active Power: Not Reported 00:23:24.963 Non-Operational Permissive Mode: Not Supported 00:23:24.963 00:23:24.963 Health Information 00:23:24.963 ================== 00:23:24.963 Critical Warnings: 00:23:24.963 Available Spare Space: OK 00:23:24.963 Temperature: OK 00:23:24.963 Device Reliability: OK 00:23:24.963 Read Only: No 00:23:24.963 Volatile Memory Backup: OK 00:23:24.963 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:24.963 Temperature Threshold: [2024-11-19 01:59:13.350497] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.350509] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.350515] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xbe7e10) 00:23:24.963 [2024-11-19 01:59:13.350526] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.963 [2024-11-19 01:59:13.350548] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc684d0, cid 7, qid 0 00:23:24.963 [2024-11-19 01:59:13.350682] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.963 [2024-11-19 01:59:13.350697] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.963 [2024-11-19 01:59:13.350704] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.350711] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc684d0) on tqpair=0xbe7e10 00:23:24.963 [2024-11-19 01:59:13.350751] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:24.963 [2024-11-19 01:59:13.350772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.963 [2024-11-19 01:59:13.350784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.963 [2024-11-19 01:59:13.350793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.963 [2024-11-19 01:59:13.350802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.963 [2024-11-19 01:59:13.350814] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.350822] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.350828] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.963 [2024-11-19 01:59:13.350839] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.963 [2024-11-19 01:59:13.350861] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.963 [2024-11-19 01:59:13.350973] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.963 [2024-11-19 01:59:13.350985] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.963 [2024-11-19 01:59:13.350991] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.350998] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.963 [2024-11-19 01:59:13.351008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.351016] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.351022] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.963 [2024-11-19 01:59:13.351032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.963 [2024-11-19 01:59:13.351058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.963 [2024-11-19 01:59:13.351154] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.963 [2024-11-19 01:59:13.351168] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.963 [2024-11-19 01:59:13.351174] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.963 [2024-11-19 01:59:13.351181] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.963 [2024-11-19 01:59:13.351192] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:24.963 [2024-11-19 01:59:13.351201] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:24.964 [2024-11-19 01:59:13.351216] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351225] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351232] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.351242] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.351263] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.351341] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.351355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.351362] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351368] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.351384] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351393] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351399] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.351409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.351430] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.351508] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.351522] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.351528] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351535] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.351550] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351565] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.351576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.351596] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.351685] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.351700] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.351706] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351713] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.351728] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351737] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351743] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.351754] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.351775] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.351847] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.351859] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.351869] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351876] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.351892] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351901] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.351908] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.351918] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.351939] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.352021] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.352033] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.352040] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352046] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.352062] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352071] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352077] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.352088] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.352108] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.352189] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.352203] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.352210] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352216] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.352232] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352241] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352247] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.352257] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.352278] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.352350] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.352362] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.352369] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352375] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.352390] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352399] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352406] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.352416] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.352436] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.352506] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.352518] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.352524] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352534] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.352551] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352560] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.352566] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.352576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.352597] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.356665] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.356682] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.356689] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.356695] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.356726] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.356736] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.356742] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xbe7e10) 00:23:24.964 [2024-11-19 01:59:13.356753] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.964 [2024-11-19 01:59:13.356776] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc67f50, cid 3, qid 0 00:23:24.964 [2024-11-19 01:59:13.356890] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.964 [2024-11-19 01:59:13.356902] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.964 [2024-11-19 01:59:13.356908] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.964 [2024-11-19 01:59:13.356915] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc67f50) on tqpair=0xbe7e10 00:23:24.964 [2024-11-19 01:59:13.356927] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:23:24.964 0 Kelvin (-273 Celsius) 00:23:24.964 Available Spare: 0% 00:23:24.964 Available Spare Threshold: 0% 00:23:24.964 Life Percentage Used: 0% 00:23:24.964 Data Units Read: 0 00:23:24.964 Data Units Written: 0 00:23:24.964 Host Read Commands: 0 00:23:24.964 Host Write Commands: 0 00:23:24.964 Controller Busy Time: 0 minutes 00:23:24.964 Power Cycles: 0 00:23:24.964 Power On Hours: 0 hours 00:23:24.964 Unsafe Shutdowns: 0 00:23:24.964 Unrecoverable Media Errors: 0 00:23:24.964 Lifetime Error Log Entries: 0 00:23:24.964 Warning Temperature Time: 0 minutes 00:23:24.964 Critical Temperature Time: 0 minutes 00:23:24.964 00:23:24.964 Number of Queues 00:23:24.964 ================ 00:23:24.964 Number of I/O Submission Queues: 127 00:23:24.964 Number of I/O Completion Queues: 127 00:23:24.964 00:23:24.964 Active Namespaces 00:23:24.964 ================= 00:23:24.964 Namespace ID:1 00:23:24.964 Error Recovery Timeout: Unlimited 00:23:24.964 Command Set Identifier: NVM (00h) 00:23:24.964 Deallocate: Supported 00:23:24.964 Deallocated/Unwritten Error: Not Supported 00:23:24.964 Deallocated Read Value: Unknown 00:23:24.964 Deallocate in Write Zeroes: Not Supported 00:23:24.964 Deallocated Guard Field: 0xFFFF 00:23:24.965 Flush: Supported 00:23:24.965 Reservation: Supported 00:23:24.965 Namespace Sharing Capabilities: Multiple Controllers 00:23:24.965 Size (in LBAs): 131072 (0GiB) 00:23:24.965 Capacity (in LBAs): 131072 (0GiB) 00:23:24.965 Utilization (in LBAs): 131072 (0GiB) 00:23:24.965 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:24.965 EUI64: ABCDEF0123456789 00:23:24.965 UUID: 276bf030-8766-4e8e-ab04-7dffc27ce158 00:23:24.965 Thin Provisioning: Not Supported 00:23:24.965 Per-NS Atomic Units: Yes 00:23:24.965 Atomic Boundary Size (Normal): 0 00:23:24.965 Atomic Boundary Size (PFail): 0 00:23:24.965 Atomic Boundary Offset: 0 00:23:24.965 Maximum Single Source Range Length: 65535 00:23:24.965 Maximum Copy Length: 65535 00:23:24.965 Maximum Source Range Count: 1 00:23:24.965 NGUID/EUI64 Never Reused: No 00:23:24.965 Namespace Write Protected: No 00:23:24.965 Number of LBA Formats: 1 00:23:24.965 Current LBA Format: LBA Format #00 00:23:24.965 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:24.965 00:23:24.965 01:59:13 -- host/identify.sh@51 -- # sync 00:23:24.965 01:59:13 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:24.965 01:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.965 01:59:13 -- common/autotest_common.sh@10 -- # set +x 00:23:24.965 01:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.965 01:59:13 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:24.965 01:59:13 -- host/identify.sh@56 -- # nvmftestfini 00:23:24.965 01:59:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:24.965 01:59:13 -- nvmf/common.sh@116 -- # sync 00:23:24.965 01:59:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:24.965 01:59:13 -- nvmf/common.sh@119 -- # set +e 00:23:24.965 01:59:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:24.965 01:59:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:24.965 rmmod nvme_tcp 00:23:24.965 rmmod nvme_fabrics 00:23:24.965 rmmod nvme_keyring 00:23:24.965 01:59:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:24.965 01:59:13 -- nvmf/common.sh@123 -- # set -e 00:23:24.965 01:59:13 -- nvmf/common.sh@124 -- # return 0 00:23:24.965 01:59:13 -- nvmf/common.sh@477 -- # '[' -n 3520366 ']' 00:23:24.965 01:59:13 -- nvmf/common.sh@478 -- # killprocess 3520366 00:23:24.965 01:59:13 -- common/autotest_common.sh@936 -- # '[' -z 3520366 ']' 00:23:24.965 01:59:13 -- common/autotest_common.sh@940 -- # kill -0 3520366 00:23:24.965 01:59:13 -- common/autotest_common.sh@941 -- # uname 00:23:24.965 01:59:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:24.965 01:59:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3520366 00:23:24.965 01:59:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:24.965 01:59:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:24.965 01:59:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3520366' 00:23:24.965 killing process with pid 3520366 00:23:24.965 01:59:13 -- common/autotest_common.sh@955 -- # kill 3520366 00:23:24.965 [2024-11-19 01:59:13.471109] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:24.965 01:59:13 -- common/autotest_common.sh@960 -- # wait 3520366 00:23:25.531 01:59:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:25.531 01:59:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:25.531 01:59:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:25.531 01:59:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:25.531 01:59:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:25.531 01:59:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:25.531 01:59:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:25.531 01:59:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.433 01:59:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:27.434 00:23:27.434 real 0m6.421s 00:23:27.434 user 0m7.907s 00:23:27.434 sys 0m1.924s 00:23:27.434 01:59:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:27.434 01:59:15 -- common/autotest_common.sh@10 -- # set +x 00:23:27.434 ************************************ 00:23:27.434 END TEST nvmf_identify 00:23:27.434 ************************************ 00:23:27.434 01:59:15 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:27.434 01:59:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:27.434 01:59:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:27.434 01:59:15 -- common/autotest_common.sh@10 -- # set +x 00:23:27.434 ************************************ 00:23:27.434 START TEST nvmf_perf 00:23:27.434 ************************************ 00:23:27.434 01:59:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:27.434 * Looking for test storage... 00:23:27.434 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:27.434 01:59:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:27.434 01:59:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:27.434 01:59:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:27.692 01:59:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:27.692 01:59:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:27.692 01:59:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:27.692 01:59:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:27.692 01:59:15 -- scripts/common.sh@335 -- # IFS=.-: 00:23:27.692 01:59:15 -- scripts/common.sh@335 -- # read -ra ver1 00:23:27.692 01:59:15 -- scripts/common.sh@336 -- # IFS=.-: 00:23:27.692 01:59:15 -- scripts/common.sh@336 -- # read -ra ver2 00:23:27.692 01:59:15 -- scripts/common.sh@337 -- # local 'op=<' 00:23:27.692 01:59:15 -- scripts/common.sh@339 -- # ver1_l=2 00:23:27.692 01:59:15 -- scripts/common.sh@340 -- # ver2_l=1 00:23:27.692 01:59:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:27.692 01:59:15 -- scripts/common.sh@343 -- # case "$op" in 00:23:27.692 01:59:15 -- scripts/common.sh@344 -- # : 1 00:23:27.692 01:59:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:27.692 01:59:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:27.692 01:59:15 -- scripts/common.sh@364 -- # decimal 1 00:23:27.692 01:59:15 -- scripts/common.sh@352 -- # local d=1 00:23:27.692 01:59:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:27.692 01:59:15 -- scripts/common.sh@354 -- # echo 1 00:23:27.692 01:59:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:27.692 01:59:15 -- scripts/common.sh@365 -- # decimal 2 00:23:27.692 01:59:15 -- scripts/common.sh@352 -- # local d=2 00:23:27.692 01:59:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:27.692 01:59:15 -- scripts/common.sh@354 -- # echo 2 00:23:27.692 01:59:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:27.692 01:59:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:27.692 01:59:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:27.692 01:59:15 -- scripts/common.sh@367 -- # return 0 00:23:27.692 01:59:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:27.692 01:59:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:27.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.692 --rc genhtml_branch_coverage=1 00:23:27.692 --rc genhtml_function_coverage=1 00:23:27.692 --rc genhtml_legend=1 00:23:27.692 --rc geninfo_all_blocks=1 00:23:27.692 --rc geninfo_unexecuted_blocks=1 00:23:27.692 00:23:27.692 ' 00:23:27.692 01:59:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:27.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.692 --rc genhtml_branch_coverage=1 00:23:27.692 --rc genhtml_function_coverage=1 00:23:27.692 --rc genhtml_legend=1 00:23:27.692 --rc geninfo_all_blocks=1 00:23:27.692 --rc geninfo_unexecuted_blocks=1 00:23:27.692 00:23:27.692 ' 00:23:27.692 01:59:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:27.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.692 --rc genhtml_branch_coverage=1 00:23:27.692 --rc genhtml_function_coverage=1 00:23:27.692 --rc genhtml_legend=1 00:23:27.692 --rc geninfo_all_blocks=1 00:23:27.692 --rc geninfo_unexecuted_blocks=1 00:23:27.692 00:23:27.692 ' 00:23:27.692 01:59:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:27.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.692 --rc genhtml_branch_coverage=1 00:23:27.692 --rc genhtml_function_coverage=1 00:23:27.692 --rc genhtml_legend=1 00:23:27.692 --rc geninfo_all_blocks=1 00:23:27.692 --rc geninfo_unexecuted_blocks=1 00:23:27.692 00:23:27.692 ' 00:23:27.692 01:59:15 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:27.692 01:59:15 -- nvmf/common.sh@7 -- # uname -s 00:23:27.692 01:59:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:27.692 01:59:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:27.692 01:59:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:27.692 01:59:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:27.692 01:59:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:27.692 01:59:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:27.692 01:59:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:27.692 01:59:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:27.692 01:59:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:27.692 01:59:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:27.692 01:59:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:27.692 01:59:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:27.692 01:59:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:27.692 01:59:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:27.692 01:59:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:27.693 01:59:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:27.693 01:59:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:27.693 01:59:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:27.693 01:59:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:27.693 01:59:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.693 01:59:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.693 01:59:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.693 01:59:16 -- paths/export.sh@5 -- # export PATH 00:23:27.693 01:59:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.693 01:59:16 -- nvmf/common.sh@46 -- # : 0 00:23:27.693 01:59:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:27.693 01:59:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:27.693 01:59:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:27.693 01:59:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:27.693 01:59:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:27.693 01:59:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:27.693 01:59:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:27.693 01:59:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:27.693 01:59:16 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:27.693 01:59:16 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:27.693 01:59:16 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:27.693 01:59:16 -- host/perf.sh@17 -- # nvmftestinit 00:23:27.693 01:59:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:27.693 01:59:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:27.693 01:59:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:27.693 01:59:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:27.693 01:59:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:27.693 01:59:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:27.693 01:59:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:27.693 01:59:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.693 01:59:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:27.693 01:59:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:27.693 01:59:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:27.693 01:59:16 -- common/autotest_common.sh@10 -- # set +x 00:23:29.594 01:59:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:29.594 01:59:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:29.594 01:59:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:29.594 01:59:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:29.594 01:59:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:29.594 01:59:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:29.594 01:59:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:29.594 01:59:17 -- nvmf/common.sh@294 -- # net_devs=() 00:23:29.594 01:59:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:29.594 01:59:17 -- nvmf/common.sh@295 -- # e810=() 00:23:29.594 01:59:17 -- nvmf/common.sh@295 -- # local -ga e810 00:23:29.594 01:59:17 -- nvmf/common.sh@296 -- # x722=() 00:23:29.594 01:59:17 -- nvmf/common.sh@296 -- # local -ga x722 00:23:29.594 01:59:17 -- nvmf/common.sh@297 -- # mlx=() 00:23:29.594 01:59:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:29.594 01:59:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:29.594 01:59:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:29.595 01:59:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:29.595 01:59:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:29.595 01:59:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:29.595 01:59:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:29.595 01:59:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:29.595 01:59:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:29.595 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:29.595 01:59:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:29.595 01:59:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:29.595 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:29.595 01:59:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:29.595 01:59:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:29.595 01:59:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:29.595 01:59:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:29.595 01:59:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:29.595 01:59:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:29.595 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:29.595 01:59:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:29.595 01:59:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:29.595 01:59:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:29.595 01:59:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:29.595 01:59:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:29.595 01:59:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:29.595 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:29.595 01:59:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:29.595 01:59:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:29.595 01:59:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:29.595 01:59:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:29.595 01:59:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:29.595 01:59:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:29.595 01:59:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:29.595 01:59:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:29.595 01:59:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:29.595 01:59:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:29.595 01:59:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:29.595 01:59:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:29.595 01:59:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:29.595 01:59:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:29.595 01:59:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:29.595 01:59:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:29.595 01:59:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:29.595 01:59:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:29.595 01:59:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:29.595 01:59:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:29.595 01:59:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:29.595 01:59:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:29.595 01:59:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:29.595 01:59:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:29.595 01:59:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:29.595 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:29.595 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:23:29.595 00:23:29.595 --- 10.0.0.2 ping statistics --- 00:23:29.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:29.595 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:23:29.595 01:59:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:29.595 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:29.595 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:23:29.595 00:23:29.595 --- 10.0.0.1 ping statistics --- 00:23:29.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:29.595 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:23:29.595 01:59:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:29.595 01:59:18 -- nvmf/common.sh@410 -- # return 0 00:23:29.595 01:59:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:29.595 01:59:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:29.595 01:59:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:29.595 01:59:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:29.595 01:59:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:29.595 01:59:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:29.595 01:59:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:29.854 01:59:18 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:29.854 01:59:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:29.854 01:59:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:29.854 01:59:18 -- common/autotest_common.sh@10 -- # set +x 00:23:29.854 01:59:18 -- nvmf/common.sh@469 -- # nvmfpid=3522516 00:23:29.854 01:59:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:29.854 01:59:18 -- nvmf/common.sh@470 -- # waitforlisten 3522516 00:23:29.854 01:59:18 -- common/autotest_common.sh@829 -- # '[' -z 3522516 ']' 00:23:29.854 01:59:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:29.854 01:59:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:29.854 01:59:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:29.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:29.854 01:59:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:29.854 01:59:18 -- common/autotest_common.sh@10 -- # set +x 00:23:29.854 [2024-11-19 01:59:18.200033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:29.854 [2024-11-19 01:59:18.200107] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:29.854 EAL: No free 2048 kB hugepages reported on node 1 00:23:29.854 [2024-11-19 01:59:18.264915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:29.854 [2024-11-19 01:59:18.379612] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:29.854 [2024-11-19 01:59:18.379776] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:29.854 [2024-11-19 01:59:18.379807] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:29.854 [2024-11-19 01:59:18.379820] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:29.854 [2024-11-19 01:59:18.379931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:29.854 [2024-11-19 01:59:18.379975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:29.854 [2024-11-19 01:59:18.380090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:29.854 [2024-11-19 01:59:18.380093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:30.799 01:59:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:30.799 01:59:19 -- common/autotest_common.sh@862 -- # return 0 00:23:30.799 01:59:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:30.799 01:59:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:30.799 01:59:19 -- common/autotest_common.sh@10 -- # set +x 00:23:30.799 01:59:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:30.799 01:59:19 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:30.799 01:59:19 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:34.082 01:59:22 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:34.082 01:59:22 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:34.082 01:59:22 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:34.082 01:59:22 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:34.341 01:59:22 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:34.341 01:59:22 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:34.341 01:59:22 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:34.341 01:59:22 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:34.341 01:59:22 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:34.599 [2024-11-19 01:59:23.079658] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:34.599 01:59:23 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:34.857 01:59:23 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:34.857 01:59:23 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:35.114 01:59:23 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:35.114 01:59:23 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:35.373 01:59:23 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:35.630 [2024-11-19 01:59:24.071417] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:35.631 01:59:24 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:35.888 01:59:24 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:35.888 01:59:24 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:35.888 01:59:24 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:35.889 01:59:24 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:37.262 Initializing NVMe Controllers 00:23:37.262 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:37.262 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:37.262 Initialization complete. Launching workers. 00:23:37.262 ======================================================== 00:23:37.262 Latency(us) 00:23:37.262 Device Information : IOPS MiB/s Average min max 00:23:37.262 PCIE (0000:88:00.0) NSID 1 from core 0: 86483.55 337.83 369.45 45.47 7278.01 00:23:37.262 ======================================================== 00:23:37.262 Total : 86483.55 337.83 369.45 45.47 7278.01 00:23:37.262 00:23:37.262 01:59:25 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:37.262 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.635 Initializing NVMe Controllers 00:23:38.635 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:38.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:38.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:38.635 Initialization complete. Launching workers. 00:23:38.635 ======================================================== 00:23:38.635 Latency(us) 00:23:38.635 Device Information : IOPS MiB/s Average min max 00:23:38.635 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 95.76 0.37 10858.42 145.94 45910.29 00:23:38.635 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 60.85 0.24 16565.14 6016.14 51872.55 00:23:38.635 ======================================================== 00:23:38.635 Total : 156.61 0.61 13075.69 145.94 51872.55 00:23:38.635 00:23:38.635 01:59:26 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:38.635 EAL: No free 2048 kB hugepages reported on node 1 00:23:40.008 Initializing NVMe Controllers 00:23:40.008 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:40.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:40.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:40.008 Initialization complete. Launching workers. 00:23:40.008 ======================================================== 00:23:40.008 Latency(us) 00:23:40.008 Device Information : IOPS MiB/s Average min max 00:23:40.008 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8637.00 33.74 3707.12 537.07 7926.71 00:23:40.008 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3919.00 15.31 8210.61 7059.75 15896.66 00:23:40.008 ======================================================== 00:23:40.008 Total : 12556.00 49.05 5112.76 537.07 15896.66 00:23:40.008 00:23:40.008 01:59:28 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:40.008 01:59:28 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:40.008 01:59:28 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:40.008 EAL: No free 2048 kB hugepages reported on node 1 00:23:42.536 Initializing NVMe Controllers 00:23:42.536 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:42.536 Controller IO queue size 128, less than required. 00:23:42.536 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:42.536 Controller IO queue size 128, less than required. 00:23:42.536 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:42.536 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:42.536 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:42.536 Initialization complete. Launching workers. 00:23:42.536 ======================================================== 00:23:42.536 Latency(us) 00:23:42.536 Device Information : IOPS MiB/s Average min max 00:23:42.536 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1698.49 424.62 76235.51 57808.19 117314.13 00:23:42.536 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 611.50 152.87 223514.77 85194.50 343584.34 00:23:42.536 ======================================================== 00:23:42.536 Total : 2309.99 577.50 115223.07 57808.19 343584.34 00:23:42.536 00:23:42.536 01:59:30 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:42.536 EAL: No free 2048 kB hugepages reported on node 1 00:23:42.536 No valid NVMe controllers or AIO or URING devices found 00:23:42.536 Initializing NVMe Controllers 00:23:42.536 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:42.536 Controller IO queue size 128, less than required. 00:23:42.536 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:42.536 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:42.536 Controller IO queue size 128, less than required. 00:23:42.536 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:42.536 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:42.536 WARNING: Some requested NVMe devices were skipped 00:23:42.536 01:59:30 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:42.536 EAL: No free 2048 kB hugepages reported on node 1 00:23:45.821 Initializing NVMe Controllers 00:23:45.821 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:45.821 Controller IO queue size 128, less than required. 00:23:45.821 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.821 Controller IO queue size 128, less than required. 00:23:45.821 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.821 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:45.821 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:45.821 Initialization complete. Launching workers. 00:23:45.821 00:23:45.821 ==================== 00:23:45.821 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:45.821 TCP transport: 00:23:45.821 polls: 8483 00:23:45.821 idle_polls: 5390 00:23:45.821 sock_completions: 3093 00:23:45.821 nvme_completions: 5811 00:23:45.821 submitted_requests: 8843 00:23:45.821 queued_requests: 1 00:23:45.821 00:23:45.821 ==================== 00:23:45.821 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:45.821 TCP transport: 00:23:45.821 polls: 8738 00:23:45.821 idle_polls: 5731 00:23:45.821 sock_completions: 3007 00:23:45.821 nvme_completions: 5809 00:23:45.821 submitted_requests: 8919 00:23:45.821 queued_requests: 1 00:23:45.821 ======================================================== 00:23:45.821 Latency(us) 00:23:45.821 Device Information : IOPS MiB/s Average min max 00:23:45.821 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1513.48 378.37 87048.30 46610.02 138858.03 00:23:45.821 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1513.48 378.37 85502.66 47101.64 136950.82 00:23:45.821 ======================================================== 00:23:45.821 Total : 3026.96 756.74 86275.48 46610.02 138858.03 00:23:45.821 00:23:45.821 01:59:33 -- host/perf.sh@66 -- # sync 00:23:45.821 01:59:33 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:45.821 01:59:33 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:45.821 01:59:33 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:45.821 01:59:33 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:49.101 01:59:37 -- host/perf.sh@72 -- # ls_guid=437994e9-193d-4f99-8d5c-5eb17b51c7a3 00:23:49.101 01:59:37 -- host/perf.sh@73 -- # get_lvs_free_mb 437994e9-193d-4f99-8d5c-5eb17b51c7a3 00:23:49.101 01:59:37 -- common/autotest_common.sh@1353 -- # local lvs_uuid=437994e9-193d-4f99-8d5c-5eb17b51c7a3 00:23:49.101 01:59:37 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:49.101 01:59:37 -- common/autotest_common.sh@1355 -- # local fc 00:23:49.101 01:59:37 -- common/autotest_common.sh@1356 -- # local cs 00:23:49.101 01:59:37 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:49.101 01:59:37 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:49.101 { 00:23:49.101 "uuid": "437994e9-193d-4f99-8d5c-5eb17b51c7a3", 00:23:49.101 "name": "lvs_0", 00:23:49.101 "base_bdev": "Nvme0n1", 00:23:49.101 "total_data_clusters": 238234, 00:23:49.101 "free_clusters": 238234, 00:23:49.101 "block_size": 512, 00:23:49.102 "cluster_size": 4194304 00:23:49.102 } 00:23:49.102 ]' 00:23:49.102 01:59:37 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="437994e9-193d-4f99-8d5c-5eb17b51c7a3") .free_clusters' 00:23:49.102 01:59:37 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:49.102 01:59:37 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="437994e9-193d-4f99-8d5c-5eb17b51c7a3") .cluster_size' 00:23:49.102 01:59:37 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:49.102 01:59:37 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:49.102 01:59:37 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:49.102 952936 00:23:49.102 01:59:37 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:49.102 01:59:37 -- host/perf.sh@78 -- # free_mb=20480 00:23:49.102 01:59:37 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 437994e9-193d-4f99-8d5c-5eb17b51c7a3 lbd_0 20480 00:23:49.667 01:59:38 -- host/perf.sh@80 -- # lb_guid=6174ccdf-c55d-4527-81e3-61a50cdbbdb0 00:23:49.667 01:59:38 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 6174ccdf-c55d-4527-81e3-61a50cdbbdb0 lvs_n_0 00:23:50.601 01:59:38 -- host/perf.sh@83 -- # ls_nested_guid=1d5a9b05-93ee-40ba-88ad-38b2ee7dd554 00:23:50.601 01:59:38 -- host/perf.sh@84 -- # get_lvs_free_mb 1d5a9b05-93ee-40ba-88ad-38b2ee7dd554 00:23:50.601 01:59:38 -- common/autotest_common.sh@1353 -- # local lvs_uuid=1d5a9b05-93ee-40ba-88ad-38b2ee7dd554 00:23:50.601 01:59:38 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:50.601 01:59:38 -- common/autotest_common.sh@1355 -- # local fc 00:23:50.601 01:59:38 -- common/autotest_common.sh@1356 -- # local cs 00:23:50.601 01:59:38 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:50.858 01:59:39 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:50.858 { 00:23:50.858 "uuid": "437994e9-193d-4f99-8d5c-5eb17b51c7a3", 00:23:50.858 "name": "lvs_0", 00:23:50.858 "base_bdev": "Nvme0n1", 00:23:50.858 "total_data_clusters": 238234, 00:23:50.858 "free_clusters": 233114, 00:23:50.858 "block_size": 512, 00:23:50.858 "cluster_size": 4194304 00:23:50.858 }, 00:23:50.858 { 00:23:50.858 "uuid": "1d5a9b05-93ee-40ba-88ad-38b2ee7dd554", 00:23:50.858 "name": "lvs_n_0", 00:23:50.858 "base_bdev": "6174ccdf-c55d-4527-81e3-61a50cdbbdb0", 00:23:50.858 "total_data_clusters": 5114, 00:23:50.858 "free_clusters": 5114, 00:23:50.858 "block_size": 512, 00:23:50.858 "cluster_size": 4194304 00:23:50.858 } 00:23:50.858 ]' 00:23:50.858 01:59:39 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="1d5a9b05-93ee-40ba-88ad-38b2ee7dd554") .free_clusters' 00:23:50.858 01:59:39 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:50.858 01:59:39 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="1d5a9b05-93ee-40ba-88ad-38b2ee7dd554") .cluster_size' 00:23:50.858 01:59:39 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:50.858 01:59:39 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:50.858 01:59:39 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:50.858 20456 00:23:50.858 01:59:39 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:50.858 01:59:39 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1d5a9b05-93ee-40ba-88ad-38b2ee7dd554 lbd_nest_0 20456 00:23:51.114 01:59:39 -- host/perf.sh@88 -- # lb_nested_guid=56f34614-0b2d-4af7-b61a-068a9e3149b3 00:23:51.114 01:59:39 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:51.372 01:59:39 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:51.372 01:59:39 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 56f34614-0b2d-4af7-b61a-068a9e3149b3 00:23:51.630 01:59:39 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:51.889 01:59:40 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:51.889 01:59:40 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:51.889 01:59:40 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:51.889 01:59:40 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:51.889 01:59:40 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:51.889 EAL: No free 2048 kB hugepages reported on node 1 00:24:04.084 Initializing NVMe Controllers 00:24:04.084 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:04.084 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:04.084 Initialization complete. Launching workers. 00:24:04.084 ======================================================== 00:24:04.084 Latency(us) 00:24:04.084 Device Information : IOPS MiB/s Average min max 00:24:04.084 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.29 0.02 21689.50 185.91 45826.56 00:24:04.084 ======================================================== 00:24:04.084 Total : 46.29 0.02 21689.50 185.91 45826.56 00:24:04.084 00:24:04.084 01:59:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:04.084 01:59:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:04.084 EAL: No free 2048 kB hugepages reported on node 1 00:24:14.051 Initializing NVMe Controllers 00:24:14.051 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:14.051 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:14.051 Initialization complete. Launching workers. 00:24:14.051 ======================================================== 00:24:14.051 Latency(us) 00:24:14.051 Device Information : IOPS MiB/s Average min max 00:24:14.051 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 71.70 8.96 13956.95 5981.70 54857.47 00:24:14.051 ======================================================== 00:24:14.051 Total : 71.70 8.96 13956.95 5981.70 54857.47 00:24:14.051 00:24:14.051 02:00:00 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:14.051 02:00:00 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:14.051 02:00:00 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:14.051 EAL: No free 2048 kB hugepages reported on node 1 00:24:24.091 Initializing NVMe Controllers 00:24:24.092 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:24.092 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:24.092 Initialization complete. Launching workers. 00:24:24.092 ======================================================== 00:24:24.092 Latency(us) 00:24:24.092 Device Information : IOPS MiB/s Average min max 00:24:24.092 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7792.62 3.80 4106.01 281.15 12103.03 00:24:24.092 ======================================================== 00:24:24.092 Total : 7792.62 3.80 4106.01 281.15 12103.03 00:24:24.092 00:24:24.092 02:00:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:24.092 02:00:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:24.092 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.059 Initializing NVMe Controllers 00:24:34.059 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:34.059 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:34.059 Initialization complete. Launching workers. 00:24:34.059 ======================================================== 00:24:34.059 Latency(us) 00:24:34.059 Device Information : IOPS MiB/s Average min max 00:24:34.059 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4022.11 502.76 7956.60 930.37 17684.94 00:24:34.059 ======================================================== 00:24:34.059 Total : 4022.11 502.76 7956.60 930.37 17684.94 00:24:34.059 00:24:34.059 02:00:21 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:34.059 02:00:21 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:34.059 02:00:21 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:34.059 EAL: No free 2048 kB hugepages reported on node 1 00:24:44.019 Initializing NVMe Controllers 00:24:44.019 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:44.019 Controller IO queue size 128, less than required. 00:24:44.019 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:44.019 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:44.019 Initialization complete. Launching workers. 00:24:44.019 ======================================================== 00:24:44.019 Latency(us) 00:24:44.019 Device Information : IOPS MiB/s Average min max 00:24:44.019 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12054.45 5.89 10620.33 1800.73 31185.84 00:24:44.019 ======================================================== 00:24:44.019 Total : 12054.45 5.89 10620.33 1800.73 31185.84 00:24:44.019 00:24:44.019 02:00:31 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:44.019 02:00:31 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:44.019 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.986 Initializing NVMe Controllers 00:24:53.986 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:53.986 Controller IO queue size 128, less than required. 00:24:53.986 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:53.986 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:53.986 Initialization complete. Launching workers. 00:24:53.986 ======================================================== 00:24:53.986 Latency(us) 00:24:53.986 Device Information : IOPS MiB/s Average min max 00:24:53.986 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1177.50 147.19 109471.63 15972.94 238182.41 00:24:53.986 ======================================================== 00:24:53.986 Total : 1177.50 147.19 109471.63 15972.94 238182.41 00:24:53.986 00:24:53.986 02:00:42 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:53.986 02:00:42 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 56f34614-0b2d-4af7-b61a-068a9e3149b3 00:24:54.917 02:00:43 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:54.917 02:00:43 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 6174ccdf-c55d-4527-81e3-61a50cdbbdb0 00:24:55.481 02:00:43 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:55.481 02:00:44 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:55.481 02:00:44 -- host/perf.sh@114 -- # nvmftestfini 00:24:55.481 02:00:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:55.481 02:00:44 -- nvmf/common.sh@116 -- # sync 00:24:55.481 02:00:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:55.481 02:00:44 -- nvmf/common.sh@119 -- # set +e 00:24:55.481 02:00:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:55.481 02:00:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:55.481 rmmod nvme_tcp 00:24:55.739 rmmod nvme_fabrics 00:24:55.739 rmmod nvme_keyring 00:24:55.739 02:00:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:55.739 02:00:44 -- nvmf/common.sh@123 -- # set -e 00:24:55.739 02:00:44 -- nvmf/common.sh@124 -- # return 0 00:24:55.739 02:00:44 -- nvmf/common.sh@477 -- # '[' -n 3522516 ']' 00:24:55.739 02:00:44 -- nvmf/common.sh@478 -- # killprocess 3522516 00:24:55.739 02:00:44 -- common/autotest_common.sh@936 -- # '[' -z 3522516 ']' 00:24:55.739 02:00:44 -- common/autotest_common.sh@940 -- # kill -0 3522516 00:24:55.739 02:00:44 -- common/autotest_common.sh@941 -- # uname 00:24:55.739 02:00:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:55.739 02:00:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3522516 00:24:55.739 02:00:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:55.739 02:00:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:55.739 02:00:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3522516' 00:24:55.739 killing process with pid 3522516 00:24:55.739 02:00:44 -- common/autotest_common.sh@955 -- # kill 3522516 00:24:55.739 02:00:44 -- common/autotest_common.sh@960 -- # wait 3522516 00:24:57.638 02:00:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:57.638 02:00:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:57.638 02:00:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:57.638 02:00:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:57.638 02:00:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:57.638 02:00:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:57.638 02:00:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:57.638 02:00:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:59.543 02:00:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:59.543 00:24:59.543 real 1m31.978s 00:24:59.543 user 5m41.160s 00:24:59.543 sys 0m15.226s 00:24:59.543 02:00:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:59.543 02:00:47 -- common/autotest_common.sh@10 -- # set +x 00:24:59.543 ************************************ 00:24:59.543 END TEST nvmf_perf 00:24:59.543 ************************************ 00:24:59.543 02:00:47 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:59.543 02:00:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:59.543 02:00:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:59.543 02:00:47 -- common/autotest_common.sh@10 -- # set +x 00:24:59.543 ************************************ 00:24:59.543 START TEST nvmf_fio_host 00:24:59.543 ************************************ 00:24:59.543 02:00:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:59.543 * Looking for test storage... 00:24:59.543 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:59.543 02:00:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:59.543 02:00:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:59.543 02:00:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:59.543 02:00:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:59.543 02:00:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:59.543 02:00:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:59.543 02:00:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:59.543 02:00:47 -- scripts/common.sh@335 -- # IFS=.-: 00:24:59.543 02:00:47 -- scripts/common.sh@335 -- # read -ra ver1 00:24:59.543 02:00:47 -- scripts/common.sh@336 -- # IFS=.-: 00:24:59.543 02:00:47 -- scripts/common.sh@336 -- # read -ra ver2 00:24:59.543 02:00:47 -- scripts/common.sh@337 -- # local 'op=<' 00:24:59.543 02:00:47 -- scripts/common.sh@339 -- # ver1_l=2 00:24:59.543 02:00:47 -- scripts/common.sh@340 -- # ver2_l=1 00:24:59.543 02:00:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:59.543 02:00:47 -- scripts/common.sh@343 -- # case "$op" in 00:24:59.543 02:00:47 -- scripts/common.sh@344 -- # : 1 00:24:59.543 02:00:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:59.543 02:00:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:59.543 02:00:47 -- scripts/common.sh@364 -- # decimal 1 00:24:59.543 02:00:47 -- scripts/common.sh@352 -- # local d=1 00:24:59.543 02:00:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:59.543 02:00:47 -- scripts/common.sh@354 -- # echo 1 00:24:59.543 02:00:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:59.543 02:00:47 -- scripts/common.sh@365 -- # decimal 2 00:24:59.543 02:00:47 -- scripts/common.sh@352 -- # local d=2 00:24:59.543 02:00:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:59.543 02:00:47 -- scripts/common.sh@354 -- # echo 2 00:24:59.543 02:00:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:59.543 02:00:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:59.543 02:00:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:59.543 02:00:47 -- scripts/common.sh@367 -- # return 0 00:24:59.543 02:00:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:59.543 02:00:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:59.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:59.543 --rc genhtml_branch_coverage=1 00:24:59.543 --rc genhtml_function_coverage=1 00:24:59.543 --rc genhtml_legend=1 00:24:59.543 --rc geninfo_all_blocks=1 00:24:59.543 --rc geninfo_unexecuted_blocks=1 00:24:59.543 00:24:59.543 ' 00:24:59.543 02:00:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:59.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:59.543 --rc genhtml_branch_coverage=1 00:24:59.543 --rc genhtml_function_coverage=1 00:24:59.543 --rc genhtml_legend=1 00:24:59.543 --rc geninfo_all_blocks=1 00:24:59.543 --rc geninfo_unexecuted_blocks=1 00:24:59.543 00:24:59.543 ' 00:24:59.543 02:00:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:59.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:59.543 --rc genhtml_branch_coverage=1 00:24:59.543 --rc genhtml_function_coverage=1 00:24:59.543 --rc genhtml_legend=1 00:24:59.543 --rc geninfo_all_blocks=1 00:24:59.543 --rc geninfo_unexecuted_blocks=1 00:24:59.543 00:24:59.543 ' 00:24:59.543 02:00:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:59.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:59.543 --rc genhtml_branch_coverage=1 00:24:59.543 --rc genhtml_function_coverage=1 00:24:59.543 --rc genhtml_legend=1 00:24:59.543 --rc geninfo_all_blocks=1 00:24:59.543 --rc geninfo_unexecuted_blocks=1 00:24:59.543 00:24:59.543 ' 00:24:59.543 02:00:47 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:59.543 02:00:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:59.543 02:00:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:59.543 02:00:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:59.543 02:00:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.543 02:00:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.543 02:00:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.543 02:00:47 -- paths/export.sh@5 -- # export PATH 00:24:59.543 02:00:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.543 02:00:47 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:59.543 02:00:48 -- nvmf/common.sh@7 -- # uname -s 00:24:59.543 02:00:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:59.543 02:00:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:59.543 02:00:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:59.543 02:00:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:59.543 02:00:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:59.543 02:00:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:59.543 02:00:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:59.543 02:00:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:59.543 02:00:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:59.543 02:00:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:59.543 02:00:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:59.543 02:00:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:59.543 02:00:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:59.543 02:00:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:59.543 02:00:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:59.543 02:00:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:59.543 02:00:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:59.543 02:00:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:59.543 02:00:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:59.543 02:00:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.543 02:00:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.543 02:00:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.543 02:00:48 -- paths/export.sh@5 -- # export PATH 00:24:59.544 02:00:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:59.544 02:00:48 -- nvmf/common.sh@46 -- # : 0 00:24:59.544 02:00:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:59.544 02:00:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:59.544 02:00:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:59.544 02:00:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:59.544 02:00:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:59.544 02:00:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:59.544 02:00:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:59.544 02:00:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:59.544 02:00:48 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:59.544 02:00:48 -- host/fio.sh@14 -- # nvmftestinit 00:24:59.544 02:00:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:59.544 02:00:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:59.544 02:00:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:59.544 02:00:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:59.544 02:00:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:59.544 02:00:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.544 02:00:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.544 02:00:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:59.544 02:00:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:59.544 02:00:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:59.544 02:00:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:59.544 02:00:48 -- common/autotest_common.sh@10 -- # set +x 00:25:01.446 02:00:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:01.446 02:00:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:01.446 02:00:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:01.446 02:00:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:01.446 02:00:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:01.446 02:00:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:01.446 02:00:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:01.446 02:00:49 -- nvmf/common.sh@294 -- # net_devs=() 00:25:01.446 02:00:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:01.446 02:00:49 -- nvmf/common.sh@295 -- # e810=() 00:25:01.446 02:00:49 -- nvmf/common.sh@295 -- # local -ga e810 00:25:01.446 02:00:49 -- nvmf/common.sh@296 -- # x722=() 00:25:01.446 02:00:49 -- nvmf/common.sh@296 -- # local -ga x722 00:25:01.446 02:00:49 -- nvmf/common.sh@297 -- # mlx=() 00:25:01.446 02:00:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:01.446 02:00:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:01.446 02:00:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:01.446 02:00:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:01.446 02:00:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:01.446 02:00:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:01.446 02:00:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:01.446 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:01.446 02:00:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:01.446 02:00:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:01.446 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:01.446 02:00:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:01.446 02:00:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:01.446 02:00:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:01.446 02:00:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:01.446 02:00:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:01.446 02:00:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:01.446 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:01.446 02:00:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:01.446 02:00:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:01.446 02:00:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:01.446 02:00:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:01.446 02:00:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:01.446 02:00:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:01.446 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:01.446 02:00:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:01.446 02:00:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:01.446 02:00:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:01.446 02:00:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:01.446 02:00:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:01.446 02:00:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:01.446 02:00:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:01.446 02:00:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:01.446 02:00:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:01.446 02:00:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:01.446 02:00:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:01.446 02:00:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:01.446 02:00:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:01.446 02:00:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:01.446 02:00:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:01.446 02:00:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:01.446 02:00:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:01.705 02:00:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:01.705 02:00:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:01.705 02:00:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:01.705 02:00:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:01.705 02:00:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:01.705 02:00:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:01.705 02:00:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:01.705 02:00:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:01.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:01.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.371 ms 00:25:01.705 00:25:01.705 --- 10.0.0.2 ping statistics --- 00:25:01.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:01.705 rtt min/avg/max/mdev = 0.371/0.371/0.371/0.000 ms 00:25:01.705 02:00:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:01.705 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:01.705 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:25:01.705 00:25:01.705 --- 10.0.0.1 ping statistics --- 00:25:01.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:01.705 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:25:01.705 02:00:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:01.705 02:00:50 -- nvmf/common.sh@410 -- # return 0 00:25:01.705 02:00:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:01.705 02:00:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:01.705 02:00:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:01.705 02:00:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:01.705 02:00:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:01.705 02:00:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:01.705 02:00:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:01.705 02:00:50 -- host/fio.sh@16 -- # [[ y != y ]] 00:25:01.705 02:00:50 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:25:01.705 02:00:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:01.705 02:00:50 -- common/autotest_common.sh@10 -- # set +x 00:25:01.705 02:00:50 -- host/fio.sh@24 -- # nvmfpid=3535598 00:25:01.705 02:00:50 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:01.705 02:00:50 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:01.705 02:00:50 -- host/fio.sh@28 -- # waitforlisten 3535598 00:25:01.705 02:00:50 -- common/autotest_common.sh@829 -- # '[' -z 3535598 ']' 00:25:01.705 02:00:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:01.705 02:00:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:01.705 02:00:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:01.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:01.705 02:00:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:01.705 02:00:50 -- common/autotest_common.sh@10 -- # set +x 00:25:01.705 [2024-11-19 02:00:50.208539] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:01.705 [2024-11-19 02:00:50.208616] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:01.705 EAL: No free 2048 kB hugepages reported on node 1 00:25:01.963 [2024-11-19 02:00:50.278803] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:01.963 [2024-11-19 02:00:50.392158] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:01.963 [2024-11-19 02:00:50.392325] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:01.963 [2024-11-19 02:00:50.392344] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:01.963 [2024-11-19 02:00:50.392365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:01.963 [2024-11-19 02:00:50.392432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:01.963 [2024-11-19 02:00:50.392484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:01.963 [2024-11-19 02:00:50.392532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:01.963 [2024-11-19 02:00:50.392534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:02.895 02:00:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:02.895 02:00:51 -- common/autotest_common.sh@862 -- # return 0 00:25:02.895 02:00:51 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:03.154 [2024-11-19 02:00:51.448083] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:03.154 02:00:51 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:25:03.154 02:00:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:03.154 02:00:51 -- common/autotest_common.sh@10 -- # set +x 00:25:03.154 02:00:51 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:25:03.412 Malloc1 00:25:03.412 02:00:51 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:03.670 02:00:52 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:03.927 02:00:52 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:03.927 [2024-11-19 02:00:52.468771] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:04.184 02:00:52 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:04.441 02:00:52 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:25:04.441 02:00:52 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.441 02:00:52 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.441 02:00:52 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:04.441 02:00:52 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:04.441 02:00:52 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:04.441 02:00:52 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.441 02:00:52 -- common/autotest_common.sh@1330 -- # shift 00:25:04.441 02:00:52 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:04.441 02:00:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:04.441 02:00:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:04.441 02:00:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:04.441 02:00:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:04.441 02:00:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:04.441 02:00:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:04.441 02:00:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.441 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:04.441 fio-3.35 00:25:04.441 Starting 1 thread 00:25:04.699 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.226 00:25:07.226 test: (groupid=0, jobs=1): err= 0: pid=3536097: Tue Nov 19 02:00:55 2024 00:25:07.226 read: IOPS=9654, BW=37.7MiB/s (39.5MB/s)(75.7MiB/2006msec) 00:25:07.226 slat (nsec): min=1848, max=102682, avg=2374.08, stdev=1324.77 00:25:07.226 clat (usec): min=2220, max=12111, avg=7284.95, stdev=575.07 00:25:07.226 lat (usec): min=2240, max=12113, avg=7287.32, stdev=574.99 00:25:07.226 clat percentiles (usec): 00:25:07.226 | 1.00th=[ 5997], 5.00th=[ 6390], 10.00th=[ 6587], 20.00th=[ 6849], 00:25:07.226 | 30.00th=[ 7046], 40.00th=[ 7177], 50.00th=[ 7308], 60.00th=[ 7439], 00:25:07.226 | 70.00th=[ 7570], 80.00th=[ 7767], 90.00th=[ 7963], 95.00th=[ 8160], 00:25:07.226 | 99.00th=[ 8586], 99.50th=[ 8717], 99.90th=[10814], 99.95th=[11338], 00:25:07.226 | 99.99th=[11994] 00:25:07.226 bw ( KiB/s): min=37432, max=39312, per=99.95%, avg=38600.00, stdev=843.89, samples=4 00:25:07.226 iops : min= 9358, max= 9828, avg=9650.00, stdev=210.97, samples=4 00:25:07.226 write: IOPS=9661, BW=37.7MiB/s (39.6MB/s)(75.7MiB/2006msec); 0 zone resets 00:25:07.226 slat (nsec): min=1934, max=88764, avg=2494.85, stdev=1224.77 00:25:07.226 clat (usec): min=905, max=10974, avg=5909.12, stdev=483.05 00:25:07.226 lat (usec): min=911, max=10977, avg=5911.62, stdev=483.01 00:25:07.226 clat percentiles (usec): 00:25:07.226 | 1.00th=[ 4817], 5.00th=[ 5211], 10.00th=[ 5342], 20.00th=[ 5538], 00:25:07.226 | 30.00th=[ 5669], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 5997], 00:25:07.226 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6456], 95.00th=[ 6587], 00:25:07.226 | 99.00th=[ 6980], 99.50th=[ 7111], 99.90th=[ 9241], 99.95th=[10552], 00:25:07.226 | 99.99th=[10945] 00:25:07.226 bw ( KiB/s): min=38160, max=39096, per=99.99%, avg=38642.00, stdev=396.48, samples=4 00:25:07.226 iops : min= 9540, max= 9774, avg=9660.50, stdev=99.12, samples=4 00:25:07.226 lat (usec) : 1000=0.01% 00:25:07.226 lat (msec) : 2=0.02%, 4=0.11%, 10=99.79%, 20=0.08% 00:25:07.226 cpu : usr=64.89%, sys=32.97%, ctx=73, majf=0, minf=41 00:25:07.226 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:07.226 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:07.226 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:07.226 issued rwts: total=19367,19381,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:07.226 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:07.226 00:25:07.226 Run status group 0 (all jobs): 00:25:07.226 READ: bw=37.7MiB/s (39.5MB/s), 37.7MiB/s-37.7MiB/s (39.5MB/s-39.5MB/s), io=75.7MiB (79.3MB), run=2006-2006msec 00:25:07.226 WRITE: bw=37.7MiB/s (39.6MB/s), 37.7MiB/s-37.7MiB/s (39.6MB/s-39.6MB/s), io=75.7MiB (79.4MB), run=2006-2006msec 00:25:07.227 02:00:55 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:07.227 02:00:55 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:07.227 02:00:55 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:07.227 02:00:55 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:07.227 02:00:55 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:07.227 02:00:55 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.227 02:00:55 -- common/autotest_common.sh@1330 -- # shift 00:25:07.227 02:00:55 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:07.227 02:00:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:07.227 02:00:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:07.227 02:00:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:07.227 02:00:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:07.227 02:00:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:07.227 02:00:55 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:07.227 02:00:55 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:07.227 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:07.227 fio-3.35 00:25:07.227 Starting 1 thread 00:25:07.227 EAL: No free 2048 kB hugepages reported on node 1 00:25:09.756 00:25:09.756 test: (groupid=0, jobs=1): err= 0: pid=3536438: Tue Nov 19 02:00:57 2024 00:25:09.756 read: IOPS=9038, BW=141MiB/s (148MB/s)(283MiB/2004msec) 00:25:09.756 slat (usec): min=2, max=104, avg= 3.67, stdev= 1.85 00:25:09.756 clat (usec): min=1776, max=16364, avg=8379.93, stdev=2032.67 00:25:09.756 lat (usec): min=1781, max=16367, avg=8383.60, stdev=2032.80 00:25:09.756 clat percentiles (usec): 00:25:09.756 | 1.00th=[ 4359], 5.00th=[ 5276], 10.00th=[ 5800], 20.00th=[ 6587], 00:25:09.756 | 30.00th=[ 7177], 40.00th=[ 7701], 50.00th=[ 8291], 60.00th=[ 8848], 00:25:09.756 | 70.00th=[ 9372], 80.00th=[10159], 90.00th=[10945], 95.00th=[11600], 00:25:09.756 | 99.00th=[13960], 99.50th=[14615], 99.90th=[15795], 99.95th=[16057], 00:25:09.756 | 99.99th=[16319] 00:25:09.756 bw ( KiB/s): min=67936, max=76608, per=49.07%, avg=70968.00, stdev=3875.87, samples=4 00:25:09.756 iops : min= 4246, max= 4788, avg=4435.50, stdev=242.24, samples=4 00:25:09.756 write: IOPS=5230, BW=81.7MiB/s (85.7MB/s)(144MiB/1767msec); 0 zone resets 00:25:09.756 slat (usec): min=30, max=189, avg=33.48, stdev= 5.66 00:25:09.756 clat (usec): min=5623, max=17200, avg=10514.04, stdev=1889.97 00:25:09.756 lat (usec): min=5661, max=17232, avg=10547.52, stdev=1890.25 00:25:09.756 clat percentiles (usec): 00:25:09.756 | 1.00th=[ 6849], 5.00th=[ 7832], 10.00th=[ 8455], 20.00th=[ 8979], 00:25:09.756 | 30.00th=[ 9372], 40.00th=[ 9765], 50.00th=[10159], 60.00th=[10683], 00:25:09.756 | 70.00th=[11338], 80.00th=[11994], 90.00th=[13173], 95.00th=[14222], 00:25:09.756 | 99.00th=[15533], 99.50th=[16188], 99.90th=[16581], 99.95th=[16909], 00:25:09.756 | 99.99th=[17171] 00:25:09.756 bw ( KiB/s): min=70720, max=79648, per=88.35%, avg=73936.00, stdev=4027.64, samples=4 00:25:09.756 iops : min= 4420, max= 4978, avg=4621.00, stdev=251.73, samples=4 00:25:09.756 lat (msec) : 2=0.01%, 4=0.41%, 10=66.92%, 20=32.65% 00:25:09.756 cpu : usr=79.74%, sys=18.96%, ctx=44, majf=0, minf=71 00:25:09.756 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:25:09.756 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:09.756 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:09.756 issued rwts: total=18113,9242,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:09.756 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:09.756 00:25:09.756 Run status group 0 (all jobs): 00:25:09.756 READ: bw=141MiB/s (148MB/s), 141MiB/s-141MiB/s (148MB/s-148MB/s), io=283MiB (297MB), run=2004-2004msec 00:25:09.756 WRITE: bw=81.7MiB/s (85.7MB/s), 81.7MiB/s-81.7MiB/s (85.7MB/s-85.7MB/s), io=144MiB (151MB), run=1767-1767msec 00:25:09.756 02:00:57 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:09.756 02:00:57 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:09.756 02:00:57 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:09.756 02:00:57 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:09.756 02:00:57 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:09.756 02:00:57 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:09.756 02:00:57 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:09.756 02:00:57 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:09.756 02:00:57 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:09.756 02:00:58 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:09.756 02:00:58 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:09.756 02:00:58 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:13.036 Nvme0n1 00:25:13.036 02:01:01 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:15.592 02:01:04 -- host/fio.sh@53 -- # ls_guid=ed2b024a-70d1-425f-ac87-0a5103587bff 00:25:15.592 02:01:04 -- host/fio.sh@54 -- # get_lvs_free_mb ed2b024a-70d1-425f-ac87-0a5103587bff 00:25:15.592 02:01:04 -- common/autotest_common.sh@1353 -- # local lvs_uuid=ed2b024a-70d1-425f-ac87-0a5103587bff 00:25:15.593 02:01:04 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:15.593 02:01:04 -- common/autotest_common.sh@1355 -- # local fc 00:25:15.593 02:01:04 -- common/autotest_common.sh@1356 -- # local cs 00:25:15.593 02:01:04 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:15.875 02:01:04 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:15.875 { 00:25:15.875 "uuid": "ed2b024a-70d1-425f-ac87-0a5103587bff", 00:25:15.875 "name": "lvs_0", 00:25:15.875 "base_bdev": "Nvme0n1", 00:25:15.875 "total_data_clusters": 930, 00:25:15.875 "free_clusters": 930, 00:25:15.875 "block_size": 512, 00:25:15.875 "cluster_size": 1073741824 00:25:15.875 } 00:25:15.875 ]' 00:25:15.875 02:01:04 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="ed2b024a-70d1-425f-ac87-0a5103587bff") .free_clusters' 00:25:15.875 02:01:04 -- common/autotest_common.sh@1358 -- # fc=930 00:25:15.875 02:01:04 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="ed2b024a-70d1-425f-ac87-0a5103587bff") .cluster_size' 00:25:15.875 02:01:04 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:15.875 02:01:04 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:15.875 02:01:04 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:15.875 952320 00:25:15.875 02:01:04 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:16.443 8d779408-9c16-4267-b04f-e72cf6151d2f 00:25:16.443 02:01:04 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:16.701 02:01:05 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:16.958 02:01:05 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:17.216 02:01:05 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:17.216 02:01:05 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:17.216 02:01:05 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:17.216 02:01:05 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:17.216 02:01:05 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:17.216 02:01:05 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:17.216 02:01:05 -- common/autotest_common.sh@1330 -- # shift 00:25:17.216 02:01:05 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:17.216 02:01:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:17.216 02:01:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:17.216 02:01:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:17.216 02:01:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:17.216 02:01:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:17.216 02:01:05 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:17.216 02:01:05 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:17.474 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:17.474 fio-3.35 00:25:17.474 Starting 1 thread 00:25:17.474 EAL: No free 2048 kB hugepages reported on node 1 00:25:20.001 00:25:20.001 test: (groupid=0, jobs=1): err= 0: pid=3537834: Tue Nov 19 02:01:08 2024 00:25:20.001 read: IOPS=6459, BW=25.2MiB/s (26.5MB/s)(50.7MiB/2008msec) 00:25:20.001 slat (nsec): min=1890, max=169908, avg=2435.96, stdev=2453.30 00:25:20.001 clat (usec): min=678, max=170663, avg=10853.92, stdev=11250.39 00:25:20.001 lat (usec): min=682, max=170709, avg=10856.36, stdev=11250.75 00:25:20.001 clat percentiles (msec): 00:25:20.001 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:20.001 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:20.001 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:20.001 | 99.00th=[ 12], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:20.001 | 99.99th=[ 171] 00:25:20.001 bw ( KiB/s): min=17952, max=28584, per=99.94%, avg=25824.00, stdev=5250.76, samples=4 00:25:20.001 iops : min= 4488, max= 7146, avg=6456.00, stdev=1312.69, samples=4 00:25:20.001 write: IOPS=6471, BW=25.3MiB/s (26.5MB/s)(50.8MiB/2008msec); 0 zone resets 00:25:20.001 slat (nsec): min=1941, max=141447, avg=2477.25, stdev=1680.96 00:25:20.001 clat (usec): min=354, max=168767, avg=8754.58, stdev=10542.10 00:25:20.001 lat (usec): min=357, max=168775, avg=8757.05, stdev=10542.45 00:25:20.001 clat percentiles (msec): 00:25:20.001 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:20.001 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:20.001 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:25:20.001 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:20.001 | 99.99th=[ 169] 00:25:20.001 bw ( KiB/s): min=18984, max=28296, per=99.87%, avg=25852.00, stdev=4580.05, samples=4 00:25:20.001 iops : min= 4746, max= 7074, avg=6463.00, stdev=1145.01, samples=4 00:25:20.001 lat (usec) : 500=0.01%, 750=0.02%, 1000=0.01% 00:25:20.001 lat (msec) : 2=0.03%, 4=0.15%, 10=72.70%, 20=26.61%, 250=0.49% 00:25:20.001 cpu : usr=62.03%, sys=36.42%, ctx=92, majf=0, minf=41 00:25:20.001 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:20.001 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:20.001 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:20.001 issued rwts: total=12971,12994,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:20.001 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:20.001 00:25:20.001 Run status group 0 (all jobs): 00:25:20.001 READ: bw=25.2MiB/s (26.5MB/s), 25.2MiB/s-25.2MiB/s (26.5MB/s-26.5MB/s), io=50.7MiB (53.1MB), run=2008-2008msec 00:25:20.001 WRITE: bw=25.3MiB/s (26.5MB/s), 25.3MiB/s-25.3MiB/s (26.5MB/s-26.5MB/s), io=50.8MiB (53.2MB), run=2008-2008msec 00:25:20.001 02:01:08 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:20.001 02:01:08 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:21.374 02:01:09 -- host/fio.sh@64 -- # ls_nested_guid=36c81a47-f80e-4e41-8ac7-fa28f9db1761 00:25:21.374 02:01:09 -- host/fio.sh@65 -- # get_lvs_free_mb 36c81a47-f80e-4e41-8ac7-fa28f9db1761 00:25:21.374 02:01:09 -- common/autotest_common.sh@1353 -- # local lvs_uuid=36c81a47-f80e-4e41-8ac7-fa28f9db1761 00:25:21.374 02:01:09 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:21.374 02:01:09 -- common/autotest_common.sh@1355 -- # local fc 00:25:21.374 02:01:09 -- common/autotest_common.sh@1356 -- # local cs 00:25:21.374 02:01:09 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:21.374 02:01:09 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:21.374 { 00:25:21.374 "uuid": "ed2b024a-70d1-425f-ac87-0a5103587bff", 00:25:21.374 "name": "lvs_0", 00:25:21.374 "base_bdev": "Nvme0n1", 00:25:21.374 "total_data_clusters": 930, 00:25:21.374 "free_clusters": 0, 00:25:21.374 "block_size": 512, 00:25:21.374 "cluster_size": 1073741824 00:25:21.374 }, 00:25:21.374 { 00:25:21.374 "uuid": "36c81a47-f80e-4e41-8ac7-fa28f9db1761", 00:25:21.374 "name": "lvs_n_0", 00:25:21.374 "base_bdev": "8d779408-9c16-4267-b04f-e72cf6151d2f", 00:25:21.374 "total_data_clusters": 237847, 00:25:21.374 "free_clusters": 237847, 00:25:21.374 "block_size": 512, 00:25:21.374 "cluster_size": 4194304 00:25:21.374 } 00:25:21.374 ]' 00:25:21.374 02:01:09 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="36c81a47-f80e-4e41-8ac7-fa28f9db1761") .free_clusters' 00:25:21.374 02:01:09 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:21.374 02:01:09 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="36c81a47-f80e-4e41-8ac7-fa28f9db1761") .cluster_size' 00:25:21.374 02:01:09 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:21.374 02:01:09 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:21.374 02:01:09 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:21.374 951388 00:25:21.374 02:01:09 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:22.307 1159724a-7bd1-486f-b02c-720191b638a6 00:25:22.307 02:01:10 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:22.307 02:01:10 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:22.565 02:01:11 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:22.823 02:01:11 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:22.823 02:01:11 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:22.823 02:01:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:22.823 02:01:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:22.823 02:01:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:22.823 02:01:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:22.823 02:01:11 -- common/autotest_common.sh@1330 -- # shift 00:25:22.823 02:01:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:22.823 02:01:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:22.823 02:01:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:22.823 02:01:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:22.823 02:01:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:22.823 02:01:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:22.823 02:01:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:22.823 02:01:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:22.823 02:01:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:22.823 02:01:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:22.823 02:01:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:23.081 02:01:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:23.081 02:01:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:23.081 02:01:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:23.081 02:01:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:23.081 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:23.081 fio-3.35 00:25:23.081 Starting 1 thread 00:25:23.081 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.608 00:25:25.608 test: (groupid=0, jobs=1): err= 0: pid=3538642: Tue Nov 19 02:01:13 2024 00:25:25.608 read: IOPS=6265, BW=24.5MiB/s (25.7MB/s)(49.2MiB/2009msec) 00:25:25.608 slat (nsec): min=1950, max=153405, avg=2567.08, stdev=1967.81 00:25:25.608 clat (usec): min=4118, max=18802, avg=11252.63, stdev=995.78 00:25:25.608 lat (usec): min=4122, max=18805, avg=11255.20, stdev=995.69 00:25:25.608 clat percentiles (usec): 00:25:25.608 | 1.00th=[ 8848], 5.00th=[ 9634], 10.00th=[10028], 20.00th=[10552], 00:25:25.608 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11207], 60.00th=[11469], 00:25:25.608 | 70.00th=[11731], 80.00th=[11994], 90.00th=[12518], 95.00th=[12780], 00:25:25.608 | 99.00th=[13435], 99.50th=[13698], 99.90th=[16450], 99.95th=[18482], 00:25:25.608 | 99.99th=[18744] 00:25:25.608 bw ( KiB/s): min=23488, max=25736, per=99.82%, avg=25016.00, stdev=1031.37, samples=4 00:25:25.608 iops : min= 5872, max= 6434, avg=6254.00, stdev=257.84, samples=4 00:25:25.608 write: IOPS=6248, BW=24.4MiB/s (25.6MB/s)(49.0MiB/2009msec); 0 zone resets 00:25:25.608 slat (nsec): min=2062, max=91519, avg=2603.02, stdev=1225.81 00:25:25.608 clat (usec): min=1934, max=16343, avg=9035.74, stdev=838.57 00:25:25.608 lat (usec): min=1939, max=16346, avg=9038.34, stdev=838.54 00:25:25.608 clat percentiles (usec): 00:25:25.608 | 1.00th=[ 7046], 5.00th=[ 7767], 10.00th=[ 8029], 20.00th=[ 8455], 00:25:25.608 | 30.00th=[ 8586], 40.00th=[ 8848], 50.00th=[ 8979], 60.00th=[ 9241], 00:25:25.608 | 70.00th=[ 9503], 80.00th=[ 9634], 90.00th=[10028], 95.00th=[10290], 00:25:25.608 | 99.00th=[10814], 99.50th=[11076], 99.90th=[14615], 99.95th=[15008], 00:25:25.608 | 99.99th=[16188] 00:25:25.608 bw ( KiB/s): min=24656, max=25336, per=100.00%, avg=25012.00, stdev=283.71, samples=4 00:25:25.608 iops : min= 6164, max= 6334, avg=6253.00, stdev=70.93, samples=4 00:25:25.608 lat (msec) : 2=0.01%, 4=0.04%, 10=49.29%, 20=50.67% 00:25:25.608 cpu : usr=61.80%, sys=36.60%, ctx=106, majf=0, minf=41 00:25:25.608 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:25.608 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:25.608 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:25.608 issued rwts: total=12587,12554,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:25.608 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:25.608 00:25:25.608 Run status group 0 (all jobs): 00:25:25.608 READ: bw=24.5MiB/s (25.7MB/s), 24.5MiB/s-24.5MiB/s (25.7MB/s-25.7MB/s), io=49.2MiB (51.6MB), run=2009-2009msec 00:25:25.608 WRITE: bw=24.4MiB/s (25.6MB/s), 24.4MiB/s-24.4MiB/s (25.6MB/s-25.6MB/s), io=49.0MiB (51.4MB), run=2009-2009msec 00:25:25.608 02:01:13 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:25.608 02:01:14 -- host/fio.sh@74 -- # sync 00:25:25.608 02:01:14 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:29.789 02:01:17 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:29.789 02:01:18 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:33.066 02:01:21 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:33.066 02:01:21 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:34.963 02:01:23 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:34.963 02:01:23 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:34.963 02:01:23 -- host/fio.sh@86 -- # nvmftestfini 00:25:34.963 02:01:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:34.963 02:01:23 -- nvmf/common.sh@116 -- # sync 00:25:34.963 02:01:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:34.963 02:01:23 -- nvmf/common.sh@119 -- # set +e 00:25:34.963 02:01:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:34.963 02:01:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:34.963 rmmod nvme_tcp 00:25:34.963 rmmod nvme_fabrics 00:25:34.963 rmmod nvme_keyring 00:25:34.963 02:01:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:34.963 02:01:23 -- nvmf/common.sh@123 -- # set -e 00:25:34.963 02:01:23 -- nvmf/common.sh@124 -- # return 0 00:25:34.963 02:01:23 -- nvmf/common.sh@477 -- # '[' -n 3535598 ']' 00:25:34.964 02:01:23 -- nvmf/common.sh@478 -- # killprocess 3535598 00:25:34.964 02:01:23 -- common/autotest_common.sh@936 -- # '[' -z 3535598 ']' 00:25:34.964 02:01:23 -- common/autotest_common.sh@940 -- # kill -0 3535598 00:25:34.964 02:01:23 -- common/autotest_common.sh@941 -- # uname 00:25:34.964 02:01:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:34.964 02:01:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3535598 00:25:34.964 02:01:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:34.964 02:01:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:34.964 02:01:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3535598' 00:25:34.964 killing process with pid 3535598 00:25:34.964 02:01:23 -- common/autotest_common.sh@955 -- # kill 3535598 00:25:34.964 02:01:23 -- common/autotest_common.sh@960 -- # wait 3535598 00:25:35.222 02:01:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:35.222 02:01:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:35.222 02:01:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:35.222 02:01:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:35.222 02:01:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:35.222 02:01:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:35.222 02:01:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:35.222 02:01:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:37.752 02:01:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:37.752 00:25:37.752 real 0m37.841s 00:25:37.752 user 2m25.576s 00:25:37.752 sys 0m6.570s 00:25:37.752 02:01:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:37.752 02:01:25 -- common/autotest_common.sh@10 -- # set +x 00:25:37.752 ************************************ 00:25:37.752 END TEST nvmf_fio_host 00:25:37.752 ************************************ 00:25:37.752 02:01:25 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:37.752 02:01:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:37.752 02:01:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:37.752 02:01:25 -- common/autotest_common.sh@10 -- # set +x 00:25:37.752 ************************************ 00:25:37.752 START TEST nvmf_failover 00:25:37.752 ************************************ 00:25:37.752 02:01:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:37.752 * Looking for test storage... 00:25:37.752 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:37.752 02:01:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:37.752 02:01:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:37.752 02:01:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:37.752 02:01:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:37.752 02:01:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:37.752 02:01:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:37.752 02:01:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:37.752 02:01:25 -- scripts/common.sh@335 -- # IFS=.-: 00:25:37.752 02:01:25 -- scripts/common.sh@335 -- # read -ra ver1 00:25:37.752 02:01:25 -- scripts/common.sh@336 -- # IFS=.-: 00:25:37.752 02:01:25 -- scripts/common.sh@336 -- # read -ra ver2 00:25:37.752 02:01:25 -- scripts/common.sh@337 -- # local 'op=<' 00:25:37.752 02:01:25 -- scripts/common.sh@339 -- # ver1_l=2 00:25:37.752 02:01:25 -- scripts/common.sh@340 -- # ver2_l=1 00:25:37.752 02:01:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:37.752 02:01:25 -- scripts/common.sh@343 -- # case "$op" in 00:25:37.752 02:01:25 -- scripts/common.sh@344 -- # : 1 00:25:37.752 02:01:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:37.752 02:01:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:37.752 02:01:25 -- scripts/common.sh@364 -- # decimal 1 00:25:37.752 02:01:25 -- scripts/common.sh@352 -- # local d=1 00:25:37.752 02:01:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:37.752 02:01:25 -- scripts/common.sh@354 -- # echo 1 00:25:37.752 02:01:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:37.752 02:01:25 -- scripts/common.sh@365 -- # decimal 2 00:25:37.752 02:01:25 -- scripts/common.sh@352 -- # local d=2 00:25:37.752 02:01:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:37.752 02:01:25 -- scripts/common.sh@354 -- # echo 2 00:25:37.752 02:01:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:37.752 02:01:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:37.752 02:01:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:37.752 02:01:25 -- scripts/common.sh@367 -- # return 0 00:25:37.752 02:01:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:37.752 02:01:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:37.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.752 --rc genhtml_branch_coverage=1 00:25:37.752 --rc genhtml_function_coverage=1 00:25:37.752 --rc genhtml_legend=1 00:25:37.752 --rc geninfo_all_blocks=1 00:25:37.752 --rc geninfo_unexecuted_blocks=1 00:25:37.752 00:25:37.752 ' 00:25:37.752 02:01:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:37.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.752 --rc genhtml_branch_coverage=1 00:25:37.752 --rc genhtml_function_coverage=1 00:25:37.752 --rc genhtml_legend=1 00:25:37.752 --rc geninfo_all_blocks=1 00:25:37.752 --rc geninfo_unexecuted_blocks=1 00:25:37.752 00:25:37.752 ' 00:25:37.752 02:01:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:37.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.752 --rc genhtml_branch_coverage=1 00:25:37.752 --rc genhtml_function_coverage=1 00:25:37.752 --rc genhtml_legend=1 00:25:37.752 --rc geninfo_all_blocks=1 00:25:37.752 --rc geninfo_unexecuted_blocks=1 00:25:37.752 00:25:37.752 ' 00:25:37.752 02:01:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:37.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.752 --rc genhtml_branch_coverage=1 00:25:37.752 --rc genhtml_function_coverage=1 00:25:37.752 --rc genhtml_legend=1 00:25:37.752 --rc geninfo_all_blocks=1 00:25:37.752 --rc geninfo_unexecuted_blocks=1 00:25:37.752 00:25:37.752 ' 00:25:37.752 02:01:25 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:37.752 02:01:25 -- nvmf/common.sh@7 -- # uname -s 00:25:37.752 02:01:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:37.752 02:01:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:37.752 02:01:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:37.752 02:01:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:37.752 02:01:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:37.752 02:01:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:37.752 02:01:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:37.752 02:01:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:37.753 02:01:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:37.753 02:01:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:37.753 02:01:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:37.753 02:01:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:37.753 02:01:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:37.753 02:01:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:37.753 02:01:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:37.753 02:01:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:37.753 02:01:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:37.753 02:01:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:37.753 02:01:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:37.753 02:01:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.753 02:01:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.753 02:01:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.753 02:01:25 -- paths/export.sh@5 -- # export PATH 00:25:37.753 02:01:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.753 02:01:25 -- nvmf/common.sh@46 -- # : 0 00:25:37.753 02:01:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:37.753 02:01:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:37.753 02:01:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:37.753 02:01:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:37.753 02:01:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:37.753 02:01:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:37.753 02:01:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:37.753 02:01:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:37.753 02:01:25 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:37.753 02:01:25 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:37.753 02:01:25 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:37.753 02:01:25 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:37.753 02:01:25 -- host/failover.sh@18 -- # nvmftestinit 00:25:37.753 02:01:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:37.753 02:01:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:37.753 02:01:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:37.753 02:01:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:37.753 02:01:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:37.753 02:01:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:37.753 02:01:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:37.753 02:01:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:37.753 02:01:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:37.753 02:01:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:37.753 02:01:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:37.753 02:01:25 -- common/autotest_common.sh@10 -- # set +x 00:25:39.657 02:01:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:39.657 02:01:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:39.657 02:01:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:39.657 02:01:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:39.657 02:01:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:39.657 02:01:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:39.657 02:01:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:39.657 02:01:27 -- nvmf/common.sh@294 -- # net_devs=() 00:25:39.657 02:01:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:39.657 02:01:27 -- nvmf/common.sh@295 -- # e810=() 00:25:39.657 02:01:27 -- nvmf/common.sh@295 -- # local -ga e810 00:25:39.657 02:01:27 -- nvmf/common.sh@296 -- # x722=() 00:25:39.657 02:01:27 -- nvmf/common.sh@296 -- # local -ga x722 00:25:39.657 02:01:27 -- nvmf/common.sh@297 -- # mlx=() 00:25:39.657 02:01:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:39.657 02:01:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:39.657 02:01:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:39.657 02:01:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:39.657 02:01:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:39.657 02:01:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.657 02:01:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:39.657 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:39.657 02:01:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.657 02:01:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:39.657 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:39.657 02:01:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:39.657 02:01:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.657 02:01:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.657 02:01:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.657 02:01:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.657 02:01:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:39.657 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:39.657 02:01:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.657 02:01:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.657 02:01:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.657 02:01:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.657 02:01:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.657 02:01:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:39.657 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:39.657 02:01:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.657 02:01:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:39.657 02:01:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:39.657 02:01:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:39.657 02:01:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:39.657 02:01:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:39.657 02:01:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:39.657 02:01:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:39.657 02:01:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:39.657 02:01:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:39.657 02:01:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:39.657 02:01:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:39.657 02:01:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:39.657 02:01:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:39.657 02:01:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:39.657 02:01:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:39.657 02:01:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:39.657 02:01:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:39.657 02:01:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:39.657 02:01:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:39.657 02:01:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:39.657 02:01:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:39.657 02:01:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:39.657 02:01:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:39.657 02:01:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:39.657 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:39.657 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:25:39.657 00:25:39.657 --- 10.0.0.2 ping statistics --- 00:25:39.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:39.657 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:25:39.657 02:01:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:39.657 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:39.657 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:25:39.657 00:25:39.657 --- 10.0.0.1 ping statistics --- 00:25:39.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:39.657 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:25:39.657 02:01:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:39.657 02:01:28 -- nvmf/common.sh@410 -- # return 0 00:25:39.657 02:01:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:39.657 02:01:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:39.657 02:01:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:39.657 02:01:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:39.657 02:01:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:39.657 02:01:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:39.657 02:01:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:39.657 02:01:28 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:39.657 02:01:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:39.657 02:01:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:39.657 02:01:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.657 02:01:28 -- nvmf/common.sh@469 -- # nvmfpid=3541947 00:25:39.657 02:01:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:39.657 02:01:28 -- nvmf/common.sh@470 -- # waitforlisten 3541947 00:25:39.657 02:01:28 -- common/autotest_common.sh@829 -- # '[' -z 3541947 ']' 00:25:39.657 02:01:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:39.657 02:01:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:39.657 02:01:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:39.657 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:39.657 02:01:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:39.657 02:01:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.657 [2024-11-19 02:01:28.172231] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:39.657 [2024-11-19 02:01:28.172318] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:39.916 EAL: No free 2048 kB hugepages reported on node 1 00:25:39.916 [2024-11-19 02:01:28.239769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:39.916 [2024-11-19 02:01:28.348929] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:39.916 [2024-11-19 02:01:28.349088] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:39.916 [2024-11-19 02:01:28.349106] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:39.916 [2024-11-19 02:01:28.349118] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:39.916 [2024-11-19 02:01:28.349272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:39.916 [2024-11-19 02:01:28.349338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:39.916 [2024-11-19 02:01:28.349341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:40.847 02:01:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:40.847 02:01:29 -- common/autotest_common.sh@862 -- # return 0 00:25:40.847 02:01:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:40.847 02:01:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:40.847 02:01:29 -- common/autotest_common.sh@10 -- # set +x 00:25:40.847 02:01:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:40.847 02:01:29 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:41.104 [2024-11-19 02:01:29.401231] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:41.104 02:01:29 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:41.362 Malloc0 00:25:41.362 02:01:29 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:41.619 02:01:29 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:41.876 02:01:30 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:42.133 [2024-11-19 02:01:30.453861] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:42.133 02:01:30 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:42.390 [2024-11-19 02:01:30.718682] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:42.390 02:01:30 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:42.648 [2024-11-19 02:01:30.987600] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:42.648 02:01:31 -- host/failover.sh@31 -- # bdevperf_pid=3542376 00:25:42.648 02:01:31 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:42.648 02:01:31 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:42.648 02:01:31 -- host/failover.sh@34 -- # waitforlisten 3542376 /var/tmp/bdevperf.sock 00:25:42.648 02:01:31 -- common/autotest_common.sh@829 -- # '[' -z 3542376 ']' 00:25:42.648 02:01:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:42.648 02:01:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:42.648 02:01:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:42.648 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:42.648 02:01:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:42.648 02:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.582 02:01:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:43.582 02:01:32 -- common/autotest_common.sh@862 -- # return 0 00:25:43.582 02:01:32 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:43.839 NVMe0n1 00:25:43.839 02:01:32 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:44.405 00:25:44.405 02:01:32 -- host/failover.sh@39 -- # run_test_pid=3542531 00:25:44.405 02:01:32 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:44.405 02:01:32 -- host/failover.sh@41 -- # sleep 1 00:25:45.340 02:01:33 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:45.598 [2024-11-19 02:01:34.028586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.028984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.598 [2024-11-19 02:01:34.029250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 [2024-11-19 02:01:34.029273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 [2024-11-19 02:01:34.029284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 [2024-11-19 02:01:34.029296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 [2024-11-19 02:01:34.029308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 [2024-11-19 02:01:34.029320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 [2024-11-19 02:01:34.029332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 [2024-11-19 02:01:34.029343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c3cb0 is same with the state(5) to be set 00:25:45.599 02:01:34 -- host/failover.sh@45 -- # sleep 3 00:25:48.882 02:01:37 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.140 00:25:49.140 02:01:37 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:49.398 [2024-11-19 02:01:37.800959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.398 [2024-11-19 02:01:37.801160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 [2024-11-19 02:01:37.801719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c53a0 is same with the state(5) to be set 00:25:49.399 02:01:37 -- host/failover.sh@50 -- # sleep 3 00:25:52.682 02:01:40 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:52.682 [2024-11-19 02:01:41.103927] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:52.682 02:01:41 -- host/failover.sh@55 -- # sleep 1 00:25:53.614 02:01:42 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:54.181 [2024-11-19 02:01:42.422015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 [2024-11-19 02:01:42.422489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c5a80 is same with the state(5) to be set 00:25:54.181 02:01:42 -- host/failover.sh@59 -- # wait 3542531 00:25:59.498 0 00:25:59.499 02:01:47 -- host/failover.sh@61 -- # killprocess 3542376 00:25:59.499 02:01:47 -- common/autotest_common.sh@936 -- # '[' -z 3542376 ']' 00:25:59.499 02:01:47 -- common/autotest_common.sh@940 -- # kill -0 3542376 00:25:59.499 02:01:47 -- common/autotest_common.sh@941 -- # uname 00:25:59.499 02:01:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.499 02:01:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3542376 00:25:59.499 02:01:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:59.499 02:01:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:59.499 02:01:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3542376' 00:25:59.499 killing process with pid 3542376 00:25:59.499 02:01:47 -- common/autotest_common.sh@955 -- # kill 3542376 00:25:59.499 02:01:47 -- common/autotest_common.sh@960 -- # wait 3542376 00:25:59.763 02:01:48 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:59.763 [2024-11-19 02:01:31.042793] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:59.763 [2024-11-19 02:01:31.042878] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3542376 ] 00:25:59.763 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.764 [2024-11-19 02:01:31.102177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:59.764 [2024-11-19 02:01:31.210049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:59.764 Running I/O for 15 seconds... 00:25:59.764 [2024-11-19 02:01:34.029635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:108480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:108488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:108496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:108520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:108528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:108536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:108552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:108560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:108568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.029959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:108576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.029993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:108584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:108592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:108616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:108632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:108648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:108656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:108672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:108680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:108712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:108720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:108736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:107976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:107984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:108000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:108008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:108016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:108024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:108080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:108088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:108752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:108760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:108768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:108776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:108104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:108112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:108120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:108136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.764 [2024-11-19 02:01:34.030856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:108144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.764 [2024-11-19 02:01:34.030870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.030885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:108160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.030899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.030914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:108168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.030928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.030943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:108184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.030956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.030972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:108792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.030988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:108800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:108808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:108816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:108824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:108832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:108840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:108848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:108856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:108864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:108200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:108216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:108232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:108240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:108272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:108296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:108328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:108344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:108872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:108880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:108888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:108896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:108904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:108912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:108920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:108928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:108936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:108944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:108952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.765 [2024-11-19 02:01:34.031828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:108960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:108384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:108392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:108408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:108416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.031980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.031996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:108424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.032009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.765 [2024-11-19 02:01:34.032024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:108440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.765 [2024-11-19 02:01:34.032038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:108448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:108456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:108968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:108976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:108984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:108992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:109000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:109008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:109016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:109024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:109032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:109040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:109048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:109056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:109064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:109072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:109080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:109088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:109096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:109104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:109112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:109120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:109128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.032916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:109136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:109144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.032984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.032999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:109152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:109160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:109168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.033070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:109176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.033099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:109184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:109192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:109200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.766 [2024-11-19 02:01:34.033186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:109208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:108464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:108472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:108504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:108512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:108544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:108600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.766 [2024-11-19 02:01:34.033397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.766 [2024-11-19 02:01:34.033412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:108608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:108624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:109216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:109224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:108640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:108664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:108688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:108696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:108704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:108728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:108744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:34.033734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22c86a0 is same with the state(5) to be set 00:25:59.767 [2024-11-19 02:01:34.033765] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.767 [2024-11-19 02:01:34.033776] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.767 [2024-11-19 02:01:34.033788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:108784 len:8 PRP1 0x0 PRP2 0x0 00:25:59.767 [2024-11-19 02:01:34.033801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033859] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x22c86a0 was disconnected and freed. reset controller. 00:25:59.767 [2024-11-19 02:01:34.033883] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:59.767 [2024-11-19 02:01:34.033923] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:34.033947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:34.033974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.033988] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:34.034003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.034016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:34.034028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:34.034041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:59.767 [2024-11-19 02:01:34.036275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:59.767 [2024-11-19 02:01:34.036311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a9870 (9): Bad file descriptor 00:25:59.767 [2024-11-19 02:01:34.063314] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.767 [2024-11-19 02:01:37.800779] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:37.800839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.800868] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:37.800883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.800898] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:37.800912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.800926] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.767 [2024-11-19 02:01:37.800950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.800963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22a9870 is same with the state(5) to be set 00:25:59.767 [2024-11-19 02:01:37.801851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:110504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.801876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.801901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:110528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.801917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.801934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:109768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.801949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.801965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:109784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.801979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.801993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:109792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:109800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:109808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:109816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:109840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:109848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:109856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:109864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:109872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:109880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:109896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.767 [2024-11-19 02:01:37.802334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.767 [2024-11-19 02:01:37.802359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:109912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:109920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:109944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:110536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:110552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:110592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:110600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:110608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:109952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:109968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:109976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:109984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:110008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:110016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:110096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:110168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:110624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:110632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:110648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.802978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:110672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.802995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:110680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:110688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:110704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:110176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:110200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:110224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:110232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:110248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:110256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:110264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:110288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:110720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:110728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.768 [2024-11-19 02:01:37.803384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.768 [2024-11-19 02:01:37.803405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:110744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:110752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:110760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:110768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:110776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:110784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:110792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:110800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:110808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:110816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:110824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:110832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:110840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:110848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:110856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:110864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:110872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.803900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:110880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:110888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:110896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.803984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.803999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:110904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:110912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:110920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.804077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:110928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:110936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.804139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:110296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:110304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:110328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:110336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:110344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:110352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:110360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:110368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:110944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.804394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:110952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:110960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:110968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.804487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:110976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.804517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:110984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.769 [2024-11-19 02:01:37.804547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.769 [2024-11-19 02:01:37.804562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:110992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.769 [2024-11-19 02:01:37.804577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:111000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.804605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:111008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.804661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:111016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.804695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:111024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.804725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:111032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.804754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:111040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.804783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:111048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.804814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:111056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.804843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:110392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.804873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:110416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.804907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:110424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.804936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:110432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.804971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.804992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:110456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:110464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:110472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:110480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:111064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.805122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:111072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.805151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:111080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.805179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:111088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:111096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:111104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.805269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:111112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:111120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.770 [2024-11-19 02:01:37.805327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:110488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:110496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:110512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:110520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:110544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:110560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:110568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:110576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:110584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:110616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:110640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:110656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:110664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:110696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:110712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.770 [2024-11-19 02:01:37.805774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.770 [2024-11-19 02:01:37.805788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22b5d10 is same with the state(5) to be set 00:25:59.770 [2024-11-19 02:01:37.805804] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.771 [2024-11-19 02:01:37.805816] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.771 [2024-11-19 02:01:37.805828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:110736 len:8 PRP1 0x0 PRP2 0x0 00:25:59.771 [2024-11-19 02:01:37.805840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:37.805896] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x22b5d10 was disconnected and freed. reset controller. 00:25:59.771 [2024-11-19 02:01:37.805913] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:59.771 [2024-11-19 02:01:37.805928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:59.771 [2024-11-19 02:01:37.808155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:59.771 [2024-11-19 02:01:37.808194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a9870 (9): Bad file descriptor 00:25:59.771 [2024-11-19 02:01:37.924938] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.771 [2024-11-19 02:01:42.422607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:63520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:62800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:62808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:62816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:62832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:62840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:62848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:62856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:62872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:63528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.422976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:63536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.422990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:63552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:63560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:63568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:63584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:63592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:63600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:63616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:62888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:62896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:62904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:62912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:62920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:62928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:62936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:62944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:63656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.771 [2024-11-19 02:01:42.423445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:62960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:62968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:62976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:62984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:63016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:63040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:63048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:63056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.771 [2024-11-19 02:01:42.423706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.771 [2024-11-19 02:01:42.423721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:63064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:63072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:63080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:63096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:63120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:63128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:63160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:63176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.423957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.423972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:63664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.423985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:63672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:63680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:63688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:63696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:63704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:63712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:63720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:63728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:63736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:63744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:63752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:63760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:63768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:63776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:63784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:63792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.772 [2024-11-19 02:01:42.424436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:63800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:63808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:63816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:63184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:63208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:63216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:63224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:63232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:63240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:63248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.772 [2024-11-19 02:01:42.424749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.772 [2024-11-19 02:01:42.424764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:63264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.424780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.424796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:63272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.424809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.424825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:63288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.424838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.424854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:63296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.424869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.424885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:63328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.424898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.424914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:63376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.424928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.424959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:63384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.424973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.424988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:63400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:63424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:63824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:63832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:63840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:63848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:63856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:63864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:63872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:63880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:63888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:63896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:63904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:63912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:63920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:63928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:63936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:63944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:63952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:63960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:63968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:63976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:63984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:63992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:64000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:64008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:64016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:64024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:64032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:64040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:64048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.773 [2024-11-19 02:01:42.425910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:64056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.773 [2024-11-19 02:01:42.425938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.773 [2024-11-19 02:01:42.425953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:64064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.425966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.425981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:63432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.425994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:63440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:63448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:63464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:63472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:63480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:63496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:63504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:64072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.774 [2024-11-19 02:01:42.426227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:64080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.774 [2024-11-19 02:01:42.426255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:63512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:63544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:63576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:63608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:63624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:63632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:63640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.774 [2024-11-19 02:01:42.426455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22cc630 is same with the state(5) to be set 00:25:59.774 [2024-11-19 02:01:42.426485] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.774 [2024-11-19 02:01:42.426496] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.774 [2024-11-19 02:01:42.426508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:63648 len:8 PRP1 0x0 PRP2 0x0 00:25:59.774 [2024-11-19 02:01:42.426521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426586] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x22cc630 was disconnected and freed. reset controller. 00:25:59.774 [2024-11-19 02:01:42.426604] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:59.774 [2024-11-19 02:01:42.426653] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.774 [2024-11-19 02:01:42.426672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426687] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.774 [2024-11-19 02:01:42.426700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.774 [2024-11-19 02:01:42.426726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426739] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.774 [2024-11-19 02:01:42.426751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.774 [2024-11-19 02:01:42.426764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:59.774 [2024-11-19 02:01:42.429120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:59.774 [2024-11-19 02:01:42.429160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a9870 (9): Bad file descriptor 00:25:59.774 [2024-11-19 02:01:42.464721] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.774 00:25:59.774 Latency(us) 00:25:59.774 [2024-11-19T01:01:48.317Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:59.774 [2024-11-19T01:01:48.317Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:59.774 Verification LBA range: start 0x0 length 0x4000 00:25:59.774 NVMe0n1 : 15.01 11990.08 46.84 680.45 0.00 10085.18 676.60 15243.19 00:25:59.774 [2024-11-19T01:01:48.317Z] =================================================================================================================== 00:25:59.774 [2024-11-19T01:01:48.317Z] Total : 11990.08 46.84 680.45 0.00 10085.18 676.60 15243.19 00:25:59.774 Received shutdown signal, test time was about 15.000000 seconds 00:25:59.774 00:25:59.774 Latency(us) 00:25:59.774 [2024-11-19T01:01:48.317Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:59.774 [2024-11-19T01:01:48.317Z] =================================================================================================================== 00:25:59.774 [2024-11-19T01:01:48.317Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:59.774 02:01:48 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:59.774 02:01:48 -- host/failover.sh@65 -- # count=3 00:25:59.774 02:01:48 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:59.774 02:01:48 -- host/failover.sh@73 -- # bdevperf_pid=3544429 00:25:59.774 02:01:48 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:59.774 02:01:48 -- host/failover.sh@75 -- # waitforlisten 3544429 /var/tmp/bdevperf.sock 00:25:59.774 02:01:48 -- common/autotest_common.sh@829 -- # '[' -z 3544429 ']' 00:25:59.774 02:01:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:59.774 02:01:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:59.774 02:01:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:59.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:59.774 02:01:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:59.774 02:01:48 -- common/autotest_common.sh@10 -- # set +x 00:26:01.148 02:01:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:01.148 02:01:49 -- common/autotest_common.sh@862 -- # return 0 00:26:01.148 02:01:49 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:01.148 [2024-11-19 02:01:49.484910] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:01.148 02:01:49 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:01.407 [2024-11-19 02:01:49.725538] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:01.407 02:01:49 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:01.664 NVMe0n1 00:26:01.664 02:01:50 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:02.229 00:26:02.229 02:01:50 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:02.486 00:26:02.486 02:01:50 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:02.486 02:01:50 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:02.744 02:01:51 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:03.001 02:01:51 -- host/failover.sh@87 -- # sleep 3 00:26:06.281 02:01:54 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:06.281 02:01:54 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:06.281 02:01:54 -- host/failover.sh@90 -- # run_test_pid=3545245 00:26:06.282 02:01:54 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:06.282 02:01:54 -- host/failover.sh@92 -- # wait 3545245 00:26:07.654 0 00:26:07.654 02:01:55 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:07.654 [2024-11-19 02:01:48.299614] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:07.654 [2024-11-19 02:01:48.299726] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3544429 ] 00:26:07.654 EAL: No free 2048 kB hugepages reported on node 1 00:26:07.654 [2024-11-19 02:01:48.359912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:07.654 [2024-11-19 02:01:48.464450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:07.654 [2024-11-19 02:01:51.481211] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:07.654 [2024-11-19 02:01:51.481296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.654 [2024-11-19 02:01:51.481319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.654 [2024-11-19 02:01:51.481350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.654 [2024-11-19 02:01:51.481364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.654 [2024-11-19 02:01:51.481378] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.654 [2024-11-19 02:01:51.481392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.654 [2024-11-19 02:01:51.481406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.654 [2024-11-19 02:01:51.481419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.654 [2024-11-19 02:01:51.481432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:07.654 [2024-11-19 02:01:51.481468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:07.654 [2024-11-19 02:01:51.481498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13fb870 (9): Bad file descriptor 00:26:07.654 [2024-11-19 02:01:51.491764] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:07.654 Running I/O for 1 seconds... 00:26:07.654 00:26:07.654 Latency(us) 00:26:07.654 [2024-11-19T01:01:56.197Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:07.654 [2024-11-19T01:01:56.197Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:07.654 Verification LBA range: start 0x0 length 0x4000 00:26:07.654 NVMe0n1 : 1.01 12922.04 50.48 0.00 0.00 9862.49 1426.01 12718.84 00:26:07.654 [2024-11-19T01:01:56.197Z] =================================================================================================================== 00:26:07.654 [2024-11-19T01:01:56.197Z] Total : 12922.04 50.48 0.00 0.00 9862.49 1426.01 12718.84 00:26:07.654 02:01:55 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.654 02:01:55 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:07.654 02:01:56 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:07.912 02:01:56 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.912 02:01:56 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:08.170 02:01:56 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:08.427 02:01:56 -- host/failover.sh@101 -- # sleep 3 00:26:11.705 02:01:59 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:11.705 02:01:59 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:11.705 02:02:00 -- host/failover.sh@108 -- # killprocess 3544429 00:26:11.705 02:02:00 -- common/autotest_common.sh@936 -- # '[' -z 3544429 ']' 00:26:11.705 02:02:00 -- common/autotest_common.sh@940 -- # kill -0 3544429 00:26:11.705 02:02:00 -- common/autotest_common.sh@941 -- # uname 00:26:11.705 02:02:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:11.705 02:02:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3544429 00:26:11.963 02:02:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:11.963 02:02:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:11.963 02:02:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3544429' 00:26:11.963 killing process with pid 3544429 00:26:11.963 02:02:00 -- common/autotest_common.sh@955 -- # kill 3544429 00:26:11.963 02:02:00 -- common/autotest_common.sh@960 -- # wait 3544429 00:26:12.221 02:02:00 -- host/failover.sh@110 -- # sync 00:26:12.221 02:02:00 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:12.479 02:02:00 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:12.479 02:02:00 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:12.479 02:02:00 -- host/failover.sh@116 -- # nvmftestfini 00:26:12.479 02:02:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:12.479 02:02:00 -- nvmf/common.sh@116 -- # sync 00:26:12.479 02:02:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:12.479 02:02:00 -- nvmf/common.sh@119 -- # set +e 00:26:12.479 02:02:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:12.479 02:02:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:12.479 rmmod nvme_tcp 00:26:12.479 rmmod nvme_fabrics 00:26:12.479 rmmod nvme_keyring 00:26:12.479 02:02:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:12.479 02:02:00 -- nvmf/common.sh@123 -- # set -e 00:26:12.479 02:02:00 -- nvmf/common.sh@124 -- # return 0 00:26:12.479 02:02:00 -- nvmf/common.sh@477 -- # '[' -n 3541947 ']' 00:26:12.479 02:02:00 -- nvmf/common.sh@478 -- # killprocess 3541947 00:26:12.479 02:02:00 -- common/autotest_common.sh@936 -- # '[' -z 3541947 ']' 00:26:12.479 02:02:00 -- common/autotest_common.sh@940 -- # kill -0 3541947 00:26:12.479 02:02:00 -- common/autotest_common.sh@941 -- # uname 00:26:12.479 02:02:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:12.479 02:02:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3541947 00:26:12.479 02:02:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:12.479 02:02:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:12.480 02:02:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3541947' 00:26:12.480 killing process with pid 3541947 00:26:12.480 02:02:00 -- common/autotest_common.sh@955 -- # kill 3541947 00:26:12.480 02:02:00 -- common/autotest_common.sh@960 -- # wait 3541947 00:26:12.738 02:02:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:12.738 02:02:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:12.738 02:02:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:12.738 02:02:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:12.738 02:02:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:12.738 02:02:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:12.738 02:02:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:12.738 02:02:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.272 02:02:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:15.272 00:26:15.272 real 0m37.463s 00:26:15.272 user 2m10.635s 00:26:15.272 sys 0m6.989s 00:26:15.272 02:02:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:15.272 02:02:03 -- common/autotest_common.sh@10 -- # set +x 00:26:15.272 ************************************ 00:26:15.272 END TEST nvmf_failover 00:26:15.272 ************************************ 00:26:15.272 02:02:03 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:15.272 02:02:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:15.272 02:02:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:15.272 02:02:03 -- common/autotest_common.sh@10 -- # set +x 00:26:15.272 ************************************ 00:26:15.272 START TEST nvmf_discovery 00:26:15.272 ************************************ 00:26:15.272 02:02:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:15.272 * Looking for test storage... 00:26:15.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:15.272 02:02:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:15.272 02:02:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:15.272 02:02:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:15.272 02:02:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:15.272 02:02:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:15.272 02:02:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:15.272 02:02:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:15.272 02:02:03 -- scripts/common.sh@335 -- # IFS=.-: 00:26:15.272 02:02:03 -- scripts/common.sh@335 -- # read -ra ver1 00:26:15.272 02:02:03 -- scripts/common.sh@336 -- # IFS=.-: 00:26:15.272 02:02:03 -- scripts/common.sh@336 -- # read -ra ver2 00:26:15.272 02:02:03 -- scripts/common.sh@337 -- # local 'op=<' 00:26:15.272 02:02:03 -- scripts/common.sh@339 -- # ver1_l=2 00:26:15.272 02:02:03 -- scripts/common.sh@340 -- # ver2_l=1 00:26:15.272 02:02:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:15.272 02:02:03 -- scripts/common.sh@343 -- # case "$op" in 00:26:15.272 02:02:03 -- scripts/common.sh@344 -- # : 1 00:26:15.272 02:02:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:15.272 02:02:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:15.272 02:02:03 -- scripts/common.sh@364 -- # decimal 1 00:26:15.272 02:02:03 -- scripts/common.sh@352 -- # local d=1 00:26:15.272 02:02:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:15.272 02:02:03 -- scripts/common.sh@354 -- # echo 1 00:26:15.272 02:02:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:15.272 02:02:03 -- scripts/common.sh@365 -- # decimal 2 00:26:15.272 02:02:03 -- scripts/common.sh@352 -- # local d=2 00:26:15.272 02:02:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:15.272 02:02:03 -- scripts/common.sh@354 -- # echo 2 00:26:15.272 02:02:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:15.272 02:02:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:15.272 02:02:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:15.272 02:02:03 -- scripts/common.sh@367 -- # return 0 00:26:15.272 02:02:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:15.272 02:02:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:15.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.272 --rc genhtml_branch_coverage=1 00:26:15.272 --rc genhtml_function_coverage=1 00:26:15.272 --rc genhtml_legend=1 00:26:15.272 --rc geninfo_all_blocks=1 00:26:15.272 --rc geninfo_unexecuted_blocks=1 00:26:15.272 00:26:15.272 ' 00:26:15.272 02:02:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:15.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.272 --rc genhtml_branch_coverage=1 00:26:15.272 --rc genhtml_function_coverage=1 00:26:15.272 --rc genhtml_legend=1 00:26:15.272 --rc geninfo_all_blocks=1 00:26:15.272 --rc geninfo_unexecuted_blocks=1 00:26:15.272 00:26:15.272 ' 00:26:15.272 02:02:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:15.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.272 --rc genhtml_branch_coverage=1 00:26:15.272 --rc genhtml_function_coverage=1 00:26:15.272 --rc genhtml_legend=1 00:26:15.272 --rc geninfo_all_blocks=1 00:26:15.272 --rc geninfo_unexecuted_blocks=1 00:26:15.272 00:26:15.272 ' 00:26:15.272 02:02:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:15.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.273 --rc genhtml_branch_coverage=1 00:26:15.273 --rc genhtml_function_coverage=1 00:26:15.273 --rc genhtml_legend=1 00:26:15.273 --rc geninfo_all_blocks=1 00:26:15.273 --rc geninfo_unexecuted_blocks=1 00:26:15.273 00:26:15.273 ' 00:26:15.273 02:02:03 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:15.273 02:02:03 -- nvmf/common.sh@7 -- # uname -s 00:26:15.273 02:02:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:15.273 02:02:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:15.273 02:02:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:15.273 02:02:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:15.273 02:02:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:15.273 02:02:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:15.273 02:02:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:15.273 02:02:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:15.273 02:02:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:15.273 02:02:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:15.273 02:02:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.273 02:02:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.273 02:02:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:15.273 02:02:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:15.273 02:02:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:15.273 02:02:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:15.273 02:02:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:15.273 02:02:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:15.273 02:02:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:15.273 02:02:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.273 02:02:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.273 02:02:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.273 02:02:03 -- paths/export.sh@5 -- # export PATH 00:26:15.273 02:02:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.273 02:02:03 -- nvmf/common.sh@46 -- # : 0 00:26:15.273 02:02:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:15.273 02:02:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:15.273 02:02:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:15.273 02:02:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:15.273 02:02:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:15.273 02:02:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:15.273 02:02:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:15.273 02:02:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:15.273 02:02:03 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:15.273 02:02:03 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:15.273 02:02:03 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:15.273 02:02:03 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:15.273 02:02:03 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:15.273 02:02:03 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:15.273 02:02:03 -- host/discovery.sh@25 -- # nvmftestinit 00:26:15.273 02:02:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:15.273 02:02:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:15.273 02:02:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:15.273 02:02:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:15.273 02:02:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:15.273 02:02:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:15.273 02:02:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:15.273 02:02:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.273 02:02:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:15.273 02:02:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:15.273 02:02:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:15.273 02:02:03 -- common/autotest_common.sh@10 -- # set +x 00:26:17.172 02:02:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:17.172 02:02:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:17.172 02:02:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:17.172 02:02:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:17.172 02:02:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:17.172 02:02:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:17.172 02:02:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:17.172 02:02:05 -- nvmf/common.sh@294 -- # net_devs=() 00:26:17.172 02:02:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:17.172 02:02:05 -- nvmf/common.sh@295 -- # e810=() 00:26:17.172 02:02:05 -- nvmf/common.sh@295 -- # local -ga e810 00:26:17.172 02:02:05 -- nvmf/common.sh@296 -- # x722=() 00:26:17.172 02:02:05 -- nvmf/common.sh@296 -- # local -ga x722 00:26:17.172 02:02:05 -- nvmf/common.sh@297 -- # mlx=() 00:26:17.172 02:02:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:17.172 02:02:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:17.172 02:02:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:17.172 02:02:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:17.172 02:02:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:17.172 02:02:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.172 02:02:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:17.172 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:17.172 02:02:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.172 02:02:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:17.172 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:17.172 02:02:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:17.172 02:02:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.172 02:02:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.172 02:02:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.172 02:02:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.172 02:02:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:17.172 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:17.172 02:02:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.172 02:02:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.172 02:02:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.172 02:02:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.172 02:02:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.172 02:02:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:17.172 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:17.172 02:02:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.172 02:02:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:17.172 02:02:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:17.172 02:02:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:17.172 02:02:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:17.172 02:02:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:17.172 02:02:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:17.172 02:02:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:17.172 02:02:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:17.172 02:02:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:17.172 02:02:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:17.172 02:02:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:17.172 02:02:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:17.172 02:02:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:17.172 02:02:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:17.172 02:02:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:17.172 02:02:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:17.172 02:02:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:17.172 02:02:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:17.172 02:02:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:17.172 02:02:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:17.172 02:02:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:17.172 02:02:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:17.172 02:02:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:17.172 02:02:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:17.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:17.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:26:17.172 00:26:17.172 --- 10.0.0.2 ping statistics --- 00:26:17.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.172 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:26:17.172 02:02:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:17.173 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:17.173 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:26:17.173 00:26:17.173 --- 10.0.0.1 ping statistics --- 00:26:17.173 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.173 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:26:17.173 02:02:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:17.173 02:02:05 -- nvmf/common.sh@410 -- # return 0 00:26:17.173 02:02:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:17.173 02:02:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:17.173 02:02:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:17.173 02:02:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:17.173 02:02:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:17.173 02:02:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:17.173 02:02:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:17.173 02:02:05 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:17.173 02:02:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:17.173 02:02:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:17.173 02:02:05 -- common/autotest_common.sh@10 -- # set +x 00:26:17.173 02:02:05 -- nvmf/common.sh@469 -- # nvmfpid=3547890 00:26:17.173 02:02:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:17.173 02:02:05 -- nvmf/common.sh@470 -- # waitforlisten 3547890 00:26:17.173 02:02:05 -- common/autotest_common.sh@829 -- # '[' -z 3547890 ']' 00:26:17.173 02:02:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:17.173 02:02:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:17.173 02:02:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:17.173 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:17.173 02:02:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:17.173 02:02:05 -- common/autotest_common.sh@10 -- # set +x 00:26:17.173 [2024-11-19 02:02:05.588888] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:17.173 [2024-11-19 02:02:05.588964] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:17.173 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.173 [2024-11-19 02:02:05.652449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:17.431 [2024-11-19 02:02:05.763481] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:17.431 [2024-11-19 02:02:05.763656] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:17.431 [2024-11-19 02:02:05.763675] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:17.431 [2024-11-19 02:02:05.763695] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:17.431 [2024-11-19 02:02:05.763731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:18.364 02:02:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:18.365 02:02:06 -- common/autotest_common.sh@862 -- # return 0 00:26:18.365 02:02:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:18.365 02:02:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:18.365 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:26:18.365 02:02:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:18.365 02:02:06 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:18.365 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.365 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:26:18.365 [2024-11-19 02:02:06.593991] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:18.365 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.365 02:02:06 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:18.365 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.365 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:26:18.365 [2024-11-19 02:02:06.602183] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:18.365 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.365 02:02:06 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:18.365 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.365 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:26:18.365 null0 00:26:18.365 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.365 02:02:06 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:18.365 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.365 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:26:18.365 null1 00:26:18.365 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.365 02:02:06 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:18.365 02:02:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.365 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:26:18.365 02:02:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.365 02:02:06 -- host/discovery.sh@45 -- # hostpid=3548048 00:26:18.365 02:02:06 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:18.365 02:02:06 -- host/discovery.sh@46 -- # waitforlisten 3548048 /tmp/host.sock 00:26:18.365 02:02:06 -- common/autotest_common.sh@829 -- # '[' -z 3548048 ']' 00:26:18.365 02:02:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:18.365 02:02:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:18.365 02:02:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:18.365 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:18.365 02:02:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:18.365 02:02:06 -- common/autotest_common.sh@10 -- # set +x 00:26:18.365 [2024-11-19 02:02:06.669492] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:18.365 [2024-11-19 02:02:06.669566] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3548048 ] 00:26:18.365 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.365 [2024-11-19 02:02:06.730156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:18.365 [2024-11-19 02:02:06.844408] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:18.365 [2024-11-19 02:02:06.844567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:19.300 02:02:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:19.300 02:02:07 -- common/autotest_common.sh@862 -- # return 0 00:26:19.300 02:02:07 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:19.300 02:02:07 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:19.300 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.300 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.300 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.300 02:02:07 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:19.300 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.300 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.300 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.300 02:02:07 -- host/discovery.sh@72 -- # notify_id=0 00:26:19.300 02:02:07 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:19.300 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.300 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # sort 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # xargs 00:26:19.300 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.300 02:02:07 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:19.300 02:02:07 -- host/discovery.sh@79 -- # get_bdev_list 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.300 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.300 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # sort 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # xargs 00:26:19.300 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.300 02:02:07 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:19.300 02:02:07 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:19.300 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.300 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.300 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.300 02:02:07 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:19.300 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.300 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # sort 00:26:19.300 02:02:07 -- host/discovery.sh@59 -- # xargs 00:26:19.300 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.300 02:02:07 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:19.300 02:02:07 -- host/discovery.sh@83 -- # get_bdev_list 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.300 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # sort 00:26:19.300 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.300 02:02:07 -- host/discovery.sh@55 -- # xargs 00:26:19.300 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.558 02:02:07 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:19.558 02:02:07 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:19.558 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.558 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.558 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.558 02:02:07 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:19.558 02:02:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:19.558 02:02:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:19.558 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.558 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.558 02:02:07 -- host/discovery.sh@59 -- # sort 00:26:19.558 02:02:07 -- host/discovery.sh@59 -- # xargs 00:26:19.558 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.558 02:02:07 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:19.558 02:02:07 -- host/discovery.sh@87 -- # get_bdev_list 00:26:19.558 02:02:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.559 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.559 02:02:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.559 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.559 02:02:07 -- host/discovery.sh@55 -- # sort 00:26:19.559 02:02:07 -- host/discovery.sh@55 -- # xargs 00:26:19.559 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.559 02:02:07 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:19.559 02:02:07 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:19.559 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.559 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.559 [2024-11-19 02:02:07.969912] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:19.559 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.559 02:02:07 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:19.559 02:02:07 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:19.559 02:02:07 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:19.559 02:02:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.559 02:02:07 -- common/autotest_common.sh@10 -- # set +x 00:26:19.559 02:02:07 -- host/discovery.sh@59 -- # sort 00:26:19.559 02:02:07 -- host/discovery.sh@59 -- # xargs 00:26:19.559 02:02:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.559 02:02:08 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:19.559 02:02:08 -- host/discovery.sh@93 -- # get_bdev_list 00:26:19.559 02:02:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.559 02:02:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.559 02:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.559 02:02:08 -- common/autotest_common.sh@10 -- # set +x 00:26:19.559 02:02:08 -- host/discovery.sh@55 -- # sort 00:26:19.559 02:02:08 -- host/discovery.sh@55 -- # xargs 00:26:19.559 02:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.559 02:02:08 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:19.559 02:02:08 -- host/discovery.sh@94 -- # get_notification_count 00:26:19.559 02:02:08 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:19.559 02:02:08 -- host/discovery.sh@74 -- # jq '. | length' 00:26:19.559 02:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.559 02:02:08 -- common/autotest_common.sh@10 -- # set +x 00:26:19.559 02:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.559 02:02:08 -- host/discovery.sh@74 -- # notification_count=0 00:26:19.559 02:02:08 -- host/discovery.sh@75 -- # notify_id=0 00:26:19.559 02:02:08 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:19.559 02:02:08 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:19.559 02:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.559 02:02:08 -- common/autotest_common.sh@10 -- # set +x 00:26:19.559 02:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.559 02:02:08 -- host/discovery.sh@100 -- # sleep 1 00:26:20.493 [2024-11-19 02:02:08.703154] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:20.493 [2024-11-19 02:02:08.703196] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:20.493 [2024-11-19 02:02:08.703226] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:20.493 [2024-11-19 02:02:08.790476] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:20.493 [2024-11-19 02:02:08.854173] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:20.493 [2024-11-19 02:02:08.854200] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:20.751 02:02:09 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:20.751 02:02:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.751 02:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.751 02:02:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.751 02:02:09 -- common/autotest_common.sh@10 -- # set +x 00:26:20.751 02:02:09 -- host/discovery.sh@59 -- # sort 00:26:20.751 02:02:09 -- host/discovery.sh@59 -- # xargs 00:26:20.751 02:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@102 -- # get_bdev_list 00:26:20.751 02:02:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.751 02:02:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.751 02:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.751 02:02:09 -- host/discovery.sh@55 -- # sort 00:26:20.751 02:02:09 -- common/autotest_common.sh@10 -- # set +x 00:26:20.751 02:02:09 -- host/discovery.sh@55 -- # xargs 00:26:20.751 02:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:20.751 02:02:09 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:20.751 02:02:09 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:20.751 02:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.751 02:02:09 -- host/discovery.sh@63 -- # sort -n 00:26:20.751 02:02:09 -- common/autotest_common.sh@10 -- # set +x 00:26:20.751 02:02:09 -- host/discovery.sh@63 -- # xargs 00:26:20.751 02:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@104 -- # get_notification_count 00:26:20.751 02:02:09 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:20.751 02:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.751 02:02:09 -- host/discovery.sh@74 -- # jq '. | length' 00:26:20.751 02:02:09 -- common/autotest_common.sh@10 -- # set +x 00:26:20.751 02:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@74 -- # notification_count=1 00:26:20.751 02:02:09 -- host/discovery.sh@75 -- # notify_id=1 00:26:20.751 02:02:09 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:20.751 02:02:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.751 02:02:09 -- common/autotest_common.sh@10 -- # set +x 00:26:20.751 02:02:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.751 02:02:09 -- host/discovery.sh@109 -- # sleep 1 00:26:22.123 02:02:10 -- host/discovery.sh@110 -- # get_bdev_list 00:26:22.123 02:02:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.123 02:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.123 02:02:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.123 02:02:10 -- common/autotest_common.sh@10 -- # set +x 00:26:22.123 02:02:10 -- host/discovery.sh@55 -- # sort 00:26:22.123 02:02:10 -- host/discovery.sh@55 -- # xargs 00:26:22.123 02:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.123 02:02:10 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:22.123 02:02:10 -- host/discovery.sh@111 -- # get_notification_count 00:26:22.123 02:02:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:22.123 02:02:10 -- host/discovery.sh@74 -- # jq '. | length' 00:26:22.123 02:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.123 02:02:10 -- common/autotest_common.sh@10 -- # set +x 00:26:22.123 02:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.123 02:02:10 -- host/discovery.sh@74 -- # notification_count=1 00:26:22.123 02:02:10 -- host/discovery.sh@75 -- # notify_id=2 00:26:22.123 02:02:10 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:22.123 02:02:10 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:22.123 02:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.123 02:02:10 -- common/autotest_common.sh@10 -- # set +x 00:26:22.123 [2024-11-19 02:02:10.357331] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:22.123 [2024-11-19 02:02:10.357753] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:22.123 [2024-11-19 02:02:10.357790] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:22.123 02:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.123 02:02:10 -- host/discovery.sh@117 -- # sleep 1 00:26:22.123 [2024-11-19 02:02:10.484180] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:22.123 [2024-11-19 02:02:10.590936] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:22.123 [2024-11-19 02:02:10.590958] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:22.123 [2024-11-19 02:02:10.590967] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:23.058 02:02:11 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:23.058 02:02:11 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:23.058 02:02:11 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:23.058 02:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.058 02:02:11 -- common/autotest_common.sh@10 -- # set +x 00:26:23.058 02:02:11 -- host/discovery.sh@59 -- # sort 00:26:23.058 02:02:11 -- host/discovery.sh@59 -- # xargs 00:26:23.058 02:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@119 -- # get_bdev_list 00:26:23.058 02:02:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:23.058 02:02:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:23.058 02:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.058 02:02:11 -- common/autotest_common.sh@10 -- # set +x 00:26:23.058 02:02:11 -- host/discovery.sh@55 -- # sort 00:26:23.058 02:02:11 -- host/discovery.sh@55 -- # xargs 00:26:23.058 02:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:23.058 02:02:11 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:23.058 02:02:11 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:23.058 02:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.058 02:02:11 -- common/autotest_common.sh@10 -- # set +x 00:26:23.058 02:02:11 -- host/discovery.sh@63 -- # sort -n 00:26:23.058 02:02:11 -- host/discovery.sh@63 -- # xargs 00:26:23.058 02:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@121 -- # get_notification_count 00:26:23.058 02:02:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:23.058 02:02:11 -- host/discovery.sh@74 -- # jq '. | length' 00:26:23.058 02:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.058 02:02:11 -- common/autotest_common.sh@10 -- # set +x 00:26:23.058 02:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@74 -- # notification_count=0 00:26:23.058 02:02:11 -- host/discovery.sh@75 -- # notify_id=2 00:26:23.058 02:02:11 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:23.058 02:02:11 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:23.058 02:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.058 02:02:11 -- common/autotest_common.sh@10 -- # set +x 00:26:23.058 [2024-11-19 02:02:11.528976] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:23.058 [2024-11-19 02:02:11.529013] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:23.058 [2024-11-19 02:02:11.531606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.058 [2024-11-19 02:02:11.531647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.059 [2024-11-19 02:02:11.531694] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.059 [2024-11-19 02:02:11.531708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.059 [2024-11-19 02:02:11.531722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.059 [2024-11-19 02:02:11.531735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.059 [2024-11-19 02:02:11.531750] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:23.059 [2024-11-19 02:02:11.531763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:23.059 [2024-11-19 02:02:11.531777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.059 02:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.059 02:02:11 -- host/discovery.sh@127 -- # sleep 1 00:26:23.059 [2024-11-19 02:02:11.541606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.059 [2024-11-19 02:02:11.551675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.059 [2024-11-19 02:02:11.551895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.552042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.552074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.059 [2024-11-19 02:02:11.552091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.059 [2024-11-19 02:02:11.552114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.059 [2024-11-19 02:02:11.552147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.059 [2024-11-19 02:02:11.552166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.059 [2024-11-19 02:02:11.552181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.059 [2024-11-19 02:02:11.552201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.059 [2024-11-19 02:02:11.561767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.059 [2024-11-19 02:02:11.561975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.562092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.562117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.059 [2024-11-19 02:02:11.562133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.059 [2024-11-19 02:02:11.562155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.059 [2024-11-19 02:02:11.562198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.059 [2024-11-19 02:02:11.562217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.059 [2024-11-19 02:02:11.562230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.059 [2024-11-19 02:02:11.562249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.059 [2024-11-19 02:02:11.571850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.059 [2024-11-19 02:02:11.572049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.572175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.572200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.059 [2024-11-19 02:02:11.572216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.059 [2024-11-19 02:02:11.572237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.059 [2024-11-19 02:02:11.572283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.059 [2024-11-19 02:02:11.572302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.059 [2024-11-19 02:02:11.572315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.059 [2024-11-19 02:02:11.572333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.059 [2024-11-19 02:02:11.581952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.059 [2024-11-19 02:02:11.582153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.582285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.582309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.059 [2024-11-19 02:02:11.582330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.059 [2024-11-19 02:02:11.582353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.059 [2024-11-19 02:02:11.582395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.059 [2024-11-19 02:02:11.582414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.059 [2024-11-19 02:02:11.582427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.059 [2024-11-19 02:02:11.582446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.059 [2024-11-19 02:02:11.592023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.059 [2024-11-19 02:02:11.592225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.592347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.592372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.059 [2024-11-19 02:02:11.592387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.059 [2024-11-19 02:02:11.592409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.059 [2024-11-19 02:02:11.592443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.059 [2024-11-19 02:02:11.592460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.059 [2024-11-19 02:02:11.592473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.059 [2024-11-19 02:02:11.592492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.059 [2024-11-19 02:02:11.602123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.059 [2024-11-19 02:02:11.602304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.602438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.059 [2024-11-19 02:02:11.602464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.059 [2024-11-19 02:02:11.602479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.059 [2024-11-19 02:02:11.602501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.059 [2024-11-19 02:02:11.602546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.059 [2024-11-19 02:02:11.602565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.059 [2024-11-19 02:02:11.602578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.059 [2024-11-19 02:02:11.602597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.318 [2024-11-19 02:02:11.612194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.318 [2024-11-19 02:02:11.612360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.612491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.612516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.318 [2024-11-19 02:02:11.612531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.318 [2024-11-19 02:02:11.612558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.318 [2024-11-19 02:02:11.612593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.318 [2024-11-19 02:02:11.612611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.318 [2024-11-19 02:02:11.612624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.318 [2024-11-19 02:02:11.612657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.318 [2024-11-19 02:02:11.622277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.318 [2024-11-19 02:02:11.622493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.622593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.622618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.318 [2024-11-19 02:02:11.622634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.318 [2024-11-19 02:02:11.622665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.318 [2024-11-19 02:02:11.622710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.318 [2024-11-19 02:02:11.622729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.318 [2024-11-19 02:02:11.622743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.318 [2024-11-19 02:02:11.622762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.318 [2024-11-19 02:02:11.632347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.318 [2024-11-19 02:02:11.632548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.632649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.632675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.318 [2024-11-19 02:02:11.632690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.318 [2024-11-19 02:02:11.632711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.318 [2024-11-19 02:02:11.632731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.318 [2024-11-19 02:02:11.632744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.318 [2024-11-19 02:02:11.632757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.318 [2024-11-19 02:02:11.632790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.318 [2024-11-19 02:02:11.642428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.318 [2024-11-19 02:02:11.642616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.642827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.642852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.318 [2024-11-19 02:02:11.642868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.318 [2024-11-19 02:02:11.642889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.318 [2024-11-19 02:02:11.642938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.318 [2024-11-19 02:02:11.642957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.318 [2024-11-19 02:02:11.642970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.318 [2024-11-19 02:02:11.642989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.318 [2024-11-19 02:02:11.652509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:23.318 [2024-11-19 02:02:11.652732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.652882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.318 [2024-11-19 02:02:11.652907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed2810 with addr=10.0.0.2, port=4420 00:26:23.318 [2024-11-19 02:02:11.652922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2810 is same with the state(5) to be set 00:26:23.318 [2024-11-19 02:02:11.652943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed2810 (9): Bad file descriptor 00:26:23.318 [2024-11-19 02:02:11.652976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:23.318 [2024-11-19 02:02:11.652993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:23.318 [2024-11-19 02:02:11.653007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:23.318 [2024-11-19 02:02:11.653025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:23.318 [2024-11-19 02:02:11.655993] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:23.318 [2024-11-19 02:02:11.656022] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:24.252 02:02:12 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:24.252 02:02:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:24.252 02:02:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:24.252 02:02:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.252 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:26:24.252 02:02:12 -- host/discovery.sh@59 -- # sort 00:26:24.252 02:02:12 -- host/discovery.sh@59 -- # xargs 00:26:24.252 02:02:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@129 -- # get_bdev_list 00:26:24.252 02:02:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.252 02:02:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:24.252 02:02:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.252 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:26:24.252 02:02:12 -- host/discovery.sh@55 -- # sort 00:26:24.252 02:02:12 -- host/discovery.sh@55 -- # xargs 00:26:24.252 02:02:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:24.252 02:02:12 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:24.252 02:02:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.252 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:26:24.252 02:02:12 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:24.252 02:02:12 -- host/discovery.sh@63 -- # sort -n 00:26:24.252 02:02:12 -- host/discovery.sh@63 -- # xargs 00:26:24.252 02:02:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@131 -- # get_notification_count 00:26:24.252 02:02:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:24.252 02:02:12 -- host/discovery.sh@74 -- # jq '. | length' 00:26:24.252 02:02:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.252 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:26:24.252 02:02:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@74 -- # notification_count=0 00:26:24.252 02:02:12 -- host/discovery.sh@75 -- # notify_id=2 00:26:24.252 02:02:12 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:24.252 02:02:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.252 02:02:12 -- common/autotest_common.sh@10 -- # set +x 00:26:24.252 02:02:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.252 02:02:12 -- host/discovery.sh@135 -- # sleep 1 00:26:25.185 02:02:13 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:25.185 02:02:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:25.185 02:02:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:25.185 02:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.185 02:02:13 -- host/discovery.sh@59 -- # sort 00:26:25.185 02:02:13 -- common/autotest_common.sh@10 -- # set +x 00:26:25.185 02:02:13 -- host/discovery.sh@59 -- # xargs 00:26:25.492 02:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.492 02:02:13 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:25.492 02:02:13 -- host/discovery.sh@137 -- # get_bdev_list 00:26:25.492 02:02:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.492 02:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.492 02:02:13 -- common/autotest_common.sh@10 -- # set +x 00:26:25.492 02:02:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:25.492 02:02:13 -- host/discovery.sh@55 -- # sort 00:26:25.492 02:02:13 -- host/discovery.sh@55 -- # xargs 00:26:25.492 02:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.492 02:02:13 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:25.492 02:02:13 -- host/discovery.sh@138 -- # get_notification_count 00:26:25.492 02:02:13 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:25.492 02:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.492 02:02:13 -- host/discovery.sh@74 -- # jq '. | length' 00:26:25.492 02:02:13 -- common/autotest_common.sh@10 -- # set +x 00:26:25.492 02:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.492 02:02:13 -- host/discovery.sh@74 -- # notification_count=2 00:26:25.492 02:02:13 -- host/discovery.sh@75 -- # notify_id=4 00:26:25.492 02:02:13 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:25.492 02:02:13 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:25.492 02:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.492 02:02:13 -- common/autotest_common.sh@10 -- # set +x 00:26:26.427 [2024-11-19 02:02:14.889286] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:26.427 [2024-11-19 02:02:14.889315] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:26.427 [2024-11-19 02:02:14.889339] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:26.685 [2024-11-19 02:02:15.016775] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:26.685 [2024-11-19 02:02:15.083974] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:26.685 [2024-11-19 02:02:15.084013] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:26.685 02:02:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.685 02:02:15 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.685 02:02:15 -- common/autotest_common.sh@650 -- # local es=0 00:26:26.685 02:02:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.685 02:02:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:26.685 02:02:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.685 02:02:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:26.685 02:02:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.685 02:02:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.685 02:02:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.685 02:02:15 -- common/autotest_common.sh@10 -- # set +x 00:26:26.685 request: 00:26:26.685 { 00:26:26.685 "name": "nvme", 00:26:26.685 "trtype": "tcp", 00:26:26.685 "traddr": "10.0.0.2", 00:26:26.685 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:26.685 "adrfam": "ipv4", 00:26:26.685 "trsvcid": "8009", 00:26:26.685 "wait_for_attach": true, 00:26:26.685 "method": "bdev_nvme_start_discovery", 00:26:26.685 "req_id": 1 00:26:26.685 } 00:26:26.685 Got JSON-RPC error response 00:26:26.685 response: 00:26:26.685 { 00:26:26.685 "code": -17, 00:26:26.685 "message": "File exists" 00:26:26.685 } 00:26:26.685 02:02:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:26.685 02:02:15 -- common/autotest_common.sh@653 -- # es=1 00:26:26.685 02:02:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:26.685 02:02:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:26.685 02:02:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:26.685 02:02:15 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:26.685 02:02:15 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:26.685 02:02:15 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:26.685 02:02:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.685 02:02:15 -- common/autotest_common.sh@10 -- # set +x 00:26:26.685 02:02:15 -- host/discovery.sh@67 -- # sort 00:26:26.685 02:02:15 -- host/discovery.sh@67 -- # xargs 00:26:26.685 02:02:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.685 02:02:15 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:26.685 02:02:15 -- host/discovery.sh@147 -- # get_bdev_list 00:26:26.685 02:02:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.685 02:02:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:26.685 02:02:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.685 02:02:15 -- common/autotest_common.sh@10 -- # set +x 00:26:26.685 02:02:15 -- host/discovery.sh@55 -- # sort 00:26:26.685 02:02:15 -- host/discovery.sh@55 -- # xargs 00:26:26.685 02:02:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.685 02:02:15 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:26.685 02:02:15 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.685 02:02:15 -- common/autotest_common.sh@650 -- # local es=0 00:26:26.685 02:02:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.685 02:02:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:26.685 02:02:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.685 02:02:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:26.685 02:02:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.685 02:02:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.685 02:02:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.685 02:02:15 -- common/autotest_common.sh@10 -- # set +x 00:26:26.685 request: 00:26:26.685 { 00:26:26.685 "name": "nvme_second", 00:26:26.685 "trtype": "tcp", 00:26:26.685 "traddr": "10.0.0.2", 00:26:26.685 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:26.685 "adrfam": "ipv4", 00:26:26.685 "trsvcid": "8009", 00:26:26.685 "wait_for_attach": true, 00:26:26.685 "method": "bdev_nvme_start_discovery", 00:26:26.685 "req_id": 1 00:26:26.685 } 00:26:26.685 Got JSON-RPC error response 00:26:26.685 response: 00:26:26.685 { 00:26:26.685 "code": -17, 00:26:26.685 "message": "File exists" 00:26:26.685 } 00:26:26.685 02:02:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:26.686 02:02:15 -- common/autotest_common.sh@653 -- # es=1 00:26:26.686 02:02:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:26.686 02:02:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:26.686 02:02:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:26.686 02:02:15 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:26.686 02:02:15 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:26.686 02:02:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.686 02:02:15 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:26.686 02:02:15 -- common/autotest_common.sh@10 -- # set +x 00:26:26.686 02:02:15 -- host/discovery.sh@67 -- # sort 00:26:26.686 02:02:15 -- host/discovery.sh@67 -- # xargs 00:26:26.686 02:02:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.686 02:02:15 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:26.686 02:02:15 -- host/discovery.sh@153 -- # get_bdev_list 00:26:26.944 02:02:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.944 02:02:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.944 02:02:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:26.944 02:02:15 -- common/autotest_common.sh@10 -- # set +x 00:26:26.944 02:02:15 -- host/discovery.sh@55 -- # sort 00:26:26.944 02:02:15 -- host/discovery.sh@55 -- # xargs 00:26:26.944 02:02:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.944 02:02:15 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:26.944 02:02:15 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:26.944 02:02:15 -- common/autotest_common.sh@650 -- # local es=0 00:26:26.944 02:02:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:26.944 02:02:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:26.944 02:02:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.944 02:02:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:26.944 02:02:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.944 02:02:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:26.944 02:02:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.944 02:02:15 -- common/autotest_common.sh@10 -- # set +x 00:26:27.878 [2024-11-19 02:02:16.279344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:27.878 [2024-11-19 02:02:16.279543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:27.878 [2024-11-19 02:02:16.279570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ef63d0 with addr=10.0.0.2, port=8010 00:26:27.878 [2024-11-19 02:02:16.279594] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:27.878 [2024-11-19 02:02:16.279608] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:27.878 [2024-11-19 02:02:16.279620] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:28.810 [2024-11-19 02:02:17.281796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:28.810 [2024-11-19 02:02:17.281925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:28.810 [2024-11-19 02:02:17.281968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec2d30 with addr=10.0.0.2, port=8010 00:26:28.810 [2024-11-19 02:02:17.281989] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:28.810 [2024-11-19 02:02:17.282003] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:28.810 [2024-11-19 02:02:17.282016] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:29.743 [2024-11-19 02:02:18.284045] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:29.743 request: 00:26:29.743 { 00:26:29.743 "name": "nvme_second", 00:26:29.743 "trtype": "tcp", 00:26:29.743 "traddr": "10.0.0.2", 00:26:29.743 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:29.743 "adrfam": "ipv4", 00:26:29.743 "trsvcid": "8010", 00:26:29.743 "attach_timeout_ms": 3000, 00:26:29.743 "method": "bdev_nvme_start_discovery", 00:26:29.743 "req_id": 1 00:26:29.743 } 00:26:29.743 Got JSON-RPC error response 00:26:29.743 response: 00:26:29.743 { 00:26:29.743 "code": -110, 00:26:29.743 "message": "Connection timed out" 00:26:29.743 } 00:26:29.743 02:02:18 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:29.743 02:02:18 -- common/autotest_common.sh@653 -- # es=1 00:26:29.743 02:02:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:29.743 02:02:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:29.743 02:02:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:29.743 02:02:18 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:30.002 02:02:18 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:30.002 02:02:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.002 02:02:18 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:30.002 02:02:18 -- common/autotest_common.sh@10 -- # set +x 00:26:30.002 02:02:18 -- host/discovery.sh@67 -- # sort 00:26:30.002 02:02:18 -- host/discovery.sh@67 -- # xargs 00:26:30.002 02:02:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.002 02:02:18 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:30.002 02:02:18 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:30.002 02:02:18 -- host/discovery.sh@162 -- # kill 3548048 00:26:30.002 02:02:18 -- host/discovery.sh@163 -- # nvmftestfini 00:26:30.002 02:02:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:30.002 02:02:18 -- nvmf/common.sh@116 -- # sync 00:26:30.002 02:02:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:30.002 02:02:18 -- nvmf/common.sh@119 -- # set +e 00:26:30.002 02:02:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:30.002 02:02:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:30.002 rmmod nvme_tcp 00:26:30.002 rmmod nvme_fabrics 00:26:30.002 rmmod nvme_keyring 00:26:30.002 02:02:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:30.002 02:02:18 -- nvmf/common.sh@123 -- # set -e 00:26:30.002 02:02:18 -- nvmf/common.sh@124 -- # return 0 00:26:30.002 02:02:18 -- nvmf/common.sh@477 -- # '[' -n 3547890 ']' 00:26:30.002 02:02:18 -- nvmf/common.sh@478 -- # killprocess 3547890 00:26:30.002 02:02:18 -- common/autotest_common.sh@936 -- # '[' -z 3547890 ']' 00:26:30.002 02:02:18 -- common/autotest_common.sh@940 -- # kill -0 3547890 00:26:30.002 02:02:18 -- common/autotest_common.sh@941 -- # uname 00:26:30.002 02:02:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:30.002 02:02:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3547890 00:26:30.002 02:02:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:30.002 02:02:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:30.002 02:02:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3547890' 00:26:30.002 killing process with pid 3547890 00:26:30.002 02:02:18 -- common/autotest_common.sh@955 -- # kill 3547890 00:26:30.002 02:02:18 -- common/autotest_common.sh@960 -- # wait 3547890 00:26:30.262 02:02:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:30.262 02:02:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:30.262 02:02:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:30.262 02:02:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:30.262 02:02:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:30.262 02:02:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:30.262 02:02:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:30.262 02:02:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:32.827 02:02:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:32.827 00:26:32.827 real 0m17.556s 00:26:32.827 user 0m27.286s 00:26:32.827 sys 0m2.833s 00:26:32.827 02:02:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:32.827 02:02:20 -- common/autotest_common.sh@10 -- # set +x 00:26:32.827 ************************************ 00:26:32.827 END TEST nvmf_discovery 00:26:32.827 ************************************ 00:26:32.827 02:02:20 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:32.827 02:02:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:32.827 02:02:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:32.827 02:02:20 -- common/autotest_common.sh@10 -- # set +x 00:26:32.827 ************************************ 00:26:32.827 START TEST nvmf_discovery_remove_ifc 00:26:32.827 ************************************ 00:26:32.827 02:02:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:32.827 * Looking for test storage... 00:26:32.827 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:32.827 02:02:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:32.827 02:02:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:32.827 02:02:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:32.827 02:02:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:32.827 02:02:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:32.827 02:02:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:32.827 02:02:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:32.827 02:02:20 -- scripts/common.sh@335 -- # IFS=.-: 00:26:32.827 02:02:20 -- scripts/common.sh@335 -- # read -ra ver1 00:26:32.827 02:02:20 -- scripts/common.sh@336 -- # IFS=.-: 00:26:32.827 02:02:20 -- scripts/common.sh@336 -- # read -ra ver2 00:26:32.827 02:02:20 -- scripts/common.sh@337 -- # local 'op=<' 00:26:32.827 02:02:20 -- scripts/common.sh@339 -- # ver1_l=2 00:26:32.827 02:02:20 -- scripts/common.sh@340 -- # ver2_l=1 00:26:32.827 02:02:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:32.827 02:02:20 -- scripts/common.sh@343 -- # case "$op" in 00:26:32.827 02:02:20 -- scripts/common.sh@344 -- # : 1 00:26:32.827 02:02:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:32.827 02:02:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:32.827 02:02:20 -- scripts/common.sh@364 -- # decimal 1 00:26:32.827 02:02:20 -- scripts/common.sh@352 -- # local d=1 00:26:32.827 02:02:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:32.827 02:02:20 -- scripts/common.sh@354 -- # echo 1 00:26:32.827 02:02:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:32.827 02:02:20 -- scripts/common.sh@365 -- # decimal 2 00:26:32.827 02:02:20 -- scripts/common.sh@352 -- # local d=2 00:26:32.827 02:02:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:32.827 02:02:20 -- scripts/common.sh@354 -- # echo 2 00:26:32.827 02:02:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:32.827 02:02:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:32.827 02:02:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:32.827 02:02:20 -- scripts/common.sh@367 -- # return 0 00:26:32.827 02:02:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:32.828 02:02:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:32.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.828 --rc genhtml_branch_coverage=1 00:26:32.828 --rc genhtml_function_coverage=1 00:26:32.828 --rc genhtml_legend=1 00:26:32.828 --rc geninfo_all_blocks=1 00:26:32.828 --rc geninfo_unexecuted_blocks=1 00:26:32.828 00:26:32.828 ' 00:26:32.828 02:02:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:32.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.828 --rc genhtml_branch_coverage=1 00:26:32.828 --rc genhtml_function_coverage=1 00:26:32.828 --rc genhtml_legend=1 00:26:32.828 --rc geninfo_all_blocks=1 00:26:32.828 --rc geninfo_unexecuted_blocks=1 00:26:32.828 00:26:32.828 ' 00:26:32.828 02:02:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:32.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.828 --rc genhtml_branch_coverage=1 00:26:32.828 --rc genhtml_function_coverage=1 00:26:32.828 --rc genhtml_legend=1 00:26:32.828 --rc geninfo_all_blocks=1 00:26:32.828 --rc geninfo_unexecuted_blocks=1 00:26:32.828 00:26:32.828 ' 00:26:32.828 02:02:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:32.828 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.828 --rc genhtml_branch_coverage=1 00:26:32.828 --rc genhtml_function_coverage=1 00:26:32.828 --rc genhtml_legend=1 00:26:32.828 --rc geninfo_all_blocks=1 00:26:32.828 --rc geninfo_unexecuted_blocks=1 00:26:32.828 00:26:32.828 ' 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:32.828 02:02:20 -- nvmf/common.sh@7 -- # uname -s 00:26:32.828 02:02:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:32.828 02:02:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:32.828 02:02:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:32.828 02:02:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:32.828 02:02:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:32.828 02:02:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:32.828 02:02:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:32.828 02:02:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:32.828 02:02:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:32.828 02:02:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:32.828 02:02:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:32.828 02:02:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:32.828 02:02:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:32.828 02:02:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:32.828 02:02:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:32.828 02:02:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:32.828 02:02:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:32.828 02:02:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:32.828 02:02:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:32.828 02:02:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.828 02:02:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.828 02:02:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.828 02:02:20 -- paths/export.sh@5 -- # export PATH 00:26:32.828 02:02:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.828 02:02:20 -- nvmf/common.sh@46 -- # : 0 00:26:32.828 02:02:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:32.828 02:02:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:32.828 02:02:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:32.828 02:02:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:32.828 02:02:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:32.828 02:02:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:32.828 02:02:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:32.828 02:02:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:32.828 02:02:20 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:32.828 02:02:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:32.828 02:02:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:32.828 02:02:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:32.828 02:02:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:32.828 02:02:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:32.828 02:02:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:32.828 02:02:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:32.828 02:02:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:32.828 02:02:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:32.828 02:02:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:32.828 02:02:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:32.828 02:02:20 -- common/autotest_common.sh@10 -- # set +x 00:26:34.751 02:02:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:34.751 02:02:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:34.751 02:02:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:34.751 02:02:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:34.751 02:02:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:34.751 02:02:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:34.751 02:02:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:34.751 02:02:22 -- nvmf/common.sh@294 -- # net_devs=() 00:26:34.751 02:02:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:34.751 02:02:22 -- nvmf/common.sh@295 -- # e810=() 00:26:34.751 02:02:22 -- nvmf/common.sh@295 -- # local -ga e810 00:26:34.751 02:02:22 -- nvmf/common.sh@296 -- # x722=() 00:26:34.751 02:02:22 -- nvmf/common.sh@296 -- # local -ga x722 00:26:34.751 02:02:22 -- nvmf/common.sh@297 -- # mlx=() 00:26:34.751 02:02:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:34.751 02:02:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:34.751 02:02:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:34.751 02:02:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:34.751 02:02:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:34.751 02:02:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:34.751 02:02:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:34.751 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:34.751 02:02:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:34.751 02:02:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:34.751 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:34.751 02:02:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:34.751 02:02:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:34.751 02:02:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:34.751 02:02:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:34.751 02:02:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:34.751 02:02:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:34.751 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:34.751 02:02:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:34.751 02:02:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:34.751 02:02:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:34.751 02:02:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:34.751 02:02:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:34.751 02:02:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:34.751 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:34.751 02:02:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:34.751 02:02:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:34.751 02:02:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:34.751 02:02:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:34.751 02:02:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:34.751 02:02:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:34.751 02:02:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:34.751 02:02:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:34.751 02:02:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:34.751 02:02:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:34.751 02:02:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:34.751 02:02:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:34.751 02:02:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:34.751 02:02:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:34.751 02:02:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:34.751 02:02:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:34.751 02:02:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:34.751 02:02:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:34.751 02:02:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:34.751 02:02:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:34.751 02:02:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:34.751 02:02:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:34.751 02:02:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:34.751 02:02:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:34.751 02:02:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:34.751 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:34.751 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:26:34.751 00:26:34.751 --- 10.0.0.2 ping statistics --- 00:26:34.751 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:34.751 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:26:34.751 02:02:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:34.751 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:34.751 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:26:34.751 00:26:34.751 --- 10.0.0.1 ping statistics --- 00:26:34.751 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:34.751 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:26:34.751 02:02:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:34.751 02:02:23 -- nvmf/common.sh@410 -- # return 0 00:26:34.751 02:02:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:34.751 02:02:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:34.751 02:02:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:34.751 02:02:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:34.751 02:02:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:34.751 02:02:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:34.751 02:02:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:34.751 02:02:23 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:34.751 02:02:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:34.751 02:02:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:34.751 02:02:23 -- common/autotest_common.sh@10 -- # set +x 00:26:34.751 02:02:23 -- nvmf/common.sh@469 -- # nvmfpid=3551649 00:26:34.751 02:02:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:34.751 02:02:23 -- nvmf/common.sh@470 -- # waitforlisten 3551649 00:26:34.751 02:02:23 -- common/autotest_common.sh@829 -- # '[' -z 3551649 ']' 00:26:34.751 02:02:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:34.751 02:02:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:34.751 02:02:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:34.751 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:34.751 02:02:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:34.751 02:02:23 -- common/autotest_common.sh@10 -- # set +x 00:26:34.751 [2024-11-19 02:02:23.120503] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:34.751 [2024-11-19 02:02:23.120575] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:34.751 EAL: No free 2048 kB hugepages reported on node 1 00:26:34.751 [2024-11-19 02:02:23.189932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:35.009 [2024-11-19 02:02:23.308145] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:35.009 [2024-11-19 02:02:23.308305] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:35.009 [2024-11-19 02:02:23.308325] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:35.009 [2024-11-19 02:02:23.308339] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:35.009 [2024-11-19 02:02:23.308384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:35.942 02:02:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:35.942 02:02:24 -- common/autotest_common.sh@862 -- # return 0 00:26:35.942 02:02:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:35.942 02:02:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:35.942 02:02:24 -- common/autotest_common.sh@10 -- # set +x 00:26:35.942 02:02:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:35.942 02:02:24 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:35.942 02:02:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.942 02:02:24 -- common/autotest_common.sh@10 -- # set +x 00:26:35.942 [2024-11-19 02:02:24.205820] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:35.942 [2024-11-19 02:02:24.213990] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:35.942 null0 00:26:35.942 [2024-11-19 02:02:24.245961] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:35.942 02:02:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.942 02:02:24 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3551807 00:26:35.942 02:02:24 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:35.942 02:02:24 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3551807 /tmp/host.sock 00:26:35.942 02:02:24 -- common/autotest_common.sh@829 -- # '[' -z 3551807 ']' 00:26:35.942 02:02:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:35.942 02:02:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:35.942 02:02:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:35.942 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:35.942 02:02:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:35.942 02:02:24 -- common/autotest_common.sh@10 -- # set +x 00:26:35.942 [2024-11-19 02:02:24.308168] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:35.942 [2024-11-19 02:02:24.308241] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3551807 ] 00:26:35.942 EAL: No free 2048 kB hugepages reported on node 1 00:26:35.942 [2024-11-19 02:02:24.372914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:36.201 [2024-11-19 02:02:24.490138] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:36.201 [2024-11-19 02:02:24.490320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:36.201 02:02:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:36.201 02:02:24 -- common/autotest_common.sh@862 -- # return 0 00:26:36.201 02:02:24 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:36.201 02:02:24 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:36.201 02:02:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.201 02:02:24 -- common/autotest_common.sh@10 -- # set +x 00:26:36.201 02:02:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.201 02:02:24 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:36.201 02:02:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.201 02:02:24 -- common/autotest_common.sh@10 -- # set +x 00:26:36.201 02:02:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.201 02:02:24 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:36.201 02:02:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.201 02:02:24 -- common/autotest_common.sh@10 -- # set +x 00:26:37.574 [2024-11-19 02:02:25.684804] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:37.574 [2024-11-19 02:02:25.684834] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:37.574 [2024-11-19 02:02:25.684857] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:37.574 [2024-11-19 02:02:25.771160] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:37.574 [2024-11-19 02:02:25.995163] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:37.574 [2024-11-19 02:02:25.995219] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:37.574 [2024-11-19 02:02:25.995261] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:37.574 [2024-11-19 02:02:25.995285] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:37.574 [2024-11-19 02:02:25.995310] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:37.574 02:02:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.574 02:02:25 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:37.574 02:02:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.574 02:02:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.574 02:02:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.574 02:02:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.574 02:02:25 -- common/autotest_common.sh@10 -- # set +x 00:26:37.574 02:02:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.574 02:02:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:37.574 [2024-11-19 02:02:26.002209] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x121ad40 was disconnected and freed. delete nvme_qpair. 00:26:37.574 02:02:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.574 02:02:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.574 02:02:26 -- common/autotest_common.sh@10 -- # set +x 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.574 02:02:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:37.832 02:02:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.832 02:02:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:37.832 02:02:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:38.766 02:02:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.766 02:02:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.766 02:02:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.766 02:02:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.766 02:02:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.767 02:02:27 -- common/autotest_common.sh@10 -- # set +x 00:26:38.767 02:02:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.767 02:02:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.767 02:02:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:38.767 02:02:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:39.702 02:02:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.702 02:02:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.702 02:02:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.702 02:02:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.702 02:02:28 -- common/autotest_common.sh@10 -- # set +x 00:26:39.702 02:02:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.702 02:02:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.702 02:02:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.702 02:02:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:39.702 02:02:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:41.074 02:02:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.074 02:02:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.074 02:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.074 02:02:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.074 02:02:29 -- common/autotest_common.sh@10 -- # set +x 00:26:41.074 02:02:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.074 02:02:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.074 02:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.074 02:02:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:41.074 02:02:29 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.007 02:02:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.007 02:02:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.007 02:02:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.007 02:02:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.007 02:02:30 -- common/autotest_common.sh@10 -- # set +x 00:26:42.007 02:02:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.007 02:02:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.007 02:02:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.007 02:02:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:42.007 02:02:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.940 02:02:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.940 02:02:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.940 02:02:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.940 02:02:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.940 02:02:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.940 02:02:31 -- common/autotest_common.sh@10 -- # set +x 00:26:42.940 02:02:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.940 02:02:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.940 02:02:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:42.940 02:02:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.940 [2024-11-19 02:02:31.436294] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:42.940 [2024-11-19 02:02:31.436359] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.940 [2024-11-19 02:02:31.436382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.940 [2024-11-19 02:02:31.436401] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.940 [2024-11-19 02:02:31.436417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.940 [2024-11-19 02:02:31.436433] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.940 [2024-11-19 02:02:31.436447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.940 [2024-11-19 02:02:31.436462] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.940 [2024-11-19 02:02:31.436486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.940 [2024-11-19 02:02:31.436503] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.940 [2024-11-19 02:02:31.436518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.940 [2024-11-19 02:02:31.436532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11e1430 is same with the state(5) to be set 00:26:42.940 [2024-11-19 02:02:31.446313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11e1430 (9): Bad file descriptor 00:26:42.940 [2024-11-19 02:02:31.456363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:43.872 02:02:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.872 02:02:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.872 02:02:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.872 02:02:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.872 02:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.872 02:02:32 -- common/autotest_common.sh@10 -- # set +x 00:26:43.872 02:02:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:44.129 [2024-11-19 02:02:32.473689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:45.061 [2024-11-19 02:02:33.497681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:45.061 [2024-11-19 02:02:33.497726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11e1430 with addr=10.0.0.2, port=4420 00:26:45.061 [2024-11-19 02:02:33.497749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11e1430 is same with the state(5) to be set 00:26:45.061 [2024-11-19 02:02:33.497780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:45.061 [2024-11-19 02:02:33.497795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:45.061 [2024-11-19 02:02:33.497807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:45.061 [2024-11-19 02:02:33.497821] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:45.061 [2024-11-19 02:02:33.498248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11e1430 (9): Bad file descriptor 00:26:45.061 [2024-11-19 02:02:33.498292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:45.061 [2024-11-19 02:02:33.498329] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:45.061 [2024-11-19 02:02:33.498366] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.061 [2024-11-19 02:02:33.498390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.061 [2024-11-19 02:02:33.498409] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.061 [2024-11-19 02:02:33.498423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.061 [2024-11-19 02:02:33.498439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.061 [2024-11-19 02:02:33.498453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.061 [2024-11-19 02:02:33.498469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.061 [2024-11-19 02:02:33.498483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.061 [2024-11-19 02:02:33.498507] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:45.061 [2024-11-19 02:02:33.498522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.061 [2024-11-19 02:02:33.498536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:45.061 [2024-11-19 02:02:33.498782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11e1840 (9): Bad file descriptor 00:26:45.061 [2024-11-19 02:02:33.499799] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:45.061 [2024-11-19 02:02:33.499820] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:45.061 02:02:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.061 02:02:33 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:45.061 02:02:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:45.994 02:02:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:45.994 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:45.994 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:45.994 02:02:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.994 02:02:34 -- common/autotest_common.sh@10 -- # set +x 00:26:45.994 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:45.994 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:45.994 02:02:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.252 02:02:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.252 02:02:34 -- common/autotest_common.sh@10 -- # set +x 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.252 02:02:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:46.252 02:02:34 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:47.185 [2024-11-19 02:02:35.509495] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:47.185 [2024-11-19 02:02:35.509530] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:47.185 [2024-11-19 02:02:35.509551] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:47.185 [2024-11-19 02:02:35.597834] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:47.185 [2024-11-19 02:02:35.659446] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:47.185 [2024-11-19 02:02:35.659491] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:47.185 [2024-11-19 02:02:35.659521] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:47.185 [2024-11-19 02:02:35.659541] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:47.185 [2024-11-19 02:02:35.659552] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:47.185 [2024-11-19 02:02:35.668184] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x11efef0 was disconnected and freed. delete nvme_qpair. 00:26:47.185 02:02:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:47.185 02:02:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:47.185 02:02:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:47.185 02:02:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.185 02:02:35 -- common/autotest_common.sh@10 -- # set +x 00:26:47.185 02:02:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:47.185 02:02:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:47.185 02:02:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:47.443 02:02:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:47.443 02:02:35 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:47.443 02:02:35 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3551807 00:26:47.443 02:02:35 -- common/autotest_common.sh@936 -- # '[' -z 3551807 ']' 00:26:47.443 02:02:35 -- common/autotest_common.sh@940 -- # kill -0 3551807 00:26:47.443 02:02:35 -- common/autotest_common.sh@941 -- # uname 00:26:47.443 02:02:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:47.443 02:02:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3551807 00:26:47.443 02:02:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:47.443 02:02:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:47.443 02:02:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3551807' 00:26:47.443 killing process with pid 3551807 00:26:47.443 02:02:35 -- common/autotest_common.sh@955 -- # kill 3551807 00:26:47.443 02:02:35 -- common/autotest_common.sh@960 -- # wait 3551807 00:26:47.701 02:02:36 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:47.701 02:02:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:47.701 02:02:36 -- nvmf/common.sh@116 -- # sync 00:26:47.701 02:02:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:47.701 02:02:36 -- nvmf/common.sh@119 -- # set +e 00:26:47.701 02:02:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:47.701 02:02:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:47.701 rmmod nvme_tcp 00:26:47.701 rmmod nvme_fabrics 00:26:47.701 rmmod nvme_keyring 00:26:47.701 02:02:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:47.701 02:02:36 -- nvmf/common.sh@123 -- # set -e 00:26:47.701 02:02:36 -- nvmf/common.sh@124 -- # return 0 00:26:47.701 02:02:36 -- nvmf/common.sh@477 -- # '[' -n 3551649 ']' 00:26:47.701 02:02:36 -- nvmf/common.sh@478 -- # killprocess 3551649 00:26:47.701 02:02:36 -- common/autotest_common.sh@936 -- # '[' -z 3551649 ']' 00:26:47.701 02:02:36 -- common/autotest_common.sh@940 -- # kill -0 3551649 00:26:47.701 02:02:36 -- common/autotest_common.sh@941 -- # uname 00:26:47.701 02:02:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:47.701 02:02:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3551649 00:26:47.701 02:02:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:47.701 02:02:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:47.701 02:02:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3551649' 00:26:47.701 killing process with pid 3551649 00:26:47.701 02:02:36 -- common/autotest_common.sh@955 -- # kill 3551649 00:26:47.701 02:02:36 -- common/autotest_common.sh@960 -- # wait 3551649 00:26:47.959 02:02:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:47.959 02:02:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:47.959 02:02:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:47.959 02:02:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:47.959 02:02:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:47.959 02:02:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:47.959 02:02:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:47.959 02:02:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:50.492 02:02:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:50.492 00:26:50.492 real 0m17.674s 00:26:50.492 user 0m24.043s 00:26:50.492 sys 0m2.912s 00:26:50.492 02:02:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:50.492 02:02:38 -- common/autotest_common.sh@10 -- # set +x 00:26:50.492 ************************************ 00:26:50.492 END TEST nvmf_discovery_remove_ifc 00:26:50.492 ************************************ 00:26:50.492 02:02:38 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:50.492 02:02:38 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:50.492 02:02:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:50.492 02:02:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:50.492 02:02:38 -- common/autotest_common.sh@10 -- # set +x 00:26:50.492 ************************************ 00:26:50.492 START TEST nvmf_digest 00:26:50.492 ************************************ 00:26:50.492 02:02:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:50.492 * Looking for test storage... 00:26:50.492 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:50.492 02:02:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:50.492 02:02:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:50.492 02:02:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:50.492 02:02:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:50.492 02:02:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:50.492 02:02:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:50.492 02:02:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:50.492 02:02:38 -- scripts/common.sh@335 -- # IFS=.-: 00:26:50.492 02:02:38 -- scripts/common.sh@335 -- # read -ra ver1 00:26:50.492 02:02:38 -- scripts/common.sh@336 -- # IFS=.-: 00:26:50.492 02:02:38 -- scripts/common.sh@336 -- # read -ra ver2 00:26:50.492 02:02:38 -- scripts/common.sh@337 -- # local 'op=<' 00:26:50.492 02:02:38 -- scripts/common.sh@339 -- # ver1_l=2 00:26:50.492 02:02:38 -- scripts/common.sh@340 -- # ver2_l=1 00:26:50.492 02:02:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:50.492 02:02:38 -- scripts/common.sh@343 -- # case "$op" in 00:26:50.492 02:02:38 -- scripts/common.sh@344 -- # : 1 00:26:50.492 02:02:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:50.492 02:02:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:50.492 02:02:38 -- scripts/common.sh@364 -- # decimal 1 00:26:50.492 02:02:38 -- scripts/common.sh@352 -- # local d=1 00:26:50.492 02:02:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:50.492 02:02:38 -- scripts/common.sh@354 -- # echo 1 00:26:50.492 02:02:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:50.492 02:02:38 -- scripts/common.sh@365 -- # decimal 2 00:26:50.492 02:02:38 -- scripts/common.sh@352 -- # local d=2 00:26:50.492 02:02:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:50.492 02:02:38 -- scripts/common.sh@354 -- # echo 2 00:26:50.492 02:02:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:50.492 02:02:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:50.492 02:02:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:50.492 02:02:38 -- scripts/common.sh@367 -- # return 0 00:26:50.492 02:02:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:50.492 02:02:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:50.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.492 --rc genhtml_branch_coverage=1 00:26:50.492 --rc genhtml_function_coverage=1 00:26:50.492 --rc genhtml_legend=1 00:26:50.492 --rc geninfo_all_blocks=1 00:26:50.492 --rc geninfo_unexecuted_blocks=1 00:26:50.492 00:26:50.492 ' 00:26:50.492 02:02:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:50.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.492 --rc genhtml_branch_coverage=1 00:26:50.492 --rc genhtml_function_coverage=1 00:26:50.492 --rc genhtml_legend=1 00:26:50.492 --rc geninfo_all_blocks=1 00:26:50.492 --rc geninfo_unexecuted_blocks=1 00:26:50.492 00:26:50.492 ' 00:26:50.492 02:02:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:50.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.492 --rc genhtml_branch_coverage=1 00:26:50.492 --rc genhtml_function_coverage=1 00:26:50.492 --rc genhtml_legend=1 00:26:50.492 --rc geninfo_all_blocks=1 00:26:50.492 --rc geninfo_unexecuted_blocks=1 00:26:50.492 00:26:50.492 ' 00:26:50.492 02:02:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:50.492 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.492 --rc genhtml_branch_coverage=1 00:26:50.492 --rc genhtml_function_coverage=1 00:26:50.492 --rc genhtml_legend=1 00:26:50.492 --rc geninfo_all_blocks=1 00:26:50.492 --rc geninfo_unexecuted_blocks=1 00:26:50.492 00:26:50.492 ' 00:26:50.492 02:02:38 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:50.492 02:02:38 -- nvmf/common.sh@7 -- # uname -s 00:26:50.492 02:02:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:50.492 02:02:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:50.492 02:02:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:50.492 02:02:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:50.492 02:02:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:50.492 02:02:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:50.492 02:02:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:50.492 02:02:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:50.492 02:02:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:50.492 02:02:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:50.492 02:02:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:50.492 02:02:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:50.492 02:02:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:50.492 02:02:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:50.492 02:02:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:50.492 02:02:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:50.492 02:02:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:50.492 02:02:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:50.492 02:02:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:50.492 02:02:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.492 02:02:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.492 02:02:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.492 02:02:38 -- paths/export.sh@5 -- # export PATH 00:26:50.492 02:02:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.492 02:02:38 -- nvmf/common.sh@46 -- # : 0 00:26:50.492 02:02:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:50.492 02:02:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:50.492 02:02:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:50.493 02:02:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:50.493 02:02:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:50.493 02:02:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:50.493 02:02:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:50.493 02:02:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:50.493 02:02:38 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:50.493 02:02:38 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:50.493 02:02:38 -- host/digest.sh@16 -- # runtime=2 00:26:50.493 02:02:38 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:50.493 02:02:38 -- host/digest.sh@132 -- # nvmftestinit 00:26:50.493 02:02:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:50.493 02:02:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:50.493 02:02:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:50.493 02:02:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:50.493 02:02:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:50.493 02:02:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:50.493 02:02:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:50.493 02:02:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:50.493 02:02:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:50.493 02:02:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:50.493 02:02:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:50.493 02:02:38 -- common/autotest_common.sh@10 -- # set +x 00:26:52.394 02:02:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:52.394 02:02:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:52.394 02:02:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:52.394 02:02:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:52.394 02:02:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:52.394 02:02:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:52.394 02:02:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:52.394 02:02:40 -- nvmf/common.sh@294 -- # net_devs=() 00:26:52.394 02:02:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:52.394 02:02:40 -- nvmf/common.sh@295 -- # e810=() 00:26:52.394 02:02:40 -- nvmf/common.sh@295 -- # local -ga e810 00:26:52.394 02:02:40 -- nvmf/common.sh@296 -- # x722=() 00:26:52.394 02:02:40 -- nvmf/common.sh@296 -- # local -ga x722 00:26:52.394 02:02:40 -- nvmf/common.sh@297 -- # mlx=() 00:26:52.394 02:02:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:52.394 02:02:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:52.394 02:02:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:52.394 02:02:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:52.394 02:02:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:52.394 02:02:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.394 02:02:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:52.394 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:52.394 02:02:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.394 02:02:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:52.394 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:52.394 02:02:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:52.394 02:02:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.394 02:02:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.394 02:02:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.394 02:02:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.394 02:02:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:52.394 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:52.394 02:02:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.394 02:02:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.394 02:02:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.394 02:02:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.394 02:02:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.394 02:02:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:52.394 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:52.394 02:02:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.394 02:02:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:52.394 02:02:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:52.394 02:02:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:52.394 02:02:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:52.394 02:02:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:52.394 02:02:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:52.394 02:02:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:52.394 02:02:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:52.394 02:02:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:52.394 02:02:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:52.394 02:02:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:52.394 02:02:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:52.394 02:02:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:52.394 02:02:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:52.394 02:02:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:52.394 02:02:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:52.394 02:02:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:52.394 02:02:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:52.394 02:02:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:52.394 02:02:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:52.394 02:02:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:52.394 02:02:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:52.394 02:02:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:52.394 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:52.394 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.276 ms 00:26:52.394 00:26:52.394 --- 10.0.0.2 ping statistics --- 00:26:52.394 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.394 rtt min/avg/max/mdev = 0.276/0.276/0.276/0.000 ms 00:26:52.394 02:02:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:52.394 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:52.394 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:26:52.394 00:26:52.394 --- 10.0.0.1 ping statistics --- 00:26:52.394 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.394 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:26:52.394 02:02:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:52.394 02:02:40 -- nvmf/common.sh@410 -- # return 0 00:26:52.394 02:02:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:52.394 02:02:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:52.394 02:02:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:52.394 02:02:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:52.394 02:02:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:52.394 02:02:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:52.394 02:02:40 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:52.394 02:02:40 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:52.394 02:02:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:52.394 02:02:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:52.394 02:02:40 -- common/autotest_common.sh@10 -- # set +x 00:26:52.394 ************************************ 00:26:52.394 START TEST nvmf_digest_clean 00:26:52.394 ************************************ 00:26:52.394 02:02:40 -- common/autotest_common.sh@1114 -- # run_digest 00:26:52.394 02:02:40 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:52.394 02:02:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:52.394 02:02:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:52.394 02:02:40 -- common/autotest_common.sh@10 -- # set +x 00:26:52.394 02:02:40 -- nvmf/common.sh@469 -- # nvmfpid=3555193 00:26:52.394 02:02:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:52.394 02:02:40 -- nvmf/common.sh@470 -- # waitforlisten 3555193 00:26:52.394 02:02:40 -- common/autotest_common.sh@829 -- # '[' -z 3555193 ']' 00:26:52.394 02:02:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:52.394 02:02:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:52.394 02:02:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:52.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:52.394 02:02:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:52.394 02:02:40 -- common/autotest_common.sh@10 -- # set +x 00:26:52.394 [2024-11-19 02:02:40.917355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:52.394 [2024-11-19 02:02:40.917425] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:52.653 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.653 [2024-11-19 02:02:40.983082] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:52.653 [2024-11-19 02:02:41.087696] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:52.653 [2024-11-19 02:02:41.087846] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:52.653 [2024-11-19 02:02:41.087875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:52.653 [2024-11-19 02:02:41.087888] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:52.653 [2024-11-19 02:02:41.087915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:52.653 02:02:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:52.653 02:02:41 -- common/autotest_common.sh@862 -- # return 0 00:26:52.653 02:02:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:52.653 02:02:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:52.653 02:02:41 -- common/autotest_common.sh@10 -- # set +x 00:26:52.653 02:02:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:52.653 02:02:41 -- host/digest.sh@120 -- # common_target_config 00:26:52.653 02:02:41 -- host/digest.sh@43 -- # rpc_cmd 00:26:52.653 02:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:52.653 02:02:41 -- common/autotest_common.sh@10 -- # set +x 00:26:52.911 null0 00:26:52.911 [2024-11-19 02:02:41.279715] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:52.911 [2024-11-19 02:02:41.303934] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:52.911 02:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:52.911 02:02:41 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:52.911 02:02:41 -- host/digest.sh@77 -- # local rw bs qd 00:26:52.911 02:02:41 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:52.911 02:02:41 -- host/digest.sh@80 -- # rw=randread 00:26:52.911 02:02:41 -- host/digest.sh@80 -- # bs=4096 00:26:52.911 02:02:41 -- host/digest.sh@80 -- # qd=128 00:26:52.911 02:02:41 -- host/digest.sh@82 -- # bperfpid=3555333 00:26:52.911 02:02:41 -- host/digest.sh@83 -- # waitforlisten 3555333 /var/tmp/bperf.sock 00:26:52.911 02:02:41 -- common/autotest_common.sh@829 -- # '[' -z 3555333 ']' 00:26:52.911 02:02:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:52.911 02:02:41 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:52.911 02:02:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:52.911 02:02:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:52.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:52.911 02:02:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:52.911 02:02:41 -- common/autotest_common.sh@10 -- # set +x 00:26:52.911 [2024-11-19 02:02:41.349215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:52.911 [2024-11-19 02:02:41.349296] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3555333 ] 00:26:52.911 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.911 [2024-11-19 02:02:41.413603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:53.169 [2024-11-19 02:02:41.528515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:53.169 02:02:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:53.169 02:02:41 -- common/autotest_common.sh@862 -- # return 0 00:26:53.169 02:02:41 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:53.169 02:02:41 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:53.169 02:02:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:53.427 02:02:41 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.427 02:02:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.992 nvme0n1 00:26:53.992 02:02:42 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:53.992 02:02:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:53.992 Running I/O for 2 seconds... 00:26:55.891 00:26:55.891 Latency(us) 00:26:55.891 [2024-11-19T01:02:44.434Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.891 [2024-11-19T01:02:44.434Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:55.891 nvme0n1 : 2.01 16757.95 65.46 0.00 0.00 7631.61 3034.07 17185.00 00:26:55.891 [2024-11-19T01:02:44.434Z] =================================================================================================================== 00:26:55.891 [2024-11-19T01:02:44.434Z] Total : 16757.95 65.46 0.00 0.00 7631.61 3034.07 17185.00 00:26:55.891 0 00:26:55.891 02:02:44 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:55.891 02:02:44 -- host/digest.sh@92 -- # get_accel_stats 00:26:55.891 02:02:44 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:55.891 02:02:44 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:55.891 | select(.opcode=="crc32c") 00:26:55.891 | "\(.module_name) \(.executed)"' 00:26:55.891 02:02:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:56.148 02:02:44 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:56.148 02:02:44 -- host/digest.sh@93 -- # exp_module=software 00:26:56.148 02:02:44 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:56.148 02:02:44 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:56.148 02:02:44 -- host/digest.sh@97 -- # killprocess 3555333 00:26:56.148 02:02:44 -- common/autotest_common.sh@936 -- # '[' -z 3555333 ']' 00:26:56.148 02:02:44 -- common/autotest_common.sh@940 -- # kill -0 3555333 00:26:56.148 02:02:44 -- common/autotest_common.sh@941 -- # uname 00:26:56.148 02:02:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.148 02:02:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3555333 00:26:56.407 02:02:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:56.407 02:02:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:56.407 02:02:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3555333' 00:26:56.407 killing process with pid 3555333 00:26:56.407 02:02:44 -- common/autotest_common.sh@955 -- # kill 3555333 00:26:56.407 Received shutdown signal, test time was about 2.000000 seconds 00:26:56.407 00:26:56.407 Latency(us) 00:26:56.407 [2024-11-19T01:02:44.950Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.407 [2024-11-19T01:02:44.950Z] =================================================================================================================== 00:26:56.407 [2024-11-19T01:02:44.950Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:56.407 02:02:44 -- common/autotest_common.sh@960 -- # wait 3555333 00:26:56.407 02:02:44 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:56.407 02:02:44 -- host/digest.sh@77 -- # local rw bs qd 00:26:56.407 02:02:44 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:56.407 02:02:44 -- host/digest.sh@80 -- # rw=randread 00:26:56.407 02:02:44 -- host/digest.sh@80 -- # bs=131072 00:26:56.407 02:02:44 -- host/digest.sh@80 -- # qd=16 00:26:56.665 02:02:44 -- host/digest.sh@82 -- # bperfpid=3555759 00:26:56.665 02:02:44 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:56.665 02:02:44 -- host/digest.sh@83 -- # waitforlisten 3555759 /var/tmp/bperf.sock 00:26:56.665 02:02:44 -- common/autotest_common.sh@829 -- # '[' -z 3555759 ']' 00:26:56.665 02:02:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:56.665 02:02:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.665 02:02:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:56.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:56.665 02:02:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.665 02:02:44 -- common/autotest_common.sh@10 -- # set +x 00:26:56.665 [2024-11-19 02:02:44.993005] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.665 [2024-11-19 02:02:44.993087] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3555759 ] 00:26:56.665 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:56.665 Zero copy mechanism will not be used. 00:26:56.665 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.665 [2024-11-19 02:02:45.053602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.665 [2024-11-19 02:02:45.164422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:56.665 02:02:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:56.665 02:02:45 -- common/autotest_common.sh@862 -- # return 0 00:26:56.665 02:02:45 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:56.665 02:02:45 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:56.665 02:02:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:57.232 02:02:45 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.232 02:02:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.490 nvme0n1 00:26:57.490 02:02:45 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:57.490 02:02:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:57.490 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:57.490 Zero copy mechanism will not be used. 00:26:57.490 Running I/O for 2 seconds... 00:27:00.017 00:27:00.017 Latency(us) 00:27:00.017 [2024-11-19T01:02:48.560Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.017 [2024-11-19T01:02:48.560Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:00.017 nvme0n1 : 2.00 6108.56 763.57 0.00 0.00 2615.33 782.79 5849.69 00:27:00.017 [2024-11-19T01:02:48.560Z] =================================================================================================================== 00:27:00.017 [2024-11-19T01:02:48.560Z] Total : 6108.56 763.57 0.00 0.00 2615.33 782.79 5849.69 00:27:00.017 0 00:27:00.017 02:02:47 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:00.017 02:02:47 -- host/digest.sh@92 -- # get_accel_stats 00:27:00.017 02:02:47 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:00.017 02:02:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:00.017 02:02:47 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:00.017 | select(.opcode=="crc32c") 00:27:00.017 | "\(.module_name) \(.executed)"' 00:27:00.017 02:02:48 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:00.017 02:02:48 -- host/digest.sh@93 -- # exp_module=software 00:27:00.017 02:02:48 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:00.017 02:02:48 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:00.017 02:02:48 -- host/digest.sh@97 -- # killprocess 3555759 00:27:00.017 02:02:48 -- common/autotest_common.sh@936 -- # '[' -z 3555759 ']' 00:27:00.017 02:02:48 -- common/autotest_common.sh@940 -- # kill -0 3555759 00:27:00.017 02:02:48 -- common/autotest_common.sh@941 -- # uname 00:27:00.017 02:02:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:00.017 02:02:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3555759 00:27:00.017 02:02:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:00.017 02:02:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:00.017 02:02:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3555759' 00:27:00.017 killing process with pid 3555759 00:27:00.017 02:02:48 -- common/autotest_common.sh@955 -- # kill 3555759 00:27:00.017 Received shutdown signal, test time was about 2.000000 seconds 00:27:00.017 00:27:00.017 Latency(us) 00:27:00.017 [2024-11-19T01:02:48.560Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.017 [2024-11-19T01:02:48.560Z] =================================================================================================================== 00:27:00.017 [2024-11-19T01:02:48.560Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:00.017 02:02:48 -- common/autotest_common.sh@960 -- # wait 3555759 00:27:00.017 02:02:48 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:27:00.017 02:02:48 -- host/digest.sh@77 -- # local rw bs qd 00:27:00.017 02:02:48 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:00.017 02:02:48 -- host/digest.sh@80 -- # rw=randwrite 00:27:00.017 02:02:48 -- host/digest.sh@80 -- # bs=4096 00:27:00.017 02:02:48 -- host/digest.sh@80 -- # qd=128 00:27:00.017 02:02:48 -- host/digest.sh@82 -- # bperfpid=3556175 00:27:00.017 02:02:48 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:27:00.017 02:02:48 -- host/digest.sh@83 -- # waitforlisten 3556175 /var/tmp/bperf.sock 00:27:00.017 02:02:48 -- common/autotest_common.sh@829 -- # '[' -z 3556175 ']' 00:27:00.017 02:02:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.017 02:02:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.017 02:02:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.017 02:02:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.017 02:02:48 -- common/autotest_common.sh@10 -- # set +x 00:27:00.275 [2024-11-19 02:02:48.565066] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.275 [2024-11-19 02:02:48.565144] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3556175 ] 00:27:00.275 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.275 [2024-11-19 02:02:48.626206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.275 [2024-11-19 02:02:48.738706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:00.275 02:02:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:00.275 02:02:48 -- common/autotest_common.sh@862 -- # return 0 00:27:00.275 02:02:48 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:00.275 02:02:48 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:00.275 02:02:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:00.841 02:02:49 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:00.841 02:02:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.098 nvme0n1 00:27:01.098 02:02:49 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:01.098 02:02:49 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:01.098 Running I/O for 2 seconds... 00:27:03.626 00:27:03.626 Latency(us) 00:27:03.626 [2024-11-19T01:02:52.169Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:03.626 [2024-11-19T01:02:52.169Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:03.626 nvme0n1 : 2.01 19926.26 77.84 0.00 0.00 6409.78 2597.17 14466.47 00:27:03.626 [2024-11-19T01:02:52.169Z] =================================================================================================================== 00:27:03.626 [2024-11-19T01:02:52.169Z] Total : 19926.26 77.84 0.00 0.00 6409.78 2597.17 14466.47 00:27:03.626 0 00:27:03.626 02:02:51 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:03.626 02:02:51 -- host/digest.sh@92 -- # get_accel_stats 00:27:03.626 02:02:51 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:03.626 02:02:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:03.626 02:02:51 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:03.626 | select(.opcode=="crc32c") 00:27:03.626 | "\(.module_name) \(.executed)"' 00:27:03.626 02:02:51 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:03.626 02:02:51 -- host/digest.sh@93 -- # exp_module=software 00:27:03.626 02:02:51 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:03.626 02:02:51 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:03.626 02:02:51 -- host/digest.sh@97 -- # killprocess 3556175 00:27:03.626 02:02:51 -- common/autotest_common.sh@936 -- # '[' -z 3556175 ']' 00:27:03.626 02:02:51 -- common/autotest_common.sh@940 -- # kill -0 3556175 00:27:03.626 02:02:51 -- common/autotest_common.sh@941 -- # uname 00:27:03.626 02:02:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:03.626 02:02:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3556175 00:27:03.626 02:02:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:03.626 02:02:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:03.626 02:02:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3556175' 00:27:03.626 killing process with pid 3556175 00:27:03.626 02:02:51 -- common/autotest_common.sh@955 -- # kill 3556175 00:27:03.626 Received shutdown signal, test time was about 2.000000 seconds 00:27:03.626 00:27:03.626 Latency(us) 00:27:03.626 [2024-11-19T01:02:52.169Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:03.626 [2024-11-19T01:02:52.169Z] =================================================================================================================== 00:27:03.626 [2024-11-19T01:02:52.169Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:03.626 02:02:51 -- common/autotest_common.sh@960 -- # wait 3556175 00:27:03.626 02:02:52 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:03.626 02:02:52 -- host/digest.sh@77 -- # local rw bs qd 00:27:03.626 02:02:52 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:03.626 02:02:52 -- host/digest.sh@80 -- # rw=randwrite 00:27:03.626 02:02:52 -- host/digest.sh@80 -- # bs=131072 00:27:03.626 02:02:52 -- host/digest.sh@80 -- # qd=16 00:27:03.626 02:02:52 -- host/digest.sh@82 -- # bperfpid=3556597 00:27:03.626 02:02:52 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:03.626 02:02:52 -- host/digest.sh@83 -- # waitforlisten 3556597 /var/tmp/bperf.sock 00:27:03.626 02:02:52 -- common/autotest_common.sh@829 -- # '[' -z 3556597 ']' 00:27:03.626 02:02:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:03.626 02:02:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:03.626 02:02:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:03.626 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:03.626 02:02:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:03.626 02:02:52 -- common/autotest_common.sh@10 -- # set +x 00:27:03.885 [2024-11-19 02:02:52.175548] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:03.885 [2024-11-19 02:02:52.175651] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3556597 ] 00:27:03.885 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:03.885 Zero copy mechanism will not be used. 00:27:03.885 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.885 [2024-11-19 02:02:52.236973] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:03.885 [2024-11-19 02:02:52.351363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.885 02:02:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:03.885 02:02:52 -- common/autotest_common.sh@862 -- # return 0 00:27:03.885 02:02:52 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:03.885 02:02:52 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:03.885 02:02:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:04.450 02:02:52 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:04.450 02:02:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:04.708 nvme0n1 00:27:04.708 02:02:53 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:04.708 02:02:53 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:04.708 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:04.708 Zero copy mechanism will not be used. 00:27:04.708 Running I/O for 2 seconds... 00:27:07.240 00:27:07.240 Latency(us) 00:27:07.240 [2024-11-19T01:02:55.783Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:07.240 [2024-11-19T01:02:55.783Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:07.240 nvme0n1 : 2.00 6720.42 840.05 0.00 0.00 2373.99 1832.58 8641.04 00:27:07.240 [2024-11-19T01:02:55.783Z] =================================================================================================================== 00:27:07.240 [2024-11-19T01:02:55.783Z] Total : 6720.42 840.05 0.00 0.00 2373.99 1832.58 8641.04 00:27:07.240 0 00:27:07.240 02:02:55 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:07.240 02:02:55 -- host/digest.sh@92 -- # get_accel_stats 00:27:07.240 02:02:55 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:07.240 02:02:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:07.240 02:02:55 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:07.240 | select(.opcode=="crc32c") 00:27:07.240 | "\(.module_name) \(.executed)"' 00:27:07.240 02:02:55 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:07.240 02:02:55 -- host/digest.sh@93 -- # exp_module=software 00:27:07.240 02:02:55 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:07.240 02:02:55 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:07.240 02:02:55 -- host/digest.sh@97 -- # killprocess 3556597 00:27:07.240 02:02:55 -- common/autotest_common.sh@936 -- # '[' -z 3556597 ']' 00:27:07.240 02:02:55 -- common/autotest_common.sh@940 -- # kill -0 3556597 00:27:07.240 02:02:55 -- common/autotest_common.sh@941 -- # uname 00:27:07.240 02:02:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:07.240 02:02:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3556597 00:27:07.240 02:02:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:07.240 02:02:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:07.240 02:02:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3556597' 00:27:07.240 killing process with pid 3556597 00:27:07.240 02:02:55 -- common/autotest_common.sh@955 -- # kill 3556597 00:27:07.240 Received shutdown signal, test time was about 2.000000 seconds 00:27:07.240 00:27:07.240 Latency(us) 00:27:07.240 [2024-11-19T01:02:55.783Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:07.240 [2024-11-19T01:02:55.783Z] =================================================================================================================== 00:27:07.240 [2024-11-19T01:02:55.783Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:07.240 02:02:55 -- common/autotest_common.sh@960 -- # wait 3556597 00:27:07.240 02:02:55 -- host/digest.sh@126 -- # killprocess 3555193 00:27:07.240 02:02:55 -- common/autotest_common.sh@936 -- # '[' -z 3555193 ']' 00:27:07.240 02:02:55 -- common/autotest_common.sh@940 -- # kill -0 3555193 00:27:07.240 02:02:55 -- common/autotest_common.sh@941 -- # uname 00:27:07.240 02:02:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:07.240 02:02:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3555193 00:27:07.499 02:02:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:07.499 02:02:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:07.499 02:02:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3555193' 00:27:07.499 killing process with pid 3555193 00:27:07.499 02:02:55 -- common/autotest_common.sh@955 -- # kill 3555193 00:27:07.499 02:02:55 -- common/autotest_common.sh@960 -- # wait 3555193 00:27:07.757 00:27:07.757 real 0m15.208s 00:27:07.757 user 0m30.042s 00:27:07.757 sys 0m4.356s 00:27:07.757 02:02:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:07.757 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:07.757 ************************************ 00:27:07.757 END TEST nvmf_digest_clean 00:27:07.757 ************************************ 00:27:07.757 02:02:56 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:07.757 02:02:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:07.757 02:02:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:07.757 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:07.757 ************************************ 00:27:07.757 START TEST nvmf_digest_error 00:27:07.757 ************************************ 00:27:07.757 02:02:56 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:07.757 02:02:56 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:07.757 02:02:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:07.757 02:02:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:07.757 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:07.757 02:02:56 -- nvmf/common.sh@469 -- # nvmfpid=3557163 00:27:07.757 02:02:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:07.757 02:02:56 -- nvmf/common.sh@470 -- # waitforlisten 3557163 00:27:07.757 02:02:56 -- common/autotest_common.sh@829 -- # '[' -z 3557163 ']' 00:27:07.757 02:02:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:07.757 02:02:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:07.757 02:02:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:07.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:07.757 02:02:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:07.757 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:07.757 [2024-11-19 02:02:56.161833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:07.757 [2024-11-19 02:02:56.161929] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:07.757 EAL: No free 2048 kB hugepages reported on node 1 00:27:07.757 [2024-11-19 02:02:56.229844] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:08.015 [2024-11-19 02:02:56.343724] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:08.015 [2024-11-19 02:02:56.343884] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:08.015 [2024-11-19 02:02:56.343903] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:08.015 [2024-11-19 02:02:56.343926] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:08.015 [2024-11-19 02:02:56.343968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:08.016 02:02:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:08.016 02:02:56 -- common/autotest_common.sh@862 -- # return 0 00:27:08.016 02:02:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:08.016 02:02:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:08.016 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:08.016 02:02:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:08.016 02:02:56 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:08.016 02:02:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:08.016 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:08.016 [2024-11-19 02:02:56.400523] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:08.016 02:02:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:08.016 02:02:56 -- host/digest.sh@104 -- # common_target_config 00:27:08.016 02:02:56 -- host/digest.sh@43 -- # rpc_cmd 00:27:08.016 02:02:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:08.016 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:08.016 null0 00:27:08.016 [2024-11-19 02:02:56.523198] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:08.016 [2024-11-19 02:02:56.547444] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:08.016 02:02:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:08.016 02:02:56 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:08.016 02:02:56 -- host/digest.sh@54 -- # local rw bs qd 00:27:08.016 02:02:56 -- host/digest.sh@56 -- # rw=randread 00:27:08.016 02:02:56 -- host/digest.sh@56 -- # bs=4096 00:27:08.016 02:02:56 -- host/digest.sh@56 -- # qd=128 00:27:08.016 02:02:56 -- host/digest.sh@58 -- # bperfpid=3557187 00:27:08.016 02:02:56 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:08.016 02:02:56 -- host/digest.sh@60 -- # waitforlisten 3557187 /var/tmp/bperf.sock 00:27:08.016 02:02:56 -- common/autotest_common.sh@829 -- # '[' -z 3557187 ']' 00:27:08.016 02:02:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:08.016 02:02:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:08.016 02:02:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:08.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:08.016 02:02:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:08.016 02:02:56 -- common/autotest_common.sh@10 -- # set +x 00:27:08.274 [2024-11-19 02:02:56.590171] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:08.274 [2024-11-19 02:02:56.590242] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3557187 ] 00:27:08.274 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.274 [2024-11-19 02:02:56.648833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:08.274 [2024-11-19 02:02:56.755452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:09.261 02:02:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:09.261 02:02:57 -- common/autotest_common.sh@862 -- # return 0 00:27:09.261 02:02:57 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:09.261 02:02:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:09.261 02:02:57 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:09.261 02:02:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.261 02:02:57 -- common/autotest_common.sh@10 -- # set +x 00:27:09.518 02:02:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.519 02:02:57 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:09.519 02:02:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:09.777 nvme0n1 00:27:09.777 02:02:58 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:09.777 02:02:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:09.777 02:02:58 -- common/autotest_common.sh@10 -- # set +x 00:27:09.777 02:02:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:09.777 02:02:58 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:09.777 02:02:58 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:09.777 Running I/O for 2 seconds... 00:27:10.036 [2024-11-19 02:02:58.338645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.338709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:20366 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.338729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.355805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.355838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:21854 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.355857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.374203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.374239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22347 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.374259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.391404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.391440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:21005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.391460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.404206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.404242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:12226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.404262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.422613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.422657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.422692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.441027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.441064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:1651 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.441098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.459479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.459515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6055 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.459535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.470926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.470974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:13451 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.470994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.488633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.488691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:8677 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.488709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.505415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.505451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:11729 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.505471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.517587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.517623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:18268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.517652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.535450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.535480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:12952 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.535510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.551866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.551899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.551916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.036 [2024-11-19 02:02:58.568148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.036 [2024-11-19 02:02:58.568192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5294 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.036 [2024-11-19 02:02:58.568208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.585996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.586028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.586068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.597106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.597135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:6987 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.597167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.612895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.612941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:702 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.612958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.630368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.630398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:16898 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.630431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.647535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.647565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9180 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.647597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.662149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.662180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.662214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.673500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.673529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.673560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.690157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.690186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17011 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.690217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.707086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.707116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:4861 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.707147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.723862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.723901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:23948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.723938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.740715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.740746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:12933 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.740779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.758155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.758184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19034 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.758216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.774204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.774234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:7400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.774266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.788414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.788444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:8008 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.788460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.800580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.800609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:20067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.800647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.817842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.817874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:958 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.817906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.296 [2024-11-19 02:02:58.834784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.296 [2024-11-19 02:02:58.834816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.296 [2024-11-19 02:02:58.834849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.850955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.851008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.851086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.862456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.862485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:17109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.862516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.878350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.878380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:17493 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.878412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.895268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.895312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:15070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.895329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.910550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.910581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:8858 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.910613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.922497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.922527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:13316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.922560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.939602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.939653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:18313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.939671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.955446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.955478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.955511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.967259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.967288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:4733 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.967320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:58.984014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:58.984046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:12363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:58.984085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:59.000986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:59.001016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:59.001047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:59.018244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:59.018275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23832 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:59.018306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:59.028674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:59.028704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23010 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:59.028737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:59.044349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:59.044379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9783 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:59.044410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:59.060958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:59.060990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:16337 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:59.061006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:59.077148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:59.077178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:24013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:59.077209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.555 [2024-11-19 02:02:59.094132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.555 [2024-11-19 02:02:59.094162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:13223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.555 [2024-11-19 02:02:59.094192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.111487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.111520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:2691 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.111552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.127158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.127224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:14885 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.127247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.138592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.138621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.138659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.154912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.154958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:16732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.154974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.171326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.171356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:1562 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.171388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.187884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.187914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:14739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.187932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.204050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.204080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.204111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.220645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.220690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:8513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.220707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.237155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.237219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:18456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.237324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.252437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.252467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:2034 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.252500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.814 [2024-11-19 02:02:59.264238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.814 [2024-11-19 02:02:59.264287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:19146 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.814 [2024-11-19 02:02:59.264304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.815 [2024-11-19 02:02:59.280701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.815 [2024-11-19 02:02:59.280732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:2116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.815 [2024-11-19 02:02:59.280764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.815 [2024-11-19 02:02:59.297629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.815 [2024-11-19 02:02:59.297672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21449 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.815 [2024-11-19 02:02:59.297706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.815 [2024-11-19 02:02:59.313993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.815 [2024-11-19 02:02:59.314023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.815 [2024-11-19 02:02:59.314054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.815 [2024-11-19 02:02:59.329095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.815 [2024-11-19 02:02:59.329127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.815 [2024-11-19 02:02:59.329145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.815 [2024-11-19 02:02:59.340422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.815 [2024-11-19 02:02:59.340450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24582 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.815 [2024-11-19 02:02:59.340481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.815 [2024-11-19 02:02:59.357810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:10.815 [2024-11-19 02:02:59.357841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:18087 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.815 [2024-11-19 02:02:59.357874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.072 [2024-11-19 02:02:59.373091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.072 [2024-11-19 02:02:59.373121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:25426 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.072 [2024-11-19 02:02:59.373151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.072 [2024-11-19 02:02:59.389572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.072 [2024-11-19 02:02:59.389602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:4090 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.072 [2024-11-19 02:02:59.389651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.072 [2024-11-19 02:02:59.406003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.072 [2024-11-19 02:02:59.406032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5334 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.072 [2024-11-19 02:02:59.406064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.072 [2024-11-19 02:02:59.422522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.072 [2024-11-19 02:02:59.422552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10847 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.072 [2024-11-19 02:02:59.422584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.072 [2024-11-19 02:02:59.439552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.072 [2024-11-19 02:02:59.439581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:16499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.072 [2024-11-19 02:02:59.439614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.072 [2024-11-19 02:02:59.456020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.072 [2024-11-19 02:02:59.456049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22274 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.072 [2024-11-19 02:02:59.456081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.072 [2024-11-19 02:02:59.466743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.072 [2024-11-19 02:02:59.466774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:22452 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.072 [2024-11-19 02:02:59.466791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.482416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.482445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:3789 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.482477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.500876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.500908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.500925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.519306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.519342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:2271 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.519361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.536184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.536227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:15439 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.536247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.555312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.555348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23546 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.555367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.572931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.572974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:13960 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.572990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.590685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.590731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:25332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.590747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.073 [2024-11-19 02:02:59.602453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.073 [2024-11-19 02:02:59.602488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:13062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.073 [2024-11-19 02:02:59.602509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.620331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.620367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:7203 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.620386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.637561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.637598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:1980 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.637618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.655910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.655940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3028 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.655971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.674078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.674200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22250 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.674231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.690807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.690838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:19892 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.690871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.703004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.703040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:3079 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.703059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.720744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.720778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:3396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.720809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.738619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.738663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:13241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.738707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.756953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.757001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:2375 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.757021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.774772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.774801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:7870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.774833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.792890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.792919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10806 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.792951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.809275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.809338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:2018 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.809361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.821526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.821568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:17321 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.821588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.839536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.839572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:2282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.839591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.857545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.857582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:7374 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.331 [2024-11-19 02:02:59.857603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.331 [2024-11-19 02:02:59.875467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.331 [2024-11-19 02:02:59.875508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:14982 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.332 [2024-11-19 02:02:59.875529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.590 [2024-11-19 02:02:59.893286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.590 [2024-11-19 02:02:59.893323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:982 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.590 [2024-11-19 02:02:59.893343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.590 [2024-11-19 02:02:59.911403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.590 [2024-11-19 02:02:59.911439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:12099 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.590 [2024-11-19 02:02:59.911458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:02:59.929772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:02:59.929801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:12385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:02:59.929832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:02:59.942545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:02:59.942579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:23925 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:02:59.942599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:02:59.958178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:02:59.958213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:3319 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:02:59.958233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:02:59.975464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:02:59.975500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:02:59.975520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:02:59.993022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:02:59.993058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:7024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:02:59.993077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:03:00.012027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:03:00.012095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:10029 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:03:00.012117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:03:00.030922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:03:00.030993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:16489 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:03:00.031027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:03:00.048733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:03:00.048792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:10695 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:03:00.048812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:03:00.066873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:03:00.066905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:13744 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:03:00.066938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:03:00.085022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:03:00.085059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:8414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:03:00.085078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:03:00.103204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:03:00.103241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:13239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:03:00.103261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.591 [2024-11-19 02:03:00.122364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.591 [2024-11-19 02:03:00.122395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.591 [2024-11-19 02:03:00.122435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.140624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.140687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:12804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.140707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.157698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.157732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.157750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.170335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.170372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18078 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.170391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.188792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.188824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:4550 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.188856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.206323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.206360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:19584 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.206380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.224325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.224361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:10842 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.224381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.242445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.242482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:5385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.242502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.260430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.260467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5325 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.260487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.278482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.278528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:5223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.278548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.294725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.294756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17395 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.294789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.306877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.306906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6417 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.306937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 [2024-11-19 02:03:00.324355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xd29bb0) 00:27:11.850 [2024-11-19 02:03:00.324390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:16829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.850 [2024-11-19 02:03:00.324410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.850 00:27:11.850 Latency(us) 00:27:11.850 [2024-11-19T01:03:00.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:11.850 [2024-11-19T01:03:00.393Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:11.850 nvme0n1 : 2.01 15647.25 61.12 0.00 0.00 8172.08 3665.16 26602.76 00:27:11.850 [2024-11-19T01:03:00.394Z] =================================================================================================================== 00:27:11.851 [2024-11-19T01:03:00.394Z] Total : 15647.25 61.12 0.00 0.00 8172.08 3665.16 26602.76 00:27:11.851 0 00:27:11.851 02:03:00 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:11.851 02:03:00 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:11.851 02:03:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:11.851 02:03:00 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:11.851 | .driver_specific 00:27:11.851 | .nvme_error 00:27:11.851 | .status_code 00:27:11.851 | .command_transient_transport_error' 00:27:12.109 02:03:00 -- host/digest.sh@71 -- # (( 123 > 0 )) 00:27:12.109 02:03:00 -- host/digest.sh@73 -- # killprocess 3557187 00:27:12.109 02:03:00 -- common/autotest_common.sh@936 -- # '[' -z 3557187 ']' 00:27:12.109 02:03:00 -- common/autotest_common.sh@940 -- # kill -0 3557187 00:27:12.109 02:03:00 -- common/autotest_common.sh@941 -- # uname 00:27:12.109 02:03:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:12.109 02:03:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3557187 00:27:12.109 02:03:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:12.109 02:03:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:12.109 02:03:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3557187' 00:27:12.109 killing process with pid 3557187 00:27:12.109 02:03:00 -- common/autotest_common.sh@955 -- # kill 3557187 00:27:12.109 Received shutdown signal, test time was about 2.000000 seconds 00:27:12.109 00:27:12.109 Latency(us) 00:27:12.109 [2024-11-19T01:03:00.652Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:12.109 [2024-11-19T01:03:00.652Z] =================================================================================================================== 00:27:12.109 [2024-11-19T01:03:00.652Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:12.109 02:03:00 -- common/autotest_common.sh@960 -- # wait 3557187 00:27:12.368 02:03:00 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:12.368 02:03:00 -- host/digest.sh@54 -- # local rw bs qd 00:27:12.368 02:03:00 -- host/digest.sh@56 -- # rw=randread 00:27:12.368 02:03:00 -- host/digest.sh@56 -- # bs=131072 00:27:12.368 02:03:00 -- host/digest.sh@56 -- # qd=16 00:27:12.368 02:03:00 -- host/digest.sh@58 -- # bperfpid=3557812 00:27:12.368 02:03:00 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:12.368 02:03:00 -- host/digest.sh@60 -- # waitforlisten 3557812 /var/tmp/bperf.sock 00:27:12.368 02:03:00 -- common/autotest_common.sh@829 -- # '[' -z 3557812 ']' 00:27:12.368 02:03:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:12.368 02:03:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:12.368 02:03:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:12.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:12.368 02:03:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:12.368 02:03:00 -- common/autotest_common.sh@10 -- # set +x 00:27:12.626 [2024-11-19 02:03:00.940345] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:12.626 [2024-11-19 02:03:00.940422] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3557812 ] 00:27:12.626 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:12.626 Zero copy mechanism will not be used. 00:27:12.626 EAL: No free 2048 kB hugepages reported on node 1 00:27:12.626 [2024-11-19 02:03:00.999301] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:12.626 [2024-11-19 02:03:01.112665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:13.560 02:03:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:13.560 02:03:01 -- common/autotest_common.sh@862 -- # return 0 00:27:13.560 02:03:01 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:13.560 02:03:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:13.818 02:03:02 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:13.818 02:03:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:13.818 02:03:02 -- common/autotest_common.sh@10 -- # set +x 00:27:13.818 02:03:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:13.818 02:03:02 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:13.818 02:03:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:14.076 nvme0n1 00:27:14.076 02:03:02 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:14.076 02:03:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:14.076 02:03:02 -- common/autotest_common.sh@10 -- # set +x 00:27:14.076 02:03:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:14.076 02:03:02 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:14.076 02:03:02 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:14.335 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:14.335 Zero copy mechanism will not be used. 00:27:14.335 Running I/O for 2 seconds... 00:27:14.335 [2024-11-19 02:03:02.685802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.685853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.685874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.691348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.691380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.691413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.696933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.696970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.696989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.702117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.702150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.702167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.707507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.707540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.707558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.713865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.713913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.713930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.720797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.720826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.720856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.729000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.729047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.729063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.736622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.736663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.736681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.743612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.743666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.743705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.750690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.750720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.750738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.757978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.758023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.758039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.765202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.765234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.765251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.772550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.772595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.772612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.778656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.778696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.778713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.783122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.783153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.783170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.787760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.787790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.787807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.793159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.793190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.793207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.798422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.798452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.798484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.803160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.803205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.803223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.808067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.808096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.808113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.813755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.813799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.813816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.818602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.818653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.818686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.823414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.823444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.823474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.828111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.828140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.828156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.833050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.833079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.336 [2024-11-19 02:03:02.833112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.336 [2024-11-19 02:03:02.837953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.336 [2024-11-19 02:03:02.837998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.838019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.842804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.842833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.842850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.847776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.847819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.847834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.852799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.852842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.852858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.857492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.857520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.857536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.862269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.862313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.862329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.867078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.867108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.867125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.871772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.871801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.871818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.876148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.876177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.876193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.337 [2024-11-19 02:03:02.880741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.337 [2024-11-19 02:03:02.880778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.337 [2024-11-19 02:03:02.880796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.885753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.885786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.885804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.890490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.890526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.890544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.894976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.895007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.895023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.899722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.899753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.899769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.904043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.904073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.904089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.908422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.908451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.908467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.913231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.913259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.913276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.917963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.917996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.918014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.922814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.922844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.922860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.927429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.927460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.927477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.932129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.932159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.932175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.936997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.937026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.937042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.941894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.941923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.941940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.946808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.946837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.946853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.951551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.951580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.951597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.957285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.957315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.957331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.962081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.962110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.962132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.966799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.966828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.966844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.972092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.972122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.972138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.977007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.977052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.977069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.597 [2024-11-19 02:03:02.982064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.597 [2024-11-19 02:03:02.982094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.597 [2024-11-19 02:03:02.982111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:02.986064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:02.986096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:02.986113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:02.990108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:02.990138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:02.990155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:02.994775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:02.994806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:02.994823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:02.999695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:02.999726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:02.999743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.005445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.005496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.005514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.011971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.012003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.012020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.019130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.019160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.019177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.025051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.025082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.025099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.031226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.031257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.031274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.035824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.035854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.035870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.040515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.040543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.040560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.045191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.045221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.045238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.052203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.052234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.052251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.059126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.059156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.059173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.064726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.064756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.064773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.069348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.069378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.069394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.072608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.072644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.072662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.079101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.079134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.079153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.083264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.083296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.083314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.088073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.088106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.088125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.093585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.093630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.093656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.099126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.099159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.099183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.103934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.103967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.103985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.109197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.109232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.109251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.114652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.114702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.114721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.120325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.120359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.120377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.598 [2024-11-19 02:03:03.125597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.598 [2024-11-19 02:03:03.125647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.598 [2024-11-19 02:03:03.125668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.599 [2024-11-19 02:03:03.130901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.599 [2024-11-19 02:03:03.130938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.599 [2024-11-19 02:03:03.130955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.599 [2024-11-19 02:03:03.135119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.599 [2024-11-19 02:03:03.135153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.599 [2024-11-19 02:03:03.135172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.599 [2024-11-19 02:03:03.140128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.599 [2024-11-19 02:03:03.140165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.599 [2024-11-19 02:03:03.140185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.858 [2024-11-19 02:03:03.144924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.858 [2024-11-19 02:03:03.144960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.858 [2024-11-19 02:03:03.144980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.858 [2024-11-19 02:03:03.149629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.858 [2024-11-19 02:03:03.149672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.858 [2024-11-19 02:03:03.149691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.858 [2024-11-19 02:03:03.154456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.858 [2024-11-19 02:03:03.154490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.858 [2024-11-19 02:03:03.154508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.858 [2024-11-19 02:03:03.159217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.858 [2024-11-19 02:03:03.159250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.858 [2024-11-19 02:03:03.159268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.858 [2024-11-19 02:03:03.164141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.858 [2024-11-19 02:03:03.164180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.858 [2024-11-19 02:03:03.164197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.858 [2024-11-19 02:03:03.168855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.858 [2024-11-19 02:03:03.168888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.858 [2024-11-19 02:03:03.168906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.858 [2024-11-19 02:03:03.173713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.858 [2024-11-19 02:03:03.173742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.858 [2024-11-19 02:03:03.173774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.178400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.178434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.178452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.183836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.183881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.183903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.189002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.189033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.189050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.193824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.193856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.193873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.199041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.199071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.199089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.204194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.204224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.204241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.209118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.209149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.209167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.213321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.213351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.213368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.217732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.217777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.217794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.222925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.222958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.222977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.228112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.228152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.228171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.233405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.233451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.233468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.238877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.238908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.238940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.244095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.244125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.244159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.250185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.250220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.250240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.255863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.255894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.255910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.261525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.261569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.261590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.267038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.267068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.267085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.272444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.272474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.272491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.277900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.277936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.277953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.283340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.283374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.283393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.288713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.288743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.288760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.294058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.294093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.294111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.299079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.299113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.299131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.304302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.304337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.304356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.309677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.309707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.309724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.859 [2024-11-19 02:03:03.314577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.859 [2024-11-19 02:03:03.314622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.859 [2024-11-19 02:03:03.314660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.320127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.320173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.320202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.325311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.325343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.325359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.330260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.330289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.330320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.335148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.335192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.335208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.340160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.340194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.340212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.344932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.344958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.344973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.349911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.349940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.349956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.354341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.354369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.354400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.359221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.359250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.359267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.364124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.364170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.364189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.368322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.368355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.368372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.373173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.373206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.373224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.377807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.377836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.377852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.382481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.382513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.382530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.387596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.387627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.387653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.393313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.393342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.393359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.398866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.398898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.398915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.860 [2024-11-19 02:03:03.403360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:14.860 [2024-11-19 02:03:03.403399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.860 [2024-11-19 02:03:03.403420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.407224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.407255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.407272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.410937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.410968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.410986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.414271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.414301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.414318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.417755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.417784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.417800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.421001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.421031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.421047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.424609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.424646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.424664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.428177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.428205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.428222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.431683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.431711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.431727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.436751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.436780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.436801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.441852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.441881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.441897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.447042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.447086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.447102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.452880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.452910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.452927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.457739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.120 [2024-11-19 02:03:03.457770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.120 [2024-11-19 02:03:03.457787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.120 [2024-11-19 02:03:03.462372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.462403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.462420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.466967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.466998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.467015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.471598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.471628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.471655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.476540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.476574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.476594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.481763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.481799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.481816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.485663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.485693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.485710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.489369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.489400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.489416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.493032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.493062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.493078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.497013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.497043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.497059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.500604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.500647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.500668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.504269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.504299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.504316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.507847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.507876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.507893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.511251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.511281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.511298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.514780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.514810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.514827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.518628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.518667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.518684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.522514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.522545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.522563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.526691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.526722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.526740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.531155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.531187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.531204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.537014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.537046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.537078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.542718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.542749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.542766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.548113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.548145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.548163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.553823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.553860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.553878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.557807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.557839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.557856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.562543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.562579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.562598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.567848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.567877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.567908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.573290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.573335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.573351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.121 [2024-11-19 02:03:03.578576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.121 [2024-11-19 02:03:03.578611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.121 [2024-11-19 02:03:03.578630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.583845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.583877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.583894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.589200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.589235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.589254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.594712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.594744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.594761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.599373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.599404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.599421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.603762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.603793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.603811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.607411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.607442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.607458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.611054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.611098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.611113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.615764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.615807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.615823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.620658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.620703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.620719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.625374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.625403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.625420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.630143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.630172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.630188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.634907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.634953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.634978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.639202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.639235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.639253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.644108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.644152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.644168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.648936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.648963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.648994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.653292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.653321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.653338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.658145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.658180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.658197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.122 [2024-11-19 02:03:03.663129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.122 [2024-11-19 02:03:03.663178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.122 [2024-11-19 02:03:03.663204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.668352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.668400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.668417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.673940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.673975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.673992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.677911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.677947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.677965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.681602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.681632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.681658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.685415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.685444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.685483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.690318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.690348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.690364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.695359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.695393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.695412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.700066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.700097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.700119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.703976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.704006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.704022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.707937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.707966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.707982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.712283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.712313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.712335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.716393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.716423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.716439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.720896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.720925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.720941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.725318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.725347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.725364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.730827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.730857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.730874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.737264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.737295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.737312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.744722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.744753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.744770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.750571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.750601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.750617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.756360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.756391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.756408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.762188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.762219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.762257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.767136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.767167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.767184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.771983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.772012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.772028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.776569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.776598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.382 [2024-11-19 02:03:03.776614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.382 [2024-11-19 02:03:03.781168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.382 [2024-11-19 02:03:03.781197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.781213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.785787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.785816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.785833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.790372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.790402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.790418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.795086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.795114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.795130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.800087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.800116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.800133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.806396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.806447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.806464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.813808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.813838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.813855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.819385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.819415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.819432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.825017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.825048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.825065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.829743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.829771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.829787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.834855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.834885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.834901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.840257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.840288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.840306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.844954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.844999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.845015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.848543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.848572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.848594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.851950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.851979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.851995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.855492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.855521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.855537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.859175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.859204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.859220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.862925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.862953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.862969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.866578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.866606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.866622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.870145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.870174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.870190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.873741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.873769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.873785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.877472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.877500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.877516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.881368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.881403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.881420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.885003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.885031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.885048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.888805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.888834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.888850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.892475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.892504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.892521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.896261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.383 [2024-11-19 02:03:03.896290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.383 [2024-11-19 02:03:03.896307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.383 [2024-11-19 02:03:03.900100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.384 [2024-11-19 02:03:03.900128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.384 [2024-11-19 02:03:03.900144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.384 [2024-11-19 02:03:03.904793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.384 [2024-11-19 02:03:03.904823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.384 [2024-11-19 02:03:03.904840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.384 [2024-11-19 02:03:03.910173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.384 [2024-11-19 02:03:03.910205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.384 [2024-11-19 02:03:03.910222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.384 [2024-11-19 02:03:03.915145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.384 [2024-11-19 02:03:03.915176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.384 [2024-11-19 02:03:03.915193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.384 [2024-11-19 02:03:03.919853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.384 [2024-11-19 02:03:03.919883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.384 [2024-11-19 02:03:03.919899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.384 [2024-11-19 02:03:03.924797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.384 [2024-11-19 02:03:03.924835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.384 [2024-11-19 02:03:03.924862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.929716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.929747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.929765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.934564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.934595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.934613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.938670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.938702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.938719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.943449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.943478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.943494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.948279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.948309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.948326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.953221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.953251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.953269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.958165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.958195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.958219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.963926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.963962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.963979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.970090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.970122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.643 [2024-11-19 02:03:03.970139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.643 [2024-11-19 02:03:03.976078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.643 [2024-11-19 02:03:03.976109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:03.976126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:03.981103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:03.981133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:03.981150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:03.986427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:03.986457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:03.986474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:03.992219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:03.992250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:03.992267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:03.998207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:03.998237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:03.998255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.004090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.004121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.004138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.010646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.010682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.010699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.017365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.017397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.017414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.023670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.023701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.023717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.028901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.028932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.028948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.034248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.034280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.034296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.039370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.039400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.039417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.044804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.044835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.044851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.050476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.050507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.050524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.056377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.056409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.056425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.061231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.061262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.061279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.064497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.064528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.064545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.070185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.070214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.070247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.074817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.074847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.074863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.079692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.079735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.079751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.085586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.085631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.085657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.089711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.089741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.089757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.093655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.093684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.093700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.097620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.097656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.097679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.101335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.101364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.101380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.105263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.105293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.105310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.109339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.109368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.644 [2024-11-19 02:03:04.109386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.644 [2024-11-19 02:03:04.113013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.644 [2024-11-19 02:03:04.113042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.113058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.116840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.116870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.116886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.120757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.120787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.120804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.124195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.124225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.124241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.127602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.127631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.127657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.131526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.131557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.131573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.135267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.135297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.135315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.139617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.139656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.139674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.143948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.143979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.143995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.148387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.148417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.148434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.152736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.152766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.152783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.157040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.157071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.157087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.161244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.161275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.161292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.165694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.165723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.165746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.170424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.170455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.170472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.175662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.175692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.175709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.181071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.181101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.181117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.645 [2024-11-19 02:03:04.186714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.645 [2024-11-19 02:03:04.186747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.645 [2024-11-19 02:03:04.186765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.192106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.192153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.192169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.197443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.197475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.197493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.203103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.203134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.203152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.208367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.208398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.208415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.213566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.213603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.213621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.218914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.218945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.218962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.222436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.222466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.222482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.225714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.225743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.225759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.228845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.228874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.228891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.232778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.232808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.232824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.238085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.238114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.238130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.243753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.243784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.243800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.249916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.249947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.249964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.257203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.257235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.257253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.263226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.263256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.263272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.268203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.268232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.268248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.273065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.273095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.273112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.278004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.278034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.278051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.282990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.905 [2024-11-19 02:03:04.283021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.905 [2024-11-19 02:03:04.283037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.905 [2024-11-19 02:03:04.288126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.288155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.288172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.293132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.293162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.293179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.298952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.298983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.299006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.305633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.305673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.305690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.313323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.313354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.313371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.318847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.318878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.318895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.322764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.322794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.322811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.328681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.328712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.328729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.333004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.333034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.333051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.338317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.338348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.338364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.344156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.344187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.344205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.348681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.348717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.348735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.353012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.353041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.353058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.356766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.356796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.356813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.360686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.360715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.360731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.364441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.364470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.364486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.368106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.368134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.368150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.372063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.372092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.372123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.377666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.377713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.377730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.381762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.381791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.381807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.386307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.386339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.386357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.391040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.391071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.391089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.395387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.395419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.395437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.399763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.399792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.399807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.404572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.404603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.404621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.409390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.409418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.409434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.906 [2024-11-19 02:03:04.414119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.906 [2024-11-19 02:03:04.414146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.906 [2024-11-19 02:03:04.414161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.907 [2024-11-19 02:03:04.418789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.907 [2024-11-19 02:03:04.418818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.907 [2024-11-19 02:03:04.418834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.907 [2024-11-19 02:03:04.423587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.907 [2024-11-19 02:03:04.423655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.907 [2024-11-19 02:03:04.423695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.907 [2024-11-19 02:03:04.428282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.907 [2024-11-19 02:03:04.428325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.907 [2024-11-19 02:03:04.428342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.907 [2024-11-19 02:03:04.432902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.907 [2024-11-19 02:03:04.432957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.907 [2024-11-19 02:03:04.432973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.907 [2024-11-19 02:03:04.437567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.907 [2024-11-19 02:03:04.437600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.907 [2024-11-19 02:03:04.437619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.907 [2024-11-19 02:03:04.443260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:15.907 [2024-11-19 02:03:04.443294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.907 [2024-11-19 02:03:04.443312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.166 [2024-11-19 02:03:04.450814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.166 [2024-11-19 02:03:04.450847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.166 [2024-11-19 02:03:04.450865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.166 [2024-11-19 02:03:04.457543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.166 [2024-11-19 02:03:04.457579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.166 [2024-11-19 02:03:04.457599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.166 [2024-11-19 02:03:04.463577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.166 [2024-11-19 02:03:04.463608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.166 [2024-11-19 02:03:04.463626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.166 [2024-11-19 02:03:04.468197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.166 [2024-11-19 02:03:04.468228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.166 [2024-11-19 02:03:04.468245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.166 [2024-11-19 02:03:04.473056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.166 [2024-11-19 02:03:04.473088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.166 [2024-11-19 02:03:04.473105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.166 [2024-11-19 02:03:04.477901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.477945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.477962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.483028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.483063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.483082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.487633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.487670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.487687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.492773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.492803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.492821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.498581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.498611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.498628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.503425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.503454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.503471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.508102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.508131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.508164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.512681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.512711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.512734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.517230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.517274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.517290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.522004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.522033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.522050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.526760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.526789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.526805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.531443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.531486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.531502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.536233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.536262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.536294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.540849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.540878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.540895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.545215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.545261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.545279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.549849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.549878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.549894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.555094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.555132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.555149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.560695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.560724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.560757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.565248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.565276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.565309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.569970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.569999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.570016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.574857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.574886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.574902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.579374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.579427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.579443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.585038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.585066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.585095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.589806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.589835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.589851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.593930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.593959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.593975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.597872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.597900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.597916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.167 [2024-11-19 02:03:04.602335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.167 [2024-11-19 02:03:04.602367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.167 [2024-11-19 02:03:04.602385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.607026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.607072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.607091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.611664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.611707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.611723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.616369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.616398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.616414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.621384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.621412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.621444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.626384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.626417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.626436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.631265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.631294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.631310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.636278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.636308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.636330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.641246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.641276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.641293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.646992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.647022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.647054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.652305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.652334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.652366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.658974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.659012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.659029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.664807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.664839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.664856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.671390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.671424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.671441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.168 [2024-11-19 02:03:04.678418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a74bb0) 00:27:16.168 [2024-11-19 02:03:04.678449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.168 [2024-11-19 02:03:04.678466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.168 00:27:16.168 Latency(us) 00:27:16.168 [2024-11-19T01:03:04.711Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:16.168 [2024-11-19T01:03:04.711Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:16.168 nvme0n1 : 2.00 6274.06 784.26 0.00 0.00 2545.86 767.62 11602.30 00:27:16.168 [2024-11-19T01:03:04.711Z] =================================================================================================================== 00:27:16.168 [2024-11-19T01:03:04.711Z] Total : 6274.06 784.26 0.00 0.00 2545.86 767.62 11602.30 00:27:16.168 0 00:27:16.168 02:03:04 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:16.168 02:03:04 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:16.168 02:03:04 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:16.168 | .driver_specific 00:27:16.168 | .nvme_error 00:27:16.168 | .status_code 00:27:16.168 | .command_transient_transport_error' 00:27:16.168 02:03:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:16.426 02:03:04 -- host/digest.sh@71 -- # (( 405 > 0 )) 00:27:16.426 02:03:04 -- host/digest.sh@73 -- # killprocess 3557812 00:27:16.426 02:03:04 -- common/autotest_common.sh@936 -- # '[' -z 3557812 ']' 00:27:16.426 02:03:04 -- common/autotest_common.sh@940 -- # kill -0 3557812 00:27:16.426 02:03:04 -- common/autotest_common.sh@941 -- # uname 00:27:16.426 02:03:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:16.426 02:03:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3557812 00:27:16.684 02:03:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:16.684 02:03:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:16.684 02:03:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3557812' 00:27:16.684 killing process with pid 3557812 00:27:16.684 02:03:04 -- common/autotest_common.sh@955 -- # kill 3557812 00:27:16.684 Received shutdown signal, test time was about 2.000000 seconds 00:27:16.684 00:27:16.684 Latency(us) 00:27:16.684 [2024-11-19T01:03:05.227Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:16.684 [2024-11-19T01:03:05.227Z] =================================================================================================================== 00:27:16.684 [2024-11-19T01:03:05.227Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:16.684 02:03:04 -- common/autotest_common.sh@960 -- # wait 3557812 00:27:16.942 02:03:05 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:16.942 02:03:05 -- host/digest.sh@54 -- # local rw bs qd 00:27:16.942 02:03:05 -- host/digest.sh@56 -- # rw=randwrite 00:27:16.942 02:03:05 -- host/digest.sh@56 -- # bs=4096 00:27:16.942 02:03:05 -- host/digest.sh@56 -- # qd=128 00:27:16.942 02:03:05 -- host/digest.sh@58 -- # bperfpid=3558409 00:27:16.942 02:03:05 -- host/digest.sh@60 -- # waitforlisten 3558409 /var/tmp/bperf.sock 00:27:16.942 02:03:05 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:16.942 02:03:05 -- common/autotest_common.sh@829 -- # '[' -z 3558409 ']' 00:27:16.942 02:03:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:16.942 02:03:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:16.942 02:03:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:16.942 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:16.942 02:03:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:16.942 02:03:05 -- common/autotest_common.sh@10 -- # set +x 00:27:16.942 [2024-11-19 02:03:05.298844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:16.942 [2024-11-19 02:03:05.298923] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3558409 ] 00:27:16.942 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.942 [2024-11-19 02:03:05.360808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:16.942 [2024-11-19 02:03:05.472390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:17.877 02:03:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:17.877 02:03:06 -- common/autotest_common.sh@862 -- # return 0 00:27:17.877 02:03:06 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:17.877 02:03:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:18.135 02:03:06 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:18.135 02:03:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:18.135 02:03:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.135 02:03:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:18.135 02:03:06 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:18.135 02:03:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:18.701 nvme0n1 00:27:18.701 02:03:06 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:18.701 02:03:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:18.701 02:03:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.701 02:03:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:18.701 02:03:06 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:18.701 02:03:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:18.701 Running I/O for 2 seconds... 00:27:18.701 [2024-11-19 02:03:07.105463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190f6890 00:27:18.701 [2024-11-19 02:03:07.105977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:18484 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.701 [2024-11-19 02:03:07.106032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:27:18.701 [2024-11-19 02:03:07.118435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e95a0 00:27:18.701 [2024-11-19 02:03:07.119678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:1197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.701 [2024-11-19 02:03:07.119729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:18.701 [2024-11-19 02:03:07.130936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e1f80 00:27:18.701 [2024-11-19 02:03:07.132314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:11736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.701 [2024-11-19 02:03:07.132348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:18.701 [2024-11-19 02:03:07.143168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190f31b8 00:27:18.701 [2024-11-19 02:03:07.143555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:12108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.701 [2024-11-19 02:03:07.143589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:18.701 [2024-11-19 02:03:07.155476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e49b0 00:27:18.701 [2024-11-19 02:03:07.157117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:9258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.701 [2024-11-19 02:03:07.157160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:18.702 [2024-11-19 02:03:07.168015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb328 00:27:18.702 [2024-11-19 02:03:07.169181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:6052 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.702 [2024-11-19 02:03:07.169216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:18.702 [2024-11-19 02:03:07.181258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e12d8 00:27:18.702 [2024-11-19 02:03:07.181733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:22177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.702 [2024-11-19 02:03:07.181762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:18.702 [2024-11-19 02:03:07.193699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e3060 00:27:18.702 [2024-11-19 02:03:07.194337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:2651 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.702 [2024-11-19 02:03:07.194371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:18.702 [2024-11-19 02:03:07.206213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190ebfd0 00:27:18.702 [2024-11-19 02:03:07.206850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8925 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.702 [2024-11-19 02:03:07.206896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:18.702 [2024-11-19 02:03:07.218453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e49b0 00:27:18.702 [2024-11-19 02:03:07.219104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17207 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.702 [2024-11-19 02:03:07.219139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:18.702 [2024-11-19 02:03:07.230942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190f3a28 00:27:18.702 [2024-11-19 02:03:07.232440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:4180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.702 [2024-11-19 02:03:07.232475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:18.702 [2024-11-19 02:03:07.243862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e0ea0 00:27:18.702 [2024-11-19 02:03:07.244740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:5706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.702 [2024-11-19 02:03:07.244771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.256900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e1f80 00:27:18.960 [2024-11-19 02:03:07.258048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:20228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.960 [2024-11-19 02:03:07.258083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.268765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e49b0 00:27:18.960 [2024-11-19 02:03:07.270083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:6183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.960 [2024-11-19 02:03:07.270117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.281003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190ea248 00:27:18.960 [2024-11-19 02:03:07.282361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:21790 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.960 [2024-11-19 02:03:07.282395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.293491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190ecc78 00:27:18.960 [2024-11-19 02:03:07.294858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:9489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.960 [2024-11-19 02:03:07.294903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.305817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eaef0 00:27:18.960 [2024-11-19 02:03:07.307199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:21441 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.960 [2024-11-19 02:03:07.307247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.318017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e6fa8 00:27:18.960 [2024-11-19 02:03:07.319433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:22311 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.960 [2024-11-19 02:03:07.319467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.330436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb328 00:27:18.960 [2024-11-19 02:03:07.330950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:21149 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.960 [2024-11-19 02:03:07.331009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:18.960 [2024-11-19 02:03:07.342883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e6300 00:27:18.960 [2024-11-19 02:03:07.343398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:25497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.343432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.355204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190f1868 00:27:18.961 [2024-11-19 02:03:07.355729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.355760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.367591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190efae0 00:27:18.961 [2024-11-19 02:03:07.368158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:16086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.368202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.379928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190ebfd0 00:27:18.961 [2024-11-19 02:03:07.380578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:6111 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.380612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.392121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.392779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:15292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.392816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.404313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190e95a0 00:27:18.961 [2024-11-19 02:03:07.405014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:13771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.405048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.417634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.418015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:19912 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.418048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.431352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.431645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:11104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.431694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.445128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.445392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25156 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.445437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.458861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.459152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:4497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.459186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.472633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.472927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:21628 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.472972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.486452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.486759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:11533 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.486792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.961 [2024-11-19 02:03:07.500231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:18.961 [2024-11-19 02:03:07.500505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:8426 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.961 [2024-11-19 02:03:07.500541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.514100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.514379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:4839 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.514424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.527848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.528164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:13158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.528197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.541586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.541928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:13382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.541977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.555374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.555653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:20567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.555699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.569113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.569394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:5407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.569427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.582860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.583125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3301 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.583157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.596661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.596961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:7640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.596994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.610395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.610696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:11814 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.610726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.624080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.624356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:19456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.624388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.637819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.638139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:10062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.638172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.651582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.651863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.651893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.665328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.665605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:21215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.220 [2024-11-19 02:03:07.665646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.220 [2024-11-19 02:03:07.679085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.220 [2024-11-19 02:03:07.679353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:25025 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.221 [2024-11-19 02:03:07.679386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.221 [2024-11-19 02:03:07.692803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.221 [2024-11-19 02:03:07.693100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:4830 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.221 [2024-11-19 02:03:07.693134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.221 [2024-11-19 02:03:07.706626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.221 [2024-11-19 02:03:07.706953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:21097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.221 [2024-11-19 02:03:07.706987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.221 [2024-11-19 02:03:07.720393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.221 [2024-11-19 02:03:07.720715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:2045 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.221 [2024-11-19 02:03:07.720746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.221 [2024-11-19 02:03:07.734148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.221 [2024-11-19 02:03:07.734418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:22788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.221 [2024-11-19 02:03:07.734451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.221 [2024-11-19 02:03:07.747928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.221 [2024-11-19 02:03:07.748221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:18379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.221 [2024-11-19 02:03:07.748259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.221 [2024-11-19 02:03:07.761651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.221 [2024-11-19 02:03:07.762004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8244 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.221 [2024-11-19 02:03:07.762039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.479 [2024-11-19 02:03:07.775504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.479 [2024-11-19 02:03:07.775797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:6632 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.479 [2024-11-19 02:03:07.775829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.479 [2024-11-19 02:03:07.789281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.479 [2024-11-19 02:03:07.789520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:14049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.479 [2024-11-19 02:03:07.789553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.479 [2024-11-19 02:03:07.802998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.479 [2024-11-19 02:03:07.803266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:12339 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.479 [2024-11-19 02:03:07.803300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.816753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.817113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:2541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.817146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.830478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.830773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:9722 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.830803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.844261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.844541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:21725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.844575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.858085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.858359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:20010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.858392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.871831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.872129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:2450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.872162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.885555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.885834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:19580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.885865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.899149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.899433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:10990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.899467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.912741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.912990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:13743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.913024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.926210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.926447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:14992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.926481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.939729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.939997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:2730 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.940031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.953353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.953623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:14713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.953664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.966935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.967217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:4789 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.967251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.980391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.980698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:7109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.980728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:07.993940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:07.994222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:18602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:07.994257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:08.007610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:08.007923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:5971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:08.007953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.480 [2024-11-19 02:03:08.021363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.480 [2024-11-19 02:03:08.021686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:4894 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.480 [2024-11-19 02:03:08.021717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.738 [2024-11-19 02:03:08.035229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.738 [2024-11-19 02:03:08.035492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:19837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.738 [2024-11-19 02:03:08.035527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.738 [2024-11-19 02:03:08.048893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.738 [2024-11-19 02:03:08.049207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:22424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.738 [2024-11-19 02:03:08.049253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.062323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.062591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:7107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.062621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.075859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.076152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:11450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.076186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.089198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.089449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:19320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.089479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.102726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.102948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:12155 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.102984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.116066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.116320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:8316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.116365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.129439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.129706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.129737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.142564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.142819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:12003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.142849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.156117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.156396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:4432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.156430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.169568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.169835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:14245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.169865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.183307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.183557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:4742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.183588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.196986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.197235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:20569 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.197268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.210874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.211194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:22782 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.211227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.224680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.224965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.225011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.238442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.238735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:11271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.238765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.252171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.252469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:25066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.252502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.265935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.266219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:5983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.266253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.739 [2024-11-19 02:03:08.279706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.739 [2024-11-19 02:03:08.279994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:10255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.739 [2024-11-19 02:03:08.280027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.293207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.293477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:4450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.293508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.306548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.306834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:20755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.306865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.319953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.320233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:15420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.320263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.333342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.333616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:19914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.333658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.347071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.347356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:11800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.347390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.360787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.361150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:18625 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.361183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.374555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.374844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:12368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.374874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.388222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.388490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:22250 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.388523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.401902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.402217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:19868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.402250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.997 [2024-11-19 02:03:08.415496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.997 [2024-11-19 02:03:08.415795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:13137 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.997 [2024-11-19 02:03:08.415826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.429224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.429462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:20292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.429495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.443050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.443337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:21958 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.443370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.456802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.457069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3406 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.457107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.470503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.470798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:5266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.470828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.484220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.484464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:10672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.484498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.497947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.498244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:1315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.498277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.511688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.512056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:12927 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.512089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.525418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.525715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:16321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.525745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:19.998 [2024-11-19 02:03:08.539196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:19.998 [2024-11-19 02:03:08.539523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:17183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.998 [2024-11-19 02:03:08.539558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.256 [2024-11-19 02:03:08.552941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.256 [2024-11-19 02:03:08.553239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:15927 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.256 [2024-11-19 02:03:08.553274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.256 [2024-11-19 02:03:08.566622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.256 [2024-11-19 02:03:08.566972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:16499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.256 [2024-11-19 02:03:08.567006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.256 [2024-11-19 02:03:08.580299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.256 [2024-11-19 02:03:08.580576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:7563 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.256 [2024-11-19 02:03:08.580615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.256 [2024-11-19 02:03:08.594044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.256 [2024-11-19 02:03:08.594316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:22538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.256 [2024-11-19 02:03:08.594350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.256 [2024-11-19 02:03:08.607804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.608119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:5798 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.608152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.621571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.621848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:19032 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.621879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.635361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.635644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:13837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.635692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.649135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.649408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:5083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.649442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.662780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.663072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:19080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.663105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.676492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.676775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:16722 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.676806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.690199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.690468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:2774 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.690501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.704018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.704287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:15083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.704320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.717738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.718037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:5728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.718071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.731327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.731597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:23154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.731635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.744911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.745204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.745237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.758527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.758778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:4227 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.758809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.772241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.772512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:24869 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.772546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.786002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.786245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:6330 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.786278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.257 [2024-11-19 02:03:08.799788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.257 [2024-11-19 02:03:08.800067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:9889 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.257 [2024-11-19 02:03:08.800101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.813650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.814005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:16606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.814039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.827480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.827788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:5691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.827819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.841243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.841510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:12057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.841544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.854931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.855227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8685 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.855260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.868718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.869012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:6949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.869046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.882405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.882699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.882728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.896169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.896435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:6772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.896467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.909866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.910160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6678 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.910193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.923631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.924008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:14192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.924042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.937260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.937535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:17187 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.937574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.950997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.951266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:5019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.951300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.964716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.965002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.965035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.978486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.978790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:7370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.978821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:08.991994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:08.992246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:15857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:08.992279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:09.005414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:09.005707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:09.005738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:09.018987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:09.019231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:14690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:09.019264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:09.032791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:09.033115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:22316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:09.033148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:09.046576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:09.046860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:22791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:09.046889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.516 [2024-11-19 02:03:09.060373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.516 [2024-11-19 02:03:09.060684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:15937 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.516 [2024-11-19 02:03:09.060715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.789 [2024-11-19 02:03:09.074236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.789 [2024-11-19 02:03:09.074519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.790 [2024-11-19 02:03:09.074554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.790 [2024-11-19 02:03:09.088036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412ad0) with pdu=0x2000190eb760 00:27:20.790 [2024-11-19 02:03:09.088312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:14719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.790 [2024-11-19 02:03:09.088345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:20.790 00:27:20.790 Latency(us) 00:27:20.790 [2024-11-19T01:03:09.333Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:20.790 [2024-11-19T01:03:09.333Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:20.790 nvme0n1 : 2.01 18902.85 73.84 0.00 0.00 6756.07 2779.21 15146.10 00:27:20.790 [2024-11-19T01:03:09.333Z] =================================================================================================================== 00:27:20.790 [2024-11-19T01:03:09.333Z] Total : 18902.85 73.84 0.00 0.00 6756.07 2779.21 15146.10 00:27:20.790 0 00:27:20.790 02:03:09 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:20.790 02:03:09 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:20.790 02:03:09 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:20.790 | .driver_specific 00:27:20.790 | .nvme_error 00:27:20.790 | .status_code 00:27:20.790 | .command_transient_transport_error' 00:27:20.790 02:03:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:21.051 02:03:09 -- host/digest.sh@71 -- # (( 148 > 0 )) 00:27:21.051 02:03:09 -- host/digest.sh@73 -- # killprocess 3558409 00:27:21.051 02:03:09 -- common/autotest_common.sh@936 -- # '[' -z 3558409 ']' 00:27:21.051 02:03:09 -- common/autotest_common.sh@940 -- # kill -0 3558409 00:27:21.051 02:03:09 -- common/autotest_common.sh@941 -- # uname 00:27:21.051 02:03:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:21.051 02:03:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3558409 00:27:21.051 02:03:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:21.051 02:03:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:21.051 02:03:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3558409' 00:27:21.051 killing process with pid 3558409 00:27:21.051 02:03:09 -- common/autotest_common.sh@955 -- # kill 3558409 00:27:21.051 Received shutdown signal, test time was about 2.000000 seconds 00:27:21.051 00:27:21.051 Latency(us) 00:27:21.051 [2024-11-19T01:03:09.594Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.051 [2024-11-19T01:03:09.594Z] =================================================================================================================== 00:27:21.051 [2024-11-19T01:03:09.594Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:21.051 02:03:09 -- common/autotest_common.sh@960 -- # wait 3558409 00:27:21.309 02:03:09 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:21.309 02:03:09 -- host/digest.sh@54 -- # local rw bs qd 00:27:21.309 02:03:09 -- host/digest.sh@56 -- # rw=randwrite 00:27:21.309 02:03:09 -- host/digest.sh@56 -- # bs=131072 00:27:21.309 02:03:09 -- host/digest.sh@56 -- # qd=16 00:27:21.309 02:03:09 -- host/digest.sh@58 -- # bperfpid=3559463 00:27:21.309 02:03:09 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:21.309 02:03:09 -- host/digest.sh@60 -- # waitforlisten 3559463 /var/tmp/bperf.sock 00:27:21.309 02:03:09 -- common/autotest_common.sh@829 -- # '[' -z 3559463 ']' 00:27:21.309 02:03:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:21.309 02:03:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:21.309 02:03:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:21.309 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:21.309 02:03:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:21.309 02:03:09 -- common/autotest_common.sh@10 -- # set +x 00:27:21.309 [2024-11-19 02:03:09.716222] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.309 [2024-11-19 02:03:09.716305] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3559463 ] 00:27:21.309 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:21.309 Zero copy mechanism will not be used. 00:27:21.309 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.309 [2024-11-19 02:03:09.776397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:21.567 [2024-11-19 02:03:09.891887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:22.501 02:03:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:22.501 02:03:10 -- common/autotest_common.sh@862 -- # return 0 00:27:22.501 02:03:10 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:22.501 02:03:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:22.501 02:03:11 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:22.501 02:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.501 02:03:11 -- common/autotest_common.sh@10 -- # set +x 00:27:22.501 02:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.501 02:03:11 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:22.501 02:03:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:23.068 nvme0n1 00:27:23.068 02:03:11 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:23.068 02:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:23.068 02:03:11 -- common/autotest_common.sh@10 -- # set +x 00:27:23.068 02:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:23.068 02:03:11 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:23.068 02:03:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:23.068 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:23.068 Zero copy mechanism will not be used. 00:27:23.068 Running I/O for 2 seconds... 00:27:23.068 [2024-11-19 02:03:11.610986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.068 [2024-11-19 02:03:11.611563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.068 [2024-11-19 02:03:11.611610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.616507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.617022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.617059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.621866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.622198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.622293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.627414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.627876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.627969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.632824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.633192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.633226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.638318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.638546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.638605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.644824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.644924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.645033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.650053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.650478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.650515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.655107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.655376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.655457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.660042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.660482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.660569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.664999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.665440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.665538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.669841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.669991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.670094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.675147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.675447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.675518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.680794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.680918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.328 [2024-11-19 02:03:11.680948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.328 [2024-11-19 02:03:11.687429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.328 [2024-11-19 02:03:11.687725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.687755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.692766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.693025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.693064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.697564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.698121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.698198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.702570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.702948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.703050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.707609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.708137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.708171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.712685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.713008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.713072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.717444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.717921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.718020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.722354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.722827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.722872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.727254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.727748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.727810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.731961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.732556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.732586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.736795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.737212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.737248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.741703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.742234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.742302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.746334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.746854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.746884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.751115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.751710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.751766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.755838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.756342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.756385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.760648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.761149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.761264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.765547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.765812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.765885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.770964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.771184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.771247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.776302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.776868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.776898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.781848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.782170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.782259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.786944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.787462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.787496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.792181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.792689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.792795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.797533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.798095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.798192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.803075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.329 [2024-11-19 02:03:11.803310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.329 [2024-11-19 02:03:11.803395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.329 [2024-11-19 02:03:11.808354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.808657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.808766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.813601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.813852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.813930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.818822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.819171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.819238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.824100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.824485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.824519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.829617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.830050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.830143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.834870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.835250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.835358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.840167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.840535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.840569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.845379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.845725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.845756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.850799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.851159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.851246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.856157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.856396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.856498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.861367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.861876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.861980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.866509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.866804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.866835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.330 [2024-11-19 02:03:11.871802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.330 [2024-11-19 02:03:11.872328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.330 [2024-11-19 02:03:11.872380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.877366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.877784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.877835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.883037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.883346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.883380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.888435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.888867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.888968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.893789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.894351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.894455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.899172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.899799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.899830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.904652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.905025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.905122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.909803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.910082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.910123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.915262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.915575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.915678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.920630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.921117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.921150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.926029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.926234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.926286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.932214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.932347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.932410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.938492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.938945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.938997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.945129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.945242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.945326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.951429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.951662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.951712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.958161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.958311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.958347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.964775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.589 [2024-11-19 02:03:11.964914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.589 [2024-11-19 02:03:11.964972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.589 [2024-11-19 02:03:11.971610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:11.971784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:11.971814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:11.978160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:11.978429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:11.978462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:11.984893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:11.985139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:11.985188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:11.991535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:11.991820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:11.991851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:11.997799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:11.997993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:11.998026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.003253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.003459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.003494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.008710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.009050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.009084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.014061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.014423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.014455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.019904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.020272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.020331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.025832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.026099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.026133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.031433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.031851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.031881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.037057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.037342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.037382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.042680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.042933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.042990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.048392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.048685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.048720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.054085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.054375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.054412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.059704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.059904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.060012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.065246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.065409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.065483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.070904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.071240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.071274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.076446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.076736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.076805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.082253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.082739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.082769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.087942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.088248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.088281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.093655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.093920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.093950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.099370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.099481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.099516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.590 [2024-11-19 02:03:12.104970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.590 [2024-11-19 02:03:12.105114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.590 [2024-11-19 02:03:12.105199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.591 [2024-11-19 02:03:12.110362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.591 [2024-11-19 02:03:12.110661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.591 [2024-11-19 02:03:12.110715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.591 [2024-11-19 02:03:12.115855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.591 [2024-11-19 02:03:12.116245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.591 [2024-11-19 02:03:12.116325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.591 [2024-11-19 02:03:12.121562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.591 [2024-11-19 02:03:12.121753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.591 [2024-11-19 02:03:12.121788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.591 [2024-11-19 02:03:12.127369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.591 [2024-11-19 02:03:12.127588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.591 [2024-11-19 02:03:12.127700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.591 [2024-11-19 02:03:12.132798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.591 [2024-11-19 02:03:12.133023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.591 [2024-11-19 02:03:12.133101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.138325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.138719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.138800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.144728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.145076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.145118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.150472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.150950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.151040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.155160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.155488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.155523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.160210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.160579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.160612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.165197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.165503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.165600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.170083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.170364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.170397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.175022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.175359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.175406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.180006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.180375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.180408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.184967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.185421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.185487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.189867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.190254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.190287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.194897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.195168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.195225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.199847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.200259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.200318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.204777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.205106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.205197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.209783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.210017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.210084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.214619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.214892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.214922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.219716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.219853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.219943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.224562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.224973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.225055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.229684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.230073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.230125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.234575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.235002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.235096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.849 [2024-11-19 02:03:12.239627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.849 [2024-11-19 02:03:12.240039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.849 [2024-11-19 02:03:12.240134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.244727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.244937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.245034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.249658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.249991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.250079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.254516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.254929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.254980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.259270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.259743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.259806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.264150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.264551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.264608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.268650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.269122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.269156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.273511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.273999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.274033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.278205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.278772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.278853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.282935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.283495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.283529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.287726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.288090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.288124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.292504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.292940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.293038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.297183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.297475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.297509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.301933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.302338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.302372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.307144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.307360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.307394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.311871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.312308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.312348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.316565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.317048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.317083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.321453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.321892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.321990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.326616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.326849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.326892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.331915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.332148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.332181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.337273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.337450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.337548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.342746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.342953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.850 [2024-11-19 02:03:12.343052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.850 [2024-11-19 02:03:12.347973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.850 [2024-11-19 02:03:12.348168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.348201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.353448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.353679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.353726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.358816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.359061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.359095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.364022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.364226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.364326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.369550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.369822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.369853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.374769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.374970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.375000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.380255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.380433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.380466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.386291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.386459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.386500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.851 [2024-11-19 02:03:12.392593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:23.851 [2024-11-19 02:03:12.392853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.851 [2024-11-19 02:03:12.392891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.398209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.398438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.398471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.403509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.403812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.403877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.409031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.409330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.409415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.414863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.415165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.415214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.419995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.420556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.420589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.425045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.425503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.425617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.430189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.430407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.430496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.110 [2024-11-19 02:03:12.435973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.110 [2024-11-19 02:03:12.436271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.110 [2024-11-19 02:03:12.436305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.441415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.441625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.441734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.447366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.447575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.447684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.452918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.453092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.453159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.458741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.458929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.459022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.464337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.464506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.464539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.470034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.470355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.470422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.475420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.475620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.475666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.481016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.481279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.481313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.486572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.486822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.486852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.492078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.492487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.492567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.497731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.497971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.498067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.503129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.503551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.503584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.508982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.509269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.509341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.514465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.514810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.514869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.520163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.520317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.520350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.525879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.526267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.526302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.531438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.531802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.531888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.537200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.537404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.537444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.542773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.543133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.543183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.548174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.548444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.548484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.554093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.554330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.554416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.111 [2024-11-19 02:03:12.559724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.111 [2024-11-19 02:03:12.559853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.111 [2024-11-19 02:03:12.559919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.565376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.565622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.565723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.571050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.571212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.571266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.576527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.576986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.577076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.581787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.582298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.582356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.587305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.587519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.587553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.593702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.593860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.593986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.598634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.598783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.598871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.603582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.603919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.603965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.608459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.608786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.608868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.612858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.613266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.613294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.617765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.617892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.617972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.623582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.623930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.624013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.628805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.628994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.629159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.634246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.634674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.634763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.639595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.639932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.640015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.645746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.645895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.645940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.112 [2024-11-19 02:03:12.652190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.112 [2024-11-19 02:03:12.652673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.112 [2024-11-19 02:03:12.652765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.657361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.657832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.657872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.662353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.662980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.663045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.667431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.667592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.667624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.673242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.673657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.673710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.679188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.679414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.679470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.685130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.685416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.685452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.690920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.691395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.691427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.697740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.697972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.698046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.703809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.704129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.704199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.709294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.709579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.709611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.714822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.715183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.715215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.720474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.720622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.720665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.726721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.726855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.726885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.733514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.733941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.734017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.739124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.739695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.739732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.745036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.745312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.745352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.750316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.750716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.750746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.755817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.756005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.756038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.762391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.762882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.762929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.768051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.768381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.768430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.773334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.773491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.773524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.779086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.779439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.779471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.784658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.784979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.785021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.790210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.790550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.379 [2024-11-19 02:03:12.790582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.379 [2024-11-19 02:03:12.796039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.379 [2024-11-19 02:03:12.796303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.382 [2024-11-19 02:03:12.796342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.382 [2024-11-19 02:03:12.801838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.382 [2024-11-19 02:03:12.802182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.382 [2024-11-19 02:03:12.802216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.382 [2024-11-19 02:03:12.807446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.382 [2024-11-19 02:03:12.807798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.382 [2024-11-19 02:03:12.807828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.382 [2024-11-19 02:03:12.813132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.382 [2024-11-19 02:03:12.813456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.382 [2024-11-19 02:03:12.813490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.382 [2024-11-19 02:03:12.818730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.382 [2024-11-19 02:03:12.819108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.382 [2024-11-19 02:03:12.819207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.382 [2024-11-19 02:03:12.824602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.382 [2024-11-19 02:03:12.824829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.382 [2024-11-19 02:03:12.824906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.382 [2024-11-19 02:03:12.830543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.382 [2024-11-19 02:03:12.830895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.382 [2024-11-19 02:03:12.830929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.382 [2024-11-19 02:03:12.836359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.836683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.836732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.841818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.842095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.842139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.847726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.847870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.847918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.854381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.854782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.854813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.859320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.859798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.859864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.864280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.864535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.864622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.869431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.869518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.869551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.874926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.875250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.875284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.880172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.880508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.880543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.885479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.885750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.885781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.890863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.891063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.891152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.896319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.896427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.896459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.901762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.901891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.901921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.907171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.907408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.907441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.912412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.912712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.912744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.917765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.917894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.917988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.383 [2024-11-19 02:03:12.923241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.383 [2024-11-19 02:03:12.923589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.383 [2024-11-19 02:03:12.923624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.928247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.928437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.928487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.934398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.934537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.934570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.939866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.940128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.940162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.945209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.945486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.945519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.950841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.951089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.951170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.956355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.956704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.956735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.961741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.961865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.961906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.967017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.967233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.967266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.972254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.972500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.972535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.977510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.977608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.977730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.982783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.983003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.983043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.987922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.988163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.988280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.993147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.993273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.993306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:12.998546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:12.998843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.642 [2024-11-19 02:03:12.998874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.642 [2024-11-19 02:03:13.003920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.642 [2024-11-19 02:03:13.004124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.004156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.009319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.009477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.009510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.014621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.014788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.014818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.019854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.020025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.020058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.025372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.025646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.025694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.030633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.031078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.031166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.036177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.036354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.036443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.041384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.041585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.041619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.046843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.046924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.047024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.052083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.052167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.052199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.057572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.057737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.057804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.062888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.063166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.063199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.068374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.068632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.068749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.073760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.074022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.074118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.079079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.079268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.079301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.084350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.084504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.084537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.089852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.090121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.090233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.095035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.095267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.095300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.100481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.100810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.100841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.105618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.105863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.105892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.111009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.111195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.111227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.117426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.117821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.117851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.123789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.124201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.124244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.129349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.129626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.129724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.134635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.134855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.134916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.140003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.140404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.140462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.145818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.643 [2024-11-19 02:03:13.146126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.643 [2024-11-19 02:03:13.146166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.643 [2024-11-19 02:03:13.152059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.644 [2024-11-19 02:03:13.152410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.644 [2024-11-19 02:03:13.152479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.644 [2024-11-19 02:03:13.157163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.644 [2024-11-19 02:03:13.157656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.644 [2024-11-19 02:03:13.157723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.644 [2024-11-19 02:03:13.162236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.644 [2024-11-19 02:03:13.162491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.644 [2024-11-19 02:03:13.162588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.644 [2024-11-19 02:03:13.167755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.644 [2024-11-19 02:03:13.167847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.644 [2024-11-19 02:03:13.167877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.644 [2024-11-19 02:03:13.173223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.644 [2024-11-19 02:03:13.173350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.644 [2024-11-19 02:03:13.173384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.644 [2024-11-19 02:03:13.178464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.644 [2024-11-19 02:03:13.178761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.644 [2024-11-19 02:03:13.178792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.644 [2024-11-19 02:03:13.183953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.644 [2024-11-19 02:03:13.184048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.644 [2024-11-19 02:03:13.184078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.902 [2024-11-19 02:03:13.189455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.902 [2024-11-19 02:03:13.189774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.902 [2024-11-19 02:03:13.189805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.902 [2024-11-19 02:03:13.195114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.902 [2024-11-19 02:03:13.195232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.902 [2024-11-19 02:03:13.195269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.902 [2024-11-19 02:03:13.201157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.902 [2024-11-19 02:03:13.201334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.902 [2024-11-19 02:03:13.201409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.902 [2024-11-19 02:03:13.207210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.902 [2024-11-19 02:03:13.207405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.902 [2024-11-19 02:03:13.207455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.902 [2024-11-19 02:03:13.213609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.902 [2024-11-19 02:03:13.213761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.902 [2024-11-19 02:03:13.213791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.902 [2024-11-19 02:03:13.219092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.219432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.219468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.224083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.224607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.224716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.229008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.229428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.229487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.234098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.234376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.234409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.238984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.239332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.239443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.243762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.244103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.244137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.248602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.249052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.249086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.253274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.253724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.253754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.258042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.258541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.258645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.262755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.263163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.263234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.267399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.267984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.268075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.272186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.272682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.272713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.276999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.277506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.277540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.281966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.282512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.282585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.286715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.287097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.287178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.291443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.291878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.291908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.296204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.296694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.296727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.301055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.301477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.301531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.305983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.306396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.306479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.310654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.311051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.311085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.315393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.315816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.315847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.320137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.320594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.320628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.325115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.325522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.325554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.329755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.330218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.330250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.334532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.335034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.335138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.339280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.339734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.339765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.344008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.903 [2024-11-19 02:03:13.344507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.903 [2024-11-19 02:03:13.344540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.903 [2024-11-19 02:03:13.348719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.349154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.349252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.353429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.353872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.353903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.358276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.358801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.358883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.363107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.363434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.363494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.367889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.368273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.368384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.372717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.373237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.373271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.377449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.377827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.377860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.382282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.382861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.382896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.386715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.387125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.387166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.391251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.391745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.391775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.396730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.396895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.396925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.401518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.402058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.402131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.406503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.406918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.406948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.411341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.411717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.411748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.416039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.416581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.416614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.420773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.421198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.421278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.425501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.425859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.425890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.430594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.430731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.430819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.435518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.435986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.436020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.440253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.440581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.440673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.904 [2024-11-19 02:03:13.445061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:24.904 [2024-11-19 02:03:13.445553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.904 [2024-11-19 02:03:13.445586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.450102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.450337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.450389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.454975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.455423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.455456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.459794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.460250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.460312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.464482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.464853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.464967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.469160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.469547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.469596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.473856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.474485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.474546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.478729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.478985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.479122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.483426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.483887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.483962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.488213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.488626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.488668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.492828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.493334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.493367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.497626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.498146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.498246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.502478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.502835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.502919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.508043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.508298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.508330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.513246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.513652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.513765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.518704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.519094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.519186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.523794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.524112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.524145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.529863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.530070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.530104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.535725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.535973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.536053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.540441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.540709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.540785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.545522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.163 [2024-11-19 02:03:13.545873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.163 [2024-11-19 02:03:13.545971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.163 [2024-11-19 02:03:13.550336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.550736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.550811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.555243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.555578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.555612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.560173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.560434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.560532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.565122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.565520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.565593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.570133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.570506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.570541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.575080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.575344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.575435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.579912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.580202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.580282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.584864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.585173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.585206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.589943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.590312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.590351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.594812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.595192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.595254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.599762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.600039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.600113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.164 [2024-11-19 02:03:13.604682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1412fb0) with pdu=0x2000190fef90 00:27:25.164 [2024-11-19 02:03:13.605041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.164 [2024-11-19 02:03:13.605076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.164 00:27:25.164 Latency(us) 00:27:25.164 [2024-11-19T01:03:13.707Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:25.164 [2024-11-19T01:03:13.707Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:25.164 nvme0n1 : 2.00 5812.61 726.58 0.00 0.00 2741.77 1771.90 9077.95 00:27:25.164 [2024-11-19T01:03:13.707Z] =================================================================================================================== 00:27:25.164 [2024-11-19T01:03:13.707Z] Total : 5812.61 726.58 0.00 0.00 2741.77 1771.90 9077.95 00:27:25.164 0 00:27:25.164 02:03:13 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:25.164 02:03:13 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:25.164 02:03:13 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:25.164 | .driver_specific 00:27:25.164 | .nvme_error 00:27:25.164 | .status_code 00:27:25.164 | .command_transient_transport_error' 00:27:25.164 02:03:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:25.422 02:03:13 -- host/digest.sh@71 -- # (( 375 > 0 )) 00:27:25.422 02:03:13 -- host/digest.sh@73 -- # killprocess 3559463 00:27:25.422 02:03:13 -- common/autotest_common.sh@936 -- # '[' -z 3559463 ']' 00:27:25.422 02:03:13 -- common/autotest_common.sh@940 -- # kill -0 3559463 00:27:25.422 02:03:13 -- common/autotest_common.sh@941 -- # uname 00:27:25.422 02:03:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:25.422 02:03:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3559463 00:27:25.422 02:03:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:25.422 02:03:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:25.422 02:03:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3559463' 00:27:25.422 killing process with pid 3559463 00:27:25.422 02:03:13 -- common/autotest_common.sh@955 -- # kill 3559463 00:27:25.422 Received shutdown signal, test time was about 2.000000 seconds 00:27:25.422 00:27:25.422 Latency(us) 00:27:25.422 [2024-11-19T01:03:13.965Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:25.422 [2024-11-19T01:03:13.965Z] =================================================================================================================== 00:27:25.422 [2024-11-19T01:03:13.965Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:25.422 02:03:13 -- common/autotest_common.sh@960 -- # wait 3559463 00:27:25.680 02:03:14 -- host/digest.sh@115 -- # killprocess 3557163 00:27:25.680 02:03:14 -- common/autotest_common.sh@936 -- # '[' -z 3557163 ']' 00:27:25.680 02:03:14 -- common/autotest_common.sh@940 -- # kill -0 3557163 00:27:25.680 02:03:14 -- common/autotest_common.sh@941 -- # uname 00:27:25.680 02:03:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:25.680 02:03:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3557163 00:27:25.938 02:03:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:25.938 02:03:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:25.938 02:03:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3557163' 00:27:25.938 killing process with pid 3557163 00:27:25.938 02:03:14 -- common/autotest_common.sh@955 -- # kill 3557163 00:27:25.938 02:03:14 -- common/autotest_common.sh@960 -- # wait 3557163 00:27:26.196 00:27:26.196 real 0m18.432s 00:27:26.196 user 0m36.134s 00:27:26.196 sys 0m4.937s 00:27:26.196 02:03:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:26.196 02:03:14 -- common/autotest_common.sh@10 -- # set +x 00:27:26.196 ************************************ 00:27:26.196 END TEST nvmf_digest_error 00:27:26.196 ************************************ 00:27:26.196 02:03:14 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:26.196 02:03:14 -- host/digest.sh@139 -- # nvmftestfini 00:27:26.196 02:03:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:26.196 02:03:14 -- nvmf/common.sh@116 -- # sync 00:27:26.196 02:03:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:26.196 02:03:14 -- nvmf/common.sh@119 -- # set +e 00:27:26.196 02:03:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:26.196 02:03:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:26.196 rmmod nvme_tcp 00:27:26.196 rmmod nvme_fabrics 00:27:26.196 rmmod nvme_keyring 00:27:26.196 02:03:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:26.196 02:03:14 -- nvmf/common.sh@123 -- # set -e 00:27:26.196 02:03:14 -- nvmf/common.sh@124 -- # return 0 00:27:26.196 02:03:14 -- nvmf/common.sh@477 -- # '[' -n 3557163 ']' 00:27:26.196 02:03:14 -- nvmf/common.sh@478 -- # killprocess 3557163 00:27:26.196 02:03:14 -- common/autotest_common.sh@936 -- # '[' -z 3557163 ']' 00:27:26.196 02:03:14 -- common/autotest_common.sh@940 -- # kill -0 3557163 00:27:26.196 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3557163) - No such process 00:27:26.196 02:03:14 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3557163 is not found' 00:27:26.196 Process with pid 3557163 is not found 00:27:26.196 02:03:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:26.196 02:03:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:26.196 02:03:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:26.196 02:03:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:26.196 02:03:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:26.196 02:03:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:26.196 02:03:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:26.196 02:03:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:28.724 02:03:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:28.724 00:27:28.724 real 0m38.172s 00:27:28.724 user 1m7.061s 00:27:28.724 sys 0m10.916s 00:27:28.724 02:03:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:28.724 02:03:16 -- common/autotest_common.sh@10 -- # set +x 00:27:28.724 ************************************ 00:27:28.724 END TEST nvmf_digest 00:27:28.724 ************************************ 00:27:28.724 02:03:16 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:28.724 02:03:16 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:28.724 02:03:16 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:28.724 02:03:16 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:28.724 02:03:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:28.724 02:03:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:28.724 02:03:16 -- common/autotest_common.sh@10 -- # set +x 00:27:28.724 ************************************ 00:27:28.724 START TEST nvmf_bdevperf 00:27:28.725 ************************************ 00:27:28.725 02:03:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:28.725 * Looking for test storage... 00:27:28.725 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:28.725 02:03:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:28.725 02:03:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:28.725 02:03:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:28.725 02:03:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:28.725 02:03:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:28.725 02:03:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:28.725 02:03:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:28.725 02:03:16 -- scripts/common.sh@335 -- # IFS=.-: 00:27:28.725 02:03:16 -- scripts/common.sh@335 -- # read -ra ver1 00:27:28.725 02:03:16 -- scripts/common.sh@336 -- # IFS=.-: 00:27:28.725 02:03:16 -- scripts/common.sh@336 -- # read -ra ver2 00:27:28.725 02:03:16 -- scripts/common.sh@337 -- # local 'op=<' 00:27:28.725 02:03:16 -- scripts/common.sh@339 -- # ver1_l=2 00:27:28.725 02:03:16 -- scripts/common.sh@340 -- # ver2_l=1 00:27:28.725 02:03:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:28.725 02:03:16 -- scripts/common.sh@343 -- # case "$op" in 00:27:28.725 02:03:16 -- scripts/common.sh@344 -- # : 1 00:27:28.725 02:03:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:28.725 02:03:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:28.725 02:03:16 -- scripts/common.sh@364 -- # decimal 1 00:27:28.725 02:03:16 -- scripts/common.sh@352 -- # local d=1 00:27:28.725 02:03:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:28.725 02:03:16 -- scripts/common.sh@354 -- # echo 1 00:27:28.725 02:03:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:28.725 02:03:16 -- scripts/common.sh@365 -- # decimal 2 00:27:28.725 02:03:16 -- scripts/common.sh@352 -- # local d=2 00:27:28.725 02:03:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:28.725 02:03:16 -- scripts/common.sh@354 -- # echo 2 00:27:28.725 02:03:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:28.725 02:03:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:28.725 02:03:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:28.725 02:03:16 -- scripts/common.sh@367 -- # return 0 00:27:28.725 02:03:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:28.725 02:03:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:28.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:28.725 --rc genhtml_branch_coverage=1 00:27:28.725 --rc genhtml_function_coverage=1 00:27:28.725 --rc genhtml_legend=1 00:27:28.725 --rc geninfo_all_blocks=1 00:27:28.725 --rc geninfo_unexecuted_blocks=1 00:27:28.725 00:27:28.725 ' 00:27:28.725 02:03:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:28.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:28.725 --rc genhtml_branch_coverage=1 00:27:28.725 --rc genhtml_function_coverage=1 00:27:28.725 --rc genhtml_legend=1 00:27:28.725 --rc geninfo_all_blocks=1 00:27:28.725 --rc geninfo_unexecuted_blocks=1 00:27:28.725 00:27:28.725 ' 00:27:28.725 02:03:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:28.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:28.725 --rc genhtml_branch_coverage=1 00:27:28.725 --rc genhtml_function_coverage=1 00:27:28.725 --rc genhtml_legend=1 00:27:28.725 --rc geninfo_all_blocks=1 00:27:28.725 --rc geninfo_unexecuted_blocks=1 00:27:28.725 00:27:28.725 ' 00:27:28.725 02:03:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:28.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:28.725 --rc genhtml_branch_coverage=1 00:27:28.725 --rc genhtml_function_coverage=1 00:27:28.725 --rc genhtml_legend=1 00:27:28.725 --rc geninfo_all_blocks=1 00:27:28.725 --rc geninfo_unexecuted_blocks=1 00:27:28.725 00:27:28.725 ' 00:27:28.725 02:03:16 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:28.725 02:03:16 -- nvmf/common.sh@7 -- # uname -s 00:27:28.725 02:03:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:28.725 02:03:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:28.725 02:03:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:28.725 02:03:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:28.725 02:03:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:28.725 02:03:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:28.725 02:03:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:28.725 02:03:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:28.725 02:03:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:28.725 02:03:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:28.725 02:03:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:28.725 02:03:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:28.725 02:03:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:28.725 02:03:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:28.725 02:03:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:28.725 02:03:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:28.725 02:03:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:28.725 02:03:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:28.725 02:03:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:28.725 02:03:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:28.725 02:03:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:28.725 02:03:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:28.725 02:03:16 -- paths/export.sh@5 -- # export PATH 00:27:28.725 02:03:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:28.725 02:03:16 -- nvmf/common.sh@46 -- # : 0 00:27:28.725 02:03:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:28.725 02:03:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:28.725 02:03:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:28.725 02:03:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:28.725 02:03:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:28.725 02:03:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:28.725 02:03:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:28.725 02:03:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:28.725 02:03:16 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:28.725 02:03:16 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:28.725 02:03:16 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:28.726 02:03:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:28.726 02:03:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:28.726 02:03:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:28.726 02:03:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:28.726 02:03:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:28.726 02:03:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:28.726 02:03:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:28.726 02:03:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:28.726 02:03:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:28.726 02:03:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:28.726 02:03:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:28.726 02:03:16 -- common/autotest_common.sh@10 -- # set +x 00:27:30.708 02:03:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:30.708 02:03:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:30.708 02:03:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:30.708 02:03:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:30.708 02:03:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:30.708 02:03:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:30.708 02:03:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:30.708 02:03:18 -- nvmf/common.sh@294 -- # net_devs=() 00:27:30.708 02:03:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:30.708 02:03:18 -- nvmf/common.sh@295 -- # e810=() 00:27:30.708 02:03:18 -- nvmf/common.sh@295 -- # local -ga e810 00:27:30.708 02:03:18 -- nvmf/common.sh@296 -- # x722=() 00:27:30.708 02:03:18 -- nvmf/common.sh@296 -- # local -ga x722 00:27:30.708 02:03:18 -- nvmf/common.sh@297 -- # mlx=() 00:27:30.708 02:03:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:30.708 02:03:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:30.708 02:03:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:30.708 02:03:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:30.708 02:03:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:30.708 02:03:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:30.708 02:03:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:30.708 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:30.708 02:03:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:30.708 02:03:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:30.708 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:30.708 02:03:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:30.708 02:03:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:30.708 02:03:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:30.708 02:03:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:30.708 02:03:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:30.708 02:03:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:30.708 02:03:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:30.708 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:30.708 02:03:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:30.708 02:03:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:30.709 02:03:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:30.709 02:03:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:30.709 02:03:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:30.709 02:03:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:30.709 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:30.709 02:03:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:30.709 02:03:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:30.709 02:03:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:30.709 02:03:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:30.709 02:03:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:30.709 02:03:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:30.709 02:03:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:30.709 02:03:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:30.709 02:03:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:30.709 02:03:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:30.709 02:03:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:30.709 02:03:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:30.709 02:03:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:30.709 02:03:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:30.709 02:03:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:30.709 02:03:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:30.709 02:03:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:30.709 02:03:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:30.709 02:03:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:30.709 02:03:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:30.709 02:03:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:30.709 02:03:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:30.709 02:03:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:30.709 02:03:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:30.709 02:03:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:30.709 02:03:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:30.709 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:30.709 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:27:30.709 00:27:30.709 --- 10.0.0.2 ping statistics --- 00:27:30.709 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:30.709 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:27:30.709 02:03:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:30.709 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:30.709 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:27:30.709 00:27:30.709 --- 10.0.0.1 ping statistics --- 00:27:30.709 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:30.709 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:27:30.709 02:03:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:30.709 02:03:19 -- nvmf/common.sh@410 -- # return 0 00:27:30.709 02:03:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:30.709 02:03:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:30.709 02:03:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:30.709 02:03:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:30.709 02:03:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:30.709 02:03:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:30.709 02:03:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:30.709 02:03:19 -- host/bdevperf.sh@25 -- # tgt_init 00:27:30.709 02:03:19 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:30.709 02:03:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:30.709 02:03:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:30.709 02:03:19 -- common/autotest_common.sh@10 -- # set +x 00:27:30.709 02:03:19 -- nvmf/common.sh@469 -- # nvmfpid=3561981 00:27:30.709 02:03:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:30.709 02:03:19 -- nvmf/common.sh@470 -- # waitforlisten 3561981 00:27:30.709 02:03:19 -- common/autotest_common.sh@829 -- # '[' -z 3561981 ']' 00:27:30.709 02:03:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:30.709 02:03:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:30.709 02:03:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:30.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:30.709 02:03:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:30.709 02:03:19 -- common/autotest_common.sh@10 -- # set +x 00:27:30.709 [2024-11-19 02:03:19.126109] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:30.709 [2024-11-19 02:03:19.126182] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:30.709 EAL: No free 2048 kB hugepages reported on node 1 00:27:30.709 [2024-11-19 02:03:19.190151] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:30.966 [2024-11-19 02:03:19.300186] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:30.966 [2024-11-19 02:03:19.300346] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:30.966 [2024-11-19 02:03:19.300380] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:30.966 [2024-11-19 02:03:19.300393] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:30.966 [2024-11-19 02:03:19.300542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:30.966 [2024-11-19 02:03:19.300605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:30.966 [2024-11-19 02:03:19.300608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:31.900 02:03:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:31.900 02:03:20 -- common/autotest_common.sh@862 -- # return 0 00:27:31.900 02:03:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:31.900 02:03:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:31.900 02:03:20 -- common/autotest_common.sh@10 -- # set +x 00:27:31.900 02:03:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:31.900 02:03:20 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:31.900 02:03:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:31.900 02:03:20 -- common/autotest_common.sh@10 -- # set +x 00:27:31.900 [2024-11-19 02:03:20.127777] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:31.900 02:03:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:31.900 02:03:20 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:31.900 02:03:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:31.900 02:03:20 -- common/autotest_common.sh@10 -- # set +x 00:27:31.900 Malloc0 00:27:31.900 02:03:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:31.900 02:03:20 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:31.900 02:03:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:31.900 02:03:20 -- common/autotest_common.sh@10 -- # set +x 00:27:31.900 02:03:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:31.900 02:03:20 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:31.900 02:03:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:31.900 02:03:20 -- common/autotest_common.sh@10 -- # set +x 00:27:31.900 02:03:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:31.900 02:03:20 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:31.900 02:03:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:31.900 02:03:20 -- common/autotest_common.sh@10 -- # set +x 00:27:31.900 [2024-11-19 02:03:20.183092] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:31.900 02:03:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:31.900 02:03:20 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:31.900 02:03:20 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:31.900 02:03:20 -- nvmf/common.sh@520 -- # config=() 00:27:31.900 02:03:20 -- nvmf/common.sh@520 -- # local subsystem config 00:27:31.900 02:03:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:31.900 02:03:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:31.900 { 00:27:31.900 "params": { 00:27:31.900 "name": "Nvme$subsystem", 00:27:31.900 "trtype": "$TEST_TRANSPORT", 00:27:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:31.900 "adrfam": "ipv4", 00:27:31.900 "trsvcid": "$NVMF_PORT", 00:27:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:31.900 "hdgst": ${hdgst:-false}, 00:27:31.900 "ddgst": ${ddgst:-false} 00:27:31.900 }, 00:27:31.900 "method": "bdev_nvme_attach_controller" 00:27:31.900 } 00:27:31.900 EOF 00:27:31.900 )") 00:27:31.900 02:03:20 -- nvmf/common.sh@542 -- # cat 00:27:31.900 02:03:20 -- nvmf/common.sh@544 -- # jq . 00:27:31.900 02:03:20 -- nvmf/common.sh@545 -- # IFS=, 00:27:31.900 02:03:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:31.900 "params": { 00:27:31.900 "name": "Nvme1", 00:27:31.900 "trtype": "tcp", 00:27:31.900 "traddr": "10.0.0.2", 00:27:31.900 "adrfam": "ipv4", 00:27:31.900 "trsvcid": "4420", 00:27:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:31.900 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:31.900 "hdgst": false, 00:27:31.900 "ddgst": false 00:27:31.900 }, 00:27:31.900 "method": "bdev_nvme_attach_controller" 00:27:31.900 }' 00:27:31.900 [2024-11-19 02:03:20.224307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:31.900 [2024-11-19 02:03:20.224408] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3562148 ] 00:27:31.900 EAL: No free 2048 kB hugepages reported on node 1 00:27:31.900 [2024-11-19 02:03:20.285223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:31.900 [2024-11-19 02:03:20.396280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:32.158 Running I/O for 1 seconds... 00:27:33.533 00:27:33.533 Latency(us) 00:27:33.533 [2024-11-19T01:03:22.076Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:33.533 [2024-11-19T01:03:22.076Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:33.533 Verification LBA range: start 0x0 length 0x4000 00:27:33.533 Nvme1n1 : 1.01 12893.36 50.36 0.00 0.00 9885.78 1237.90 15728.64 00:27:33.533 [2024-11-19T01:03:22.076Z] =================================================================================================================== 00:27:33.533 [2024-11-19T01:03:22.077Z] Total : 12893.36 50.36 0.00 0.00 9885.78 1237.90 15728.64 00:27:33.534 02:03:21 -- host/bdevperf.sh@30 -- # bdevperfpid=3562413 00:27:33.534 02:03:21 -- host/bdevperf.sh@32 -- # sleep 3 00:27:33.534 02:03:21 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:33.534 02:03:21 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:33.534 02:03:21 -- nvmf/common.sh@520 -- # config=() 00:27:33.534 02:03:21 -- nvmf/common.sh@520 -- # local subsystem config 00:27:33.534 02:03:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:33.534 02:03:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:33.534 { 00:27:33.534 "params": { 00:27:33.534 "name": "Nvme$subsystem", 00:27:33.534 "trtype": "$TEST_TRANSPORT", 00:27:33.534 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:33.534 "adrfam": "ipv4", 00:27:33.534 "trsvcid": "$NVMF_PORT", 00:27:33.534 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:33.534 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:33.534 "hdgst": ${hdgst:-false}, 00:27:33.534 "ddgst": ${ddgst:-false} 00:27:33.534 }, 00:27:33.534 "method": "bdev_nvme_attach_controller" 00:27:33.534 } 00:27:33.534 EOF 00:27:33.534 )") 00:27:33.534 02:03:21 -- nvmf/common.sh@542 -- # cat 00:27:33.534 02:03:21 -- nvmf/common.sh@544 -- # jq . 00:27:33.534 02:03:21 -- nvmf/common.sh@545 -- # IFS=, 00:27:33.534 02:03:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:33.534 "params": { 00:27:33.534 "name": "Nvme1", 00:27:33.534 "trtype": "tcp", 00:27:33.534 "traddr": "10.0.0.2", 00:27:33.534 "adrfam": "ipv4", 00:27:33.534 "trsvcid": "4420", 00:27:33.534 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:33.534 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:33.534 "hdgst": false, 00:27:33.534 "ddgst": false 00:27:33.534 }, 00:27:33.534 "method": "bdev_nvme_attach_controller" 00:27:33.534 }' 00:27:33.534 [2024-11-19 02:03:21.997064] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:33.534 [2024-11-19 02:03:21.997146] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3562413 ] 00:27:33.534 EAL: No free 2048 kB hugepages reported on node 1 00:27:33.534 [2024-11-19 02:03:22.056161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:33.792 [2024-11-19 02:03:22.161386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:34.050 Running I/O for 15 seconds... 00:27:36.583 02:03:24 -- host/bdevperf.sh@33 -- # kill -9 3561981 00:27:36.583 02:03:24 -- host/bdevperf.sh@35 -- # sleep 3 00:27:36.583 [2024-11-19 02:03:24.972303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.583 [2024-11-19 02:03:24.972360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.583 [2024-11-19 02:03:24.972394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:9016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:8472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:8480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:8496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:8520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:8544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:8552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:9040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:9048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:9056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:9080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:9096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:8568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:8584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.972962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:8592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.972990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:8600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:8608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:8616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:8632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:9112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:9120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:8648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:8656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:8672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:8680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:8704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:8712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:8752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:9144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.584 [2024-11-19 02:03:24.973552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:9168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.584 [2024-11-19 02:03:24.973567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:9176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:9240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.973754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:9248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.973783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:9256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:9264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:9272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.973873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:9280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:9288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.973945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:9296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.973978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.973994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:9304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.974009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:9320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:9336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.974135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:8760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:8784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:8792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:8808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:8816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:8856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:8864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:9352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.974453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:9360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:9376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.974547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:9384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.585 [2024-11-19 02:03:24.974578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:9392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:8872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:8880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:8920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:8936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.585 [2024-11-19 02:03:24.974807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.585 [2024-11-19 02:03:24.974820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.974835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:8960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.974849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.974864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:8968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.974878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.974893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:9400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.974906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.974937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:9408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.974953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.974970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:9416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.974985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:9424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:9432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:9440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:9448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:9464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:9472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:9480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:9488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:9504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:8984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:8992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:9000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:9024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:9032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:9064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:9072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:9088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:9512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:9528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:9536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:9544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.975828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:9560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:9568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:9576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:9584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.975965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.975995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:9592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.976012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.976030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:9600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.586 [2024-11-19 02:03:24.976046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.586 [2024-11-19 02:03:24.976064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:9608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.586 [2024-11-19 02:03:24.976079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:9624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.587 [2024-11-19 02:03:24.976146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.587 [2024-11-19 02:03:24.976179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:9640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.587 [2024-11-19 02:03:24.976212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:9648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.587 [2024-11-19 02:03:24.976246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:9656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.587 [2024-11-19 02:03:24.976279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:36.587 [2024-11-19 02:03:24.976315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:9672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:9136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:9160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:9192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:36.587 [2024-11-19 02:03:24.976602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac0740 is same with the state(5) to be set 00:27:36.587 [2024-11-19 02:03:24.976641] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:36.587 [2024-11-19 02:03:24.976656] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:36.587 [2024-11-19 02:03:24.976669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9224 len:8 PRP1 0x0 PRP2 0x0 00:27:36.587 [2024-11-19 02:03:24.976698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976773] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xac0740 was disconnected and freed. reset controller. 00:27:36.587 [2024-11-19 02:03:24.976844] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:36.587 [2024-11-19 02:03:24.976866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:36.587 [2024-11-19 02:03:24.976900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976913] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:36.587 [2024-11-19 02:03:24.976942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:36.587 [2024-11-19 02:03:24.976972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:36.587 [2024-11-19 02:03:24.976986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.587 [2024-11-19 02:03:24.979370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.587 [2024-11-19 02:03:24.979411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.587 [2024-11-19 02:03:24.979986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:24.980139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:24.980169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.587 [2024-11-19 02:03:24.980187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.587 [2024-11-19 02:03:24.980372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.587 [2024-11-19 02:03:24.980504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.587 [2024-11-19 02:03:24.980526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.587 [2024-11-19 02:03:24.980543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.587 [2024-11-19 02:03:24.983024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.587 [2024-11-19 02:03:24.992131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.587 [2024-11-19 02:03:24.992455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:24.992597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:24.992625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.587 [2024-11-19 02:03:24.992650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.587 [2024-11-19 02:03:24.992833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.587 [2024-11-19 02:03:24.993028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.587 [2024-11-19 02:03:24.993052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.587 [2024-11-19 02:03:24.993067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.587 [2024-11-19 02:03:24.995389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.587 [2024-11-19 02:03:25.004785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.587 [2024-11-19 02:03:25.005088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:25.005221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:25.005249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.587 [2024-11-19 02:03:25.005267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.587 [2024-11-19 02:03:25.005432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.587 [2024-11-19 02:03:25.005565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.587 [2024-11-19 02:03:25.005588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.587 [2024-11-19 02:03:25.005604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.587 [2024-11-19 02:03:25.007863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.587 [2024-11-19 02:03:25.017437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.587 [2024-11-19 02:03:25.017750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:25.017892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.587 [2024-11-19 02:03:25.017920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.587 [2024-11-19 02:03:25.017938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.587 [2024-11-19 02:03:25.018103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.587 [2024-11-19 02:03:25.018290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.018313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.018329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.020489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.029935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.588 [2024-11-19 02:03:25.030232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.030348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.030376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.588 [2024-11-19 02:03:25.030393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.588 [2024-11-19 02:03:25.030595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.588 [2024-11-19 02:03:25.030738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.030763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.030778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.033372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.042628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.588 [2024-11-19 02:03:25.042964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.043109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.043138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.588 [2024-11-19 02:03:25.043156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.588 [2024-11-19 02:03:25.043339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.588 [2024-11-19 02:03:25.043490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.043513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.043529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.045986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.055150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.588 [2024-11-19 02:03:25.055467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.055579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.055607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.588 [2024-11-19 02:03:25.055625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.588 [2024-11-19 02:03:25.055855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.588 [2024-11-19 02:03:25.056042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.056065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.056080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.058383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.067766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.588 [2024-11-19 02:03:25.068058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.068214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.068243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.588 [2024-11-19 02:03:25.068261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.588 [2024-11-19 02:03:25.068444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.588 [2024-11-19 02:03:25.068613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.068646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.068664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.071204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.080211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.588 [2024-11-19 02:03:25.080571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.080706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.080736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.588 [2024-11-19 02:03:25.080759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.588 [2024-11-19 02:03:25.080908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.588 [2024-11-19 02:03:25.081076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.081099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.081115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.083477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.092668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.588 [2024-11-19 02:03:25.092968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.093208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.093272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.588 [2024-11-19 02:03:25.093289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.588 [2024-11-19 02:03:25.093437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.588 [2024-11-19 02:03:25.093605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.093628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.093654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.095960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.105118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.588 [2024-11-19 02:03:25.105439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.105592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.588 [2024-11-19 02:03:25.105620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.588 [2024-11-19 02:03:25.105646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.588 [2024-11-19 02:03:25.105814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.588 [2024-11-19 02:03:25.105966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.588 [2024-11-19 02:03:25.105989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.588 [2024-11-19 02:03:25.106004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.588 [2024-11-19 02:03:25.108182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.588 [2024-11-19 02:03:25.117790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.589 [2024-11-19 02:03:25.118193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.589 [2024-11-19 02:03:25.118419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.589 [2024-11-19 02:03:25.118477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.589 [2024-11-19 02:03:25.118494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.589 [2024-11-19 02:03:25.118657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.589 [2024-11-19 02:03:25.118827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.589 [2024-11-19 02:03:25.118851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.589 [2024-11-19 02:03:25.118866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.589 [2024-11-19 02:03:25.121246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.848 [2024-11-19 02:03:25.130100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.848 [2024-11-19 02:03:25.130480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.130651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.130689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.848 [2024-11-19 02:03:25.130705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.848 [2024-11-19 02:03:25.130854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.848 [2024-11-19 02:03:25.131047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.848 [2024-11-19 02:03:25.131067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.848 [2024-11-19 02:03:25.131079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.848 [2024-11-19 02:03:25.133369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.848 [2024-11-19 02:03:25.142786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.848 [2024-11-19 02:03:25.143147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.143401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.143493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.848 [2024-11-19 02:03:25.143511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.848 [2024-11-19 02:03:25.143686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.848 [2024-11-19 02:03:25.143857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.848 [2024-11-19 02:03:25.143878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.848 [2024-11-19 02:03:25.143891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.848 [2024-11-19 02:03:25.146296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.848 [2024-11-19 02:03:25.155271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.848 [2024-11-19 02:03:25.155554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.155724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.155751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.848 [2024-11-19 02:03:25.155767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.848 [2024-11-19 02:03:25.155916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.848 [2024-11-19 02:03:25.156122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.848 [2024-11-19 02:03:25.156146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.848 [2024-11-19 02:03:25.156162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.848 [2024-11-19 02:03:25.158579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.848 [2024-11-19 02:03:25.167792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.848 [2024-11-19 02:03:25.168221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.168447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.168498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.848 [2024-11-19 02:03:25.168515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.848 [2024-11-19 02:03:25.168697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.848 [2024-11-19 02:03:25.168903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.848 [2024-11-19 02:03:25.168927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.848 [2024-11-19 02:03:25.168943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.848 [2024-11-19 02:03:25.171357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.848 [2024-11-19 02:03:25.180599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.848 [2024-11-19 02:03:25.180980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.181217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.181264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.848 [2024-11-19 02:03:25.181282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.848 [2024-11-19 02:03:25.181465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.848 [2024-11-19 02:03:25.181714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.848 [2024-11-19 02:03:25.181737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.848 [2024-11-19 02:03:25.181751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.848 [2024-11-19 02:03:25.184174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.848 [2024-11-19 02:03:25.193079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.848 [2024-11-19 02:03:25.193368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.193545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.848 [2024-11-19 02:03:25.193573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.848 [2024-11-19 02:03:25.193590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.848 [2024-11-19 02:03:25.193758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.193911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.193953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.193967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.196239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.205784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.206185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.206316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.206344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.206361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.206490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.206685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.206707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.206721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.209071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.218484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.218762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.218853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.218878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.218894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.219019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.219187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.219210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.219226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.221511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.230885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.231267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.231453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.231481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.231499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.231675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.231844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.231867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.231889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.234242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.243577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.243851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.243991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.244036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.244052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.244226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.244418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.244443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.244459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.246871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.256251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.256547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.256671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.256701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.256719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.256885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.257072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.257095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.257111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.259538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.268771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.269140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.269313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.269358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.269376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.269541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.269703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.269727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.269743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.272242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.281323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.281621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.281771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.281800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.281818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.282002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.282206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.282230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.282245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.284585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.294047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.294364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.294464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.294492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.294509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.294668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.294820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.294843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.294858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.849 [2024-11-19 02:03:25.297141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.849 [2024-11-19 02:03:25.306471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.849 [2024-11-19 02:03:25.306770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.307134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.849 [2024-11-19 02:03:25.307167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.849 [2024-11-19 02:03:25.307185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.849 [2024-11-19 02:03:25.307352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.849 [2024-11-19 02:03:25.307504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.849 [2024-11-19 02:03:25.307527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.849 [2024-11-19 02:03:25.307542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.850 [2024-11-19 02:03:25.310032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.850 [2024-11-19 02:03:25.319178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.850 [2024-11-19 02:03:25.319527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.319645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.319674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.850 [2024-11-19 02:03:25.319691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.850 [2024-11-19 02:03:25.319875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.850 [2024-11-19 02:03:25.320062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.850 [2024-11-19 02:03:25.320085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.850 [2024-11-19 02:03:25.320100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.850 [2024-11-19 02:03:25.322348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.850 [2024-11-19 02:03:25.331703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.850 [2024-11-19 02:03:25.332050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.332214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.332239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.850 [2024-11-19 02:03:25.332255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.850 [2024-11-19 02:03:25.332434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.850 [2024-11-19 02:03:25.332619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.850 [2024-11-19 02:03:25.332651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.850 [2024-11-19 02:03:25.332668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.850 [2024-11-19 02:03:25.335129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.850 [2024-11-19 02:03:25.344298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.850 [2024-11-19 02:03:25.344607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.344749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.344778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.850 [2024-11-19 02:03:25.344795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.850 [2024-11-19 02:03:25.344925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.850 [2024-11-19 02:03:25.345111] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.850 [2024-11-19 02:03:25.345134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.850 [2024-11-19 02:03:25.345149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.850 [2024-11-19 02:03:25.347417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.850 [2024-11-19 02:03:25.356775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.850 [2024-11-19 02:03:25.357102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.357267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.357295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.850 [2024-11-19 02:03:25.357312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.850 [2024-11-19 02:03:25.357549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.850 [2024-11-19 02:03:25.357729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.850 [2024-11-19 02:03:25.357754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.850 [2024-11-19 02:03:25.357769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.850 [2024-11-19 02:03:25.360123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.850 [2024-11-19 02:03:25.369426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.850 [2024-11-19 02:03:25.369762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.369889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.369918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.850 [2024-11-19 02:03:25.369935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.850 [2024-11-19 02:03:25.370082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.850 [2024-11-19 02:03:25.370232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.850 [2024-11-19 02:03:25.370255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.850 [2024-11-19 02:03:25.370270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.850 [2024-11-19 02:03:25.372607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.850 [2024-11-19 02:03:25.381994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.850 [2024-11-19 02:03:25.382355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.382533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.850 [2024-11-19 02:03:25.382561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:36.850 [2024-11-19 02:03:25.382579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:36.850 [2024-11-19 02:03:25.382737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:36.850 [2024-11-19 02:03:25.382888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.850 [2024-11-19 02:03:25.382911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.850 [2024-11-19 02:03:25.382926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.850 [2024-11-19 02:03:25.385337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.109 [2024-11-19 02:03:25.394643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.109 [2024-11-19 02:03:25.394919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.109 [2024-11-19 02:03:25.395112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.109 [2024-11-19 02:03:25.395169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.109 [2024-11-19 02:03:25.395188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.109 [2024-11-19 02:03:25.395336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.395468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.395491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.395506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.397816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.406964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.407259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.407388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.407416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.407434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.407563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.407743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.407767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.407783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.410031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.419356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.419698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.419827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.419855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.419872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.420038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.420170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.420193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.420209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.422701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.432016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.432294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.432466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.432491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.432517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.432755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.432921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.432945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.432960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.435026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.444720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.445040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.445172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.445200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.445218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.445364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.445533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.445556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.445572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.448002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.457243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.457568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.457716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.457745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.457762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.457927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.458078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.458101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.458117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.460183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.469941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.470252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.470413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.470441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.470458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.470629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.470791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.470815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.470831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.473169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.482434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.482712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.482825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.482854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.482871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.483000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.483170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.483193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.483209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.485529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.495036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.495377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.495508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.495536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.495553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.495711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.495825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.495848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.495864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.110 [2024-11-19 02:03:25.498240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.110 [2024-11-19 02:03:25.507686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.110 [2024-11-19 02:03:25.508011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.508189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.110 [2024-11-19 02:03:25.508215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.110 [2024-11-19 02:03:25.508230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.110 [2024-11-19 02:03:25.508424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.110 [2024-11-19 02:03:25.508600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.110 [2024-11-19 02:03:25.508623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.110 [2024-11-19 02:03:25.508648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.510983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.520208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.520481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.520683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.520713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.520731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.520896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.521065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.521088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.521104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.523510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.532737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.533028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.533261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.533313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.533331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.533532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.533712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.533736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.533752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.536106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.545338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.545681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.545846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.545874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.545892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.546057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.546244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.546272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.546288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.548647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.557709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.558034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.558163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.558191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.558208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.558355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.558470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.558493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.558509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.560821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.570308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.570654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.570810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.570838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.570856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.570985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.571136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.571159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.571174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.573459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.583145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.583436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.583548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.583576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.583593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.583743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.583895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.583918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.583938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.586353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.595557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.595797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.595962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.595990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.596007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.596136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.596322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.596345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.596360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.598628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.608136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.608469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.608594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.608623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.608649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.608835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.609004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.609027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.609042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.611486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.111 [2024-11-19 02:03:25.620718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.111 [2024-11-19 02:03:25.621049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.621204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.111 [2024-11-19 02:03:25.621231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.111 [2024-11-19 02:03:25.621249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.111 [2024-11-19 02:03:25.621450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.111 [2024-11-19 02:03:25.621684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.111 [2024-11-19 02:03:25.621708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.111 [2024-11-19 02:03:25.621723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.111 [2024-11-19 02:03:25.624097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.112 [2024-11-19 02:03:25.633570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.112 [2024-11-19 02:03:25.633878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.112 [2024-11-19 02:03:25.634014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.112 [2024-11-19 02:03:25.634041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.112 [2024-11-19 02:03:25.634059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.112 [2024-11-19 02:03:25.634242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.112 [2024-11-19 02:03:25.634446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.112 [2024-11-19 02:03:25.634469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.112 [2024-11-19 02:03:25.634485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.112 [2024-11-19 02:03:25.636886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.112 [2024-11-19 02:03:25.646196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.112 [2024-11-19 02:03:25.646506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.112 [2024-11-19 02:03:25.646649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.112 [2024-11-19 02:03:25.646678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.112 [2024-11-19 02:03:25.646696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.112 [2024-11-19 02:03:25.646879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.112 [2024-11-19 02:03:25.647102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.112 [2024-11-19 02:03:25.647125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.112 [2024-11-19 02:03:25.647140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.112 [2024-11-19 02:03:25.649564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.372 [2024-11-19 02:03:25.658930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.372 [2024-11-19 02:03:25.659268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.659388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.659416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.372 [2024-11-19 02:03:25.659433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.372 [2024-11-19 02:03:25.659534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.372 [2024-11-19 02:03:25.659706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.372 [2024-11-19 02:03:25.659731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.372 [2024-11-19 02:03:25.659746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.372 [2024-11-19 02:03:25.662160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.372 [2024-11-19 02:03:25.671667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.372 [2024-11-19 02:03:25.672000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.672096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.672124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.372 [2024-11-19 02:03:25.672141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.372 [2024-11-19 02:03:25.672288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.372 [2024-11-19 02:03:25.672493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.372 [2024-11-19 02:03:25.672516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.372 [2024-11-19 02:03:25.672531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.372 [2024-11-19 02:03:25.675067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.372 [2024-11-19 02:03:25.684404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.372 [2024-11-19 02:03:25.684720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.684831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.684859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.372 [2024-11-19 02:03:25.684877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.372 [2024-11-19 02:03:25.685061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.372 [2024-11-19 02:03:25.685265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.372 [2024-11-19 02:03:25.685288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.372 [2024-11-19 02:03:25.685304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.372 [2024-11-19 02:03:25.687552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.372 [2024-11-19 02:03:25.697087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.372 [2024-11-19 02:03:25.697412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.697566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.697594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.372 [2024-11-19 02:03:25.697612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.372 [2024-11-19 02:03:25.697770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.372 [2024-11-19 02:03:25.697975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.372 [2024-11-19 02:03:25.697998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.372 [2024-11-19 02:03:25.698014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.372 [2024-11-19 02:03:25.700442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.372 [2024-11-19 02:03:25.709755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.372 [2024-11-19 02:03:25.710067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.710253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.372 [2024-11-19 02:03:25.710282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.372 [2024-11-19 02:03:25.710299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.372 [2024-11-19 02:03:25.710518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.372 [2024-11-19 02:03:25.710680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.372 [2024-11-19 02:03:25.710704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.372 [2024-11-19 02:03:25.710721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.712950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.722439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.722779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.722891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.722919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.722936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.723119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.723270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.723293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.723309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.725693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.735084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.735348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.735478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.735506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.735523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.735735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.735851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.735873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.735889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.738352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.747721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.748057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.748218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.748248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.748271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.748473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.748623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.748657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.748674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.750957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.760424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.760763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.760893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.760921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.760938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.761103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.761254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.761278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.761293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.763563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.773230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.773573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.773688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.773717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.773734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.773917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.774068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.774091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.774106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.776425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.785856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.786218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.786341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.786369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.786386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.786557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.786737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.786761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.786777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.789060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.798453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.798793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.798929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.798957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.798975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.799121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.799291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.799314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.799330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.801560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.811064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.811430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.811553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.811582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.811599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.811774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.373 [2024-11-19 02:03:25.811980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.373 [2024-11-19 02:03:25.812003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.373 [2024-11-19 02:03:25.812018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.373 [2024-11-19 02:03:25.814427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.373 [2024-11-19 02:03:25.823356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.373 [2024-11-19 02:03:25.823687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.823839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.373 [2024-11-19 02:03:25.823864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.373 [2024-11-19 02:03:25.823880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.373 [2024-11-19 02:03:25.824043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.824253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.824277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.824292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.826541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.374 [2024-11-19 02:03:25.835879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.374 [2024-11-19 02:03:25.836159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.836292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.836320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.374 [2024-11-19 02:03:25.836337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.374 [2024-11-19 02:03:25.836484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.836682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.836707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.836722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.839096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.374 [2024-11-19 02:03:25.848433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.374 [2024-11-19 02:03:25.848740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.848867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.848895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.374 [2024-11-19 02:03:25.848913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.374 [2024-11-19 02:03:25.849132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.849337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.849360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.849375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.851648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.374 [2024-11-19 02:03:25.860906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.374 [2024-11-19 02:03:25.861258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.861365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.861392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.374 [2024-11-19 02:03:25.861409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.374 [2024-11-19 02:03:25.861592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.861771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.861801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.861817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.864120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.374 [2024-11-19 02:03:25.873479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.374 [2024-11-19 02:03:25.873764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.873878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.873906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.374 [2024-11-19 02:03:25.873923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.374 [2024-11-19 02:03:25.874106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.874311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.874334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.874349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.876417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.374 [2024-11-19 02:03:25.886019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.374 [2024-11-19 02:03:25.886347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.886478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.886506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.374 [2024-11-19 02:03:25.886523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.374 [2024-11-19 02:03:25.886678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.886865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.886888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.886904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.889042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.374 [2024-11-19 02:03:25.898679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.374 [2024-11-19 02:03:25.899017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.899150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.899178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.374 [2024-11-19 02:03:25.899195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.374 [2024-11-19 02:03:25.899361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.899530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.899552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.899573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.902103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.374 [2024-11-19 02:03:25.911356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.374 [2024-11-19 02:03:25.911615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.911805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.374 [2024-11-19 02:03:25.911836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.374 [2024-11-19 02:03:25.911854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.374 [2024-11-19 02:03:25.912001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.374 [2024-11-19 02:03:25.912188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.374 [2024-11-19 02:03:25.912211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.374 [2024-11-19 02:03:25.912226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.374 [2024-11-19 02:03:25.914769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:25.923933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:25.924234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.924392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.924421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:25.924438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:25.924622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:25.924804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:25.924828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.634 [2024-11-19 02:03:25.924843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.634 [2024-11-19 02:03:25.927220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:25.936561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:25.936893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.937049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.937077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:25.937095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:25.937241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:25.937392] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:25.937416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.634 [2024-11-19 02:03:25.937431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.634 [2024-11-19 02:03:25.939778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:25.949193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:25.949578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.949750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.949791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:25.949809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:25.949992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:25.950142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:25.950166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.634 [2024-11-19 02:03:25.950181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.634 [2024-11-19 02:03:25.952504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:25.961800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:25.962226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.962359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.962387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:25.962404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:25.962570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:25.962750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:25.962774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.634 [2024-11-19 02:03:25.962790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.634 [2024-11-19 02:03:25.964947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:25.974480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:25.974784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.974911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.974939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:25.974956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:25.975085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:25.975235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:25.975258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.634 [2024-11-19 02:03:25.975274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.634 [2024-11-19 02:03:25.977751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:25.987157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:25.987459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.987612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:25.987645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:25.987663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:25.987812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:25.987979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:25.988014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.634 [2024-11-19 02:03:25.988027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.634 [2024-11-19 02:03:25.990212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:25.999720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:25.999967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:26.000124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:26.000153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:26.000171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:26.000336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:26.000469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:26.000492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.634 [2024-11-19 02:03:26.000508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.634 [2024-11-19 02:03:26.002857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.634 [2024-11-19 02:03:26.012256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.634 [2024-11-19 02:03:26.012570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:26.012704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.634 [2024-11-19 02:03:26.012733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.634 [2024-11-19 02:03:26.012750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.634 [2024-11-19 02:03:26.012897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.634 [2024-11-19 02:03:26.013049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.634 [2024-11-19 02:03:26.013072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.013088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.015460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.024742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.025068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.025296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.025325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.025342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.025562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.025724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.025748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.025764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.028047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.037381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.037718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.037904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.037930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.037945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.038089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.038272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.038296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.038311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.040662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.049897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.050240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.050394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.050423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.050440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.050588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.050803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.050828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.050844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.053254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.062361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.062713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.062877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.062911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.062929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.063076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.063227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.063250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.063265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.065588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.074835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.075164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.075403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.075459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.075477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.075587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.075767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.075792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.075808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.078037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.087454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.087777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.088029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.088088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.088106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.088271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.088422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.088445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.088460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.090807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.100051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.100376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.100506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.100534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.100557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.100752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.100958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.100981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.100997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.103336] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.112542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.112855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.113031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.113056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.113072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.113218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.113406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.113429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.113445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.115773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.125104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.125401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.125560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.635 [2024-11-19 02:03:26.125588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.635 [2024-11-19 02:03:26.125605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.635 [2024-11-19 02:03:26.125764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.635 [2024-11-19 02:03:26.125898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.635 [2024-11-19 02:03:26.125921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.635 [2024-11-19 02:03:26.125936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.635 [2024-11-19 02:03:26.128219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.635 [2024-11-19 02:03:26.137537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.635 [2024-11-19 02:03:26.137841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.137988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.138033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.636 [2024-11-19 02:03:26.138051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.636 [2024-11-19 02:03:26.138222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.636 [2024-11-19 02:03:26.138390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.636 [2024-11-19 02:03:26.138413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.636 [2024-11-19 02:03:26.138428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.636 [2024-11-19 02:03:26.140938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.636 [2024-11-19 02:03:26.150044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.636 [2024-11-19 02:03:26.150350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.150529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.150554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.636 [2024-11-19 02:03:26.150585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.636 [2024-11-19 02:03:26.150827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.636 [2024-11-19 02:03:26.150977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.636 [2024-11-19 02:03:26.151001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.636 [2024-11-19 02:03:26.151016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.636 [2024-11-19 02:03:26.153408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.636 [2024-11-19 02:03:26.162908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.636 [2024-11-19 02:03:26.163224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.163327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.163370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.636 [2024-11-19 02:03:26.163385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.636 [2024-11-19 02:03:26.163516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.636 [2024-11-19 02:03:26.163732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.636 [2024-11-19 02:03:26.163757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.636 [2024-11-19 02:03:26.163773] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.636 [2024-11-19 02:03:26.166044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.636 [2024-11-19 02:03:26.175307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.636 [2024-11-19 02:03:26.175645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.175794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.636 [2024-11-19 02:03:26.175822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.636 [2024-11-19 02:03:26.175839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.636 [2024-11-19 02:03:26.175996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.636 [2024-11-19 02:03:26.176136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.636 [2024-11-19 02:03:26.176159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.636 [2024-11-19 02:03:26.176175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.636 [2024-11-19 02:03:26.178558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.895 [2024-11-19 02:03:26.187849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.895 [2024-11-19 02:03:26.188178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.188285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.188314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.895 [2024-11-19 02:03:26.188331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.895 [2024-11-19 02:03:26.188497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.895 [2024-11-19 02:03:26.188660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.895 [2024-11-19 02:03:26.188684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.895 [2024-11-19 02:03:26.188699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.895 [2024-11-19 02:03:26.191018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.895 [2024-11-19 02:03:26.200552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.895 [2024-11-19 02:03:26.200837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.200938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.200966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.895 [2024-11-19 02:03:26.200984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.895 [2024-11-19 02:03:26.201112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.895 [2024-11-19 02:03:26.201263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.895 [2024-11-19 02:03:26.201286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.895 [2024-11-19 02:03:26.201302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.895 [2024-11-19 02:03:26.203391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.895 [2024-11-19 02:03:26.213137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.895 [2024-11-19 02:03:26.213394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.213538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.213567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.895 [2024-11-19 02:03:26.213584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.895 [2024-11-19 02:03:26.213754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.895 [2024-11-19 02:03:26.213941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.895 [2024-11-19 02:03:26.213971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.895 [2024-11-19 02:03:26.213987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.895 [2024-11-19 02:03:26.216334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.895 [2024-11-19 02:03:26.226008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.895 [2024-11-19 02:03:26.226346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.226508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.226536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.895 [2024-11-19 02:03:26.226554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.895 [2024-11-19 02:03:26.226758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.895 [2024-11-19 02:03:26.226944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.895 [2024-11-19 02:03:26.226969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.895 [2024-11-19 02:03:26.226984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.895 [2024-11-19 02:03:26.229262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.895 [2024-11-19 02:03:26.238350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.895 [2024-11-19 02:03:26.238618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.238773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.895 [2024-11-19 02:03:26.238802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.895 [2024-11-19 02:03:26.238819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.895 [2024-11-19 02:03:26.239020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.895 [2024-11-19 02:03:26.239172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.895 [2024-11-19 02:03:26.239195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.895 [2024-11-19 02:03:26.239210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.895 [2024-11-19 02:03:26.241598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.895 [2024-11-19 02:03:26.251089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.895 [2024-11-19 02:03:26.251369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.251584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.251610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.251626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.251770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.251934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.251954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.251987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.254540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.263748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.264053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.264209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.264237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.264254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.264437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.264625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.264658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.264675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.267128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.276111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.276424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.276555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.276583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.276600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.276756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.276908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.276931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.276947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.279399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.288699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.289037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.289166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.289193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.289211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.289395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.289563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.289586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.289601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.291922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.301343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.301727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.301888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.301916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.301934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.302064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.302233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.302257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.302273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.304844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.313940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.314286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.314396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.314425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.314442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.314625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.314844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.314869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.314884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.317242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.326569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.326892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.327026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.327054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.327071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.327273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.327442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.327466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.327481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.329707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.339247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.339615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.339758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.339786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.339804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.339970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.340102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.340125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.340141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.342466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.351838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.352167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.352275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.352305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.896 [2024-11-19 02:03:26.352322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.896 [2024-11-19 02:03:26.352505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.896 [2024-11-19 02:03:26.352685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.896 [2024-11-19 02:03:26.352709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.896 [2024-11-19 02:03:26.352725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.896 [2024-11-19 02:03:26.355139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.896 [2024-11-19 02:03:26.364360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.896 [2024-11-19 02:03:26.364643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.364782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.896 [2024-11-19 02:03:26.364810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.897 [2024-11-19 02:03:26.364827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.897 [2024-11-19 02:03:26.364974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.897 [2024-11-19 02:03:26.365161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.897 [2024-11-19 02:03:26.365184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.897 [2024-11-19 02:03:26.365200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.897 [2024-11-19 02:03:26.367503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.897 [2024-11-19 02:03:26.376970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.897 [2024-11-19 02:03:26.377287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.377386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.377414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.897 [2024-11-19 02:03:26.377432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.897 [2024-11-19 02:03:26.377544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.897 [2024-11-19 02:03:26.377704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.897 [2024-11-19 02:03:26.377728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.897 [2024-11-19 02:03:26.377744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.897 [2024-11-19 02:03:26.380193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.897 [2024-11-19 02:03:26.389498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.897 [2024-11-19 02:03:26.389815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.390015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.390069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.897 [2024-11-19 02:03:26.390086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.897 [2024-11-19 02:03:26.390305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.897 [2024-11-19 02:03:26.390510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.897 [2024-11-19 02:03:26.390533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.897 [2024-11-19 02:03:26.390548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.897 [2024-11-19 02:03:26.392683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.897 [2024-11-19 02:03:26.402069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.897 [2024-11-19 02:03:26.402355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.402493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.402521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.897 [2024-11-19 02:03:26.402539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.897 [2024-11-19 02:03:26.402680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.897 [2024-11-19 02:03:26.402832] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.897 [2024-11-19 02:03:26.402856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.897 [2024-11-19 02:03:26.402872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.897 [2024-11-19 02:03:26.405252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.897 [2024-11-19 02:03:26.414617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.897 [2024-11-19 02:03:26.414995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.415139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.415164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.897 [2024-11-19 02:03:26.415185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.897 [2024-11-19 02:03:26.415302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.897 [2024-11-19 02:03:26.415444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.897 [2024-11-19 02:03:26.415468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.897 [2024-11-19 02:03:26.415483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.897 [2024-11-19 02:03:26.417740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.897 [2024-11-19 02:03:26.427097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.897 [2024-11-19 02:03:26.427386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.427499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.427527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.897 [2024-11-19 02:03:26.427544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.897 [2024-11-19 02:03:26.427737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:37.897 [2024-11-19 02:03:26.427889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.897 [2024-11-19 02:03:26.427912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.897 [2024-11-19 02:03:26.427927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.897 [2024-11-19 02:03:26.430268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.897 [2024-11-19 02:03:26.439763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.897 [2024-11-19 02:03:26.440114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.440267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.897 [2024-11-19 02:03:26.440321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:37.897 [2024-11-19 02:03:26.440338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:37.897 [2024-11-19 02:03:26.440504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.156 [2024-11-19 02:03:26.440687] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.156 [2024-11-19 02:03:26.440711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.156 [2024-11-19 02:03:26.440727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.156 [2024-11-19 02:03:26.443173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.156 [2024-11-19 02:03:26.452373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.156 [2024-11-19 02:03:26.452670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.156 [2024-11-19 02:03:26.452868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.156 [2024-11-19 02:03:26.452919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.156 [2024-11-19 02:03:26.452937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.156 [2024-11-19 02:03:26.453127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.156 [2024-11-19 02:03:26.453296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.156 [2024-11-19 02:03:26.453319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.156 [2024-11-19 02:03:26.453334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.156 [2024-11-19 02:03:26.455524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.464954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.465212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.465379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.465407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.465425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.465626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.465806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.465830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.465845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.468073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.477651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.478021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.478121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.478146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.478162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.478340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.478509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.478532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.478548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.481007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.490228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.490565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.490704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.490735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.490754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.490919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.491113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.491136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.491151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.493474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.502943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.503303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.503396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.503424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.503441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.503606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.503821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.503856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.503872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.506179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.515621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.515974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.516107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.516136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.516153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.516318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.516469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.516492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.516508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.518594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.528254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.528609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.528774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.528803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.528820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.528968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.529190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.529219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.529235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.531577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.540655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.540978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.541134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.541162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.541178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.541415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.541530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.541553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.541569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.543810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.553369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.553696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.553794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.553822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.553840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.554041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.554246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.554269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.554285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.556688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.566129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.566428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.566573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.566598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.157 [2024-11-19 02:03:26.566614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.157 [2024-11-19 02:03:26.566772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.157 [2024-11-19 02:03:26.566931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.157 [2024-11-19 02:03:26.566955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.157 [2024-11-19 02:03:26.566976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.157 [2024-11-19 02:03:26.569622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.157 [2024-11-19 02:03:26.578671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.157 [2024-11-19 02:03:26.578944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.579116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.157 [2024-11-19 02:03:26.579141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.579156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.579296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.579484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.579508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.579523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.581926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.591471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.591798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.591932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.591962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.591979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.592144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.592367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.592391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.592406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.594532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.604113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.604347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.604474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.604502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.604519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.604699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.604868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.604892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.604907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.607255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.616665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.616968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.617102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.617130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.617147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.617312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.617499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.617522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.617537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.619974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.629223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.629536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.629672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.629703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.629720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.629903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.630090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.630113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.630129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.632376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.641903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.642211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.642366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.642394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.642411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.642594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.642774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.642798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.642813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.645170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.654166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.654486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.654654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.654680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.654696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.654844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.655032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.655056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.655070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.657389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.666846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.667176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.667332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.667360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.667377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.667506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.667602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.667625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.667652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.670066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.679436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.679694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.679926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.679988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.680005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.680135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.680339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.158 [2024-11-19 02:03:26.680363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.158 [2024-11-19 02:03:26.680378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.158 [2024-11-19 02:03:26.682441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.158 [2024-11-19 02:03:26.692016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.158 [2024-11-19 02:03:26.692333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.692466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.158 [2024-11-19 02:03:26.692495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.158 [2024-11-19 02:03:26.692512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.158 [2024-11-19 02:03:26.692672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.158 [2024-11-19 02:03:26.692843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.159 [2024-11-19 02:03:26.692866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.159 [2024-11-19 02:03:26.692881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.159 [2024-11-19 02:03:26.695146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.418 [2024-11-19 02:03:26.704606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.418 [2024-11-19 02:03:26.705059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.705289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.705352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.418 [2024-11-19 02:03:26.705369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.418 [2024-11-19 02:03:26.705499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.418 [2024-11-19 02:03:26.705716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.418 [2024-11-19 02:03:26.705741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.418 [2024-11-19 02:03:26.705757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.418 [2024-11-19 02:03:26.708098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.418 [2024-11-19 02:03:26.717176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.418 [2024-11-19 02:03:26.717453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.717590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.717618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.418 [2024-11-19 02:03:26.717646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.418 [2024-11-19 02:03:26.717778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.418 [2024-11-19 02:03:26.717983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.418 [2024-11-19 02:03:26.718006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.418 [2024-11-19 02:03:26.718021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.418 [2024-11-19 02:03:26.720271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.418 [2024-11-19 02:03:26.729697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.418 [2024-11-19 02:03:26.729967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.730101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.730134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.418 [2024-11-19 02:03:26.730152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.418 [2024-11-19 02:03:26.730318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.418 [2024-11-19 02:03:26.730505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.418 [2024-11-19 02:03:26.730528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.418 [2024-11-19 02:03:26.730543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.418 [2024-11-19 02:03:26.732984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.418 [2024-11-19 02:03:26.742220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.418 [2024-11-19 02:03:26.742469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.742657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.742683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.418 [2024-11-19 02:03:26.742699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.418 [2024-11-19 02:03:26.742832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.418 [2024-11-19 02:03:26.742983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.418 [2024-11-19 02:03:26.743018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.418 [2024-11-19 02:03:26.743032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.418 [2024-11-19 02:03:26.745487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.418 [2024-11-19 02:03:26.754946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.418 [2024-11-19 02:03:26.755273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.755409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.755438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.418 [2024-11-19 02:03:26.755455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.418 [2024-11-19 02:03:26.755620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.418 [2024-11-19 02:03:26.755821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.418 [2024-11-19 02:03:26.755845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.418 [2024-11-19 02:03:26.755860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.418 [2024-11-19 02:03:26.758127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.418 [2024-11-19 02:03:26.767467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.418 [2024-11-19 02:03:26.767769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.767884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.767911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.418 [2024-11-19 02:03:26.767934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.418 [2024-11-19 02:03:26.768082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.418 [2024-11-19 02:03:26.768251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.418 [2024-11-19 02:03:26.768273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.418 [2024-11-19 02:03:26.768289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.418 [2024-11-19 02:03:26.770750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.418 [2024-11-19 02:03:26.779809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.418 [2024-11-19 02:03:26.780087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.780221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.418 [2024-11-19 02:03:26.780248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.418 [2024-11-19 02:03:26.780266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.780449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.780599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.780622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.780648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.783119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.792249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.792534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.792672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.792700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.792718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.792918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.793087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.793111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.793127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.795377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.804755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.805074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.805246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.805271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.805286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.805456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.805608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.805633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.805661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.808092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.817255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.817605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.817752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.817781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.817798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.817964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.818097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.818120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.818135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.820457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.829792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.830128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.830321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.830367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.830384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.830531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.830749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.830774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.830789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.833234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.842142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.842448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.842624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.842659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.842675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.842808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.843023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.843048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.843063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.845258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.854629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.854973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.855173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.855233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.855251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.855398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.855567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.855590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.855605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.858116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.867205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.867491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.867665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.867694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.867712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.867894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.868100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.868123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.868138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.870751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.879762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.880092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.880213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.880239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.880254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.880436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.880614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.419 [2024-11-19 02:03:26.880654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.419 [2024-11-19 02:03:26.880672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.419 [2024-11-19 02:03:26.882948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.419 [2024-11-19 02:03:26.892375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.419 [2024-11-19 02:03:26.892659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.892815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.419 [2024-11-19 02:03:26.892840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.419 [2024-11-19 02:03:26.892856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.419 [2024-11-19 02:03:26.892995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.419 [2024-11-19 02:03:26.893110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.420 [2024-11-19 02:03:26.893133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.420 [2024-11-19 02:03:26.893148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.420 [2024-11-19 02:03:26.895489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.420 [2024-11-19 02:03:26.904913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.420 [2024-11-19 02:03:26.905285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.905399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.905427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.420 [2024-11-19 02:03:26.905444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.420 [2024-11-19 02:03:26.905609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.420 [2024-11-19 02:03:26.905815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.420 [2024-11-19 02:03:26.905838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.420 [2024-11-19 02:03:26.905852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.420 [2024-11-19 02:03:26.908245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.420 [2024-11-19 02:03:26.917586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.420 [2024-11-19 02:03:26.917862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.917996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.918024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.420 [2024-11-19 02:03:26.918041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.420 [2024-11-19 02:03:26.918206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.420 [2024-11-19 02:03:26.918410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.420 [2024-11-19 02:03:26.918434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.420 [2024-11-19 02:03:26.918456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.420 [2024-11-19 02:03:26.920904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.420 [2024-11-19 02:03:26.930181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.420 [2024-11-19 02:03:26.930478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.930611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.930649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.420 [2024-11-19 02:03:26.930669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.420 [2024-11-19 02:03:26.930834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.420 [2024-11-19 02:03:26.931021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.420 [2024-11-19 02:03:26.931044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.420 [2024-11-19 02:03:26.931060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.420 [2024-11-19 02:03:26.933452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.420 [2024-11-19 02:03:26.942793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.420 [2024-11-19 02:03:26.943069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.943177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.943203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.420 [2024-11-19 02:03:26.943219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.420 [2024-11-19 02:03:26.943389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.420 [2024-11-19 02:03:26.943529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.420 [2024-11-19 02:03:26.943551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.420 [2024-11-19 02:03:26.943565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.420 [2024-11-19 02:03:26.945865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.420 [2024-11-19 02:03:26.955336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.420 [2024-11-19 02:03:26.955610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.955719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.420 [2024-11-19 02:03:26.955745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.420 [2024-11-19 02:03:26.955761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.420 [2024-11-19 02:03:26.955893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.420 [2024-11-19 02:03:26.956058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.420 [2024-11-19 02:03:26.956078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.420 [2024-11-19 02:03:26.956091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.420 [2024-11-19 02:03:26.958080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.680 [2024-11-19 02:03:26.967457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.680 [2024-11-19 02:03:26.967741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:26.967905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:26.967935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.680 [2024-11-19 02:03:26.967952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.680 [2024-11-19 02:03:26.968138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.680 [2024-11-19 02:03:26.968303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.680 [2024-11-19 02:03:26.968337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.680 [2024-11-19 02:03:26.968350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.680 [2024-11-19 02:03:26.970397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.680 [2024-11-19 02:03:26.979600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.680 [2024-11-19 02:03:26.979965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:26.980110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:26.980136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.680 [2024-11-19 02:03:26.980152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.680 [2024-11-19 02:03:26.980299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.680 [2024-11-19 02:03:26.980473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.680 [2024-11-19 02:03:26.980492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.680 [2024-11-19 02:03:26.980505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.680 [2024-11-19 02:03:26.982472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.680 [2024-11-19 02:03:26.991585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.680 [2024-11-19 02:03:26.991835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:26.991974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:26.992000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.680 [2024-11-19 02:03:26.992015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.680 [2024-11-19 02:03:26.992210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.680 [2024-11-19 02:03:26.992381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.680 [2024-11-19 02:03:26.992401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.680 [2024-11-19 02:03:26.992413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.680 [2024-11-19 02:03:26.994781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.680 [2024-11-19 02:03:27.003863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.680 [2024-11-19 02:03:27.004209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:27.004323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.680 [2024-11-19 02:03:27.004349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.680 [2024-11-19 02:03:27.004364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.680 [2024-11-19 02:03:27.004464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.680 [2024-11-19 02:03:27.004629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.004656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.004685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.006805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.016084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.016446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.016597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.016622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.016644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.016811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.017002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.017022] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.017034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.018997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.028216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.028577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.028681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.028707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.028722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.028871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.029060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.029080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.029093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.031171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.040434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.040721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.040830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.040855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.040871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.041003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.041152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.041171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.041184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.043271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.052698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.053005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.053132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.053157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.053173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.053369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.053538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.053558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.053571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.055630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.064875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.065212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.065318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.065343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.065358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.065506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.065721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.065743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.065757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.067646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.077217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.077530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.077650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.077677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.077697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.077831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.077980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.078015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.078028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.079944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.089396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.089726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.089863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.089889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.089904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.090068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.090259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.090279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.090292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.092276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.101429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.101750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.101856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.101881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.101897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.102045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.102237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.102257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.102270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.104179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.681 [2024-11-19 02:03:27.113793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.681 [2024-11-19 02:03:27.114128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.114219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.681 [2024-11-19 02:03:27.114243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.681 [2024-11-19 02:03:27.114258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.681 [2024-11-19 02:03:27.114423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.681 [2024-11-19 02:03:27.114548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.681 [2024-11-19 02:03:27.114567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.681 [2024-11-19 02:03:27.114579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.681 [2024-11-19 02:03:27.116335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.125893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.126189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.126314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.126339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.126355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.126519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.126704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.126725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.126739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.128552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.138061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.138443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.138564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.138590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.138605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.138764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.138981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.139016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.139029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.140905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.150549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.150910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.151043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.151069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.151084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.151199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.151397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.151417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.151429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.153413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.162771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.163142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.163267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.163292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.163308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.163473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.163630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.163660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.163674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.165797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.174819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.175215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.175311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.175340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.175355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.175535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.175752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.175773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.175787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.177768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.187051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.187381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.187505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.187530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.187545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.187687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.187865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.187893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.187907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.189864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.199209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.199505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.199630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.199663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.199679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.199828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.199966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.200000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.200013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.201915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.211291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.211604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.211763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.211790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.211806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.211970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.212158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.212177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.212191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.682 [2024-11-19 02:03:27.214204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.682 [2024-11-19 02:03:27.223693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.682 [2024-11-19 02:03:27.224046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.224186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.682 [2024-11-19 02:03:27.224212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.682 [2024-11-19 02:03:27.224229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.682 [2024-11-19 02:03:27.224409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.682 [2024-11-19 02:03:27.224575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.682 [2024-11-19 02:03:27.224594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.682 [2024-11-19 02:03:27.224627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.942 [2024-11-19 02:03:27.226725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.942 [2024-11-19 02:03:27.235970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.942 [2024-11-19 02:03:27.236353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.942 [2024-11-19 02:03:27.236526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.942 [2024-11-19 02:03:27.236552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.942 [2024-11-19 02:03:27.236568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.942 [2024-11-19 02:03:27.236773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.942 [2024-11-19 02:03:27.236938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.942 [2024-11-19 02:03:27.236958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.942 [2024-11-19 02:03:27.236971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.942 [2024-11-19 02:03:27.239078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.942 [2024-11-19 02:03:27.248022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.942 [2024-11-19 02:03:27.248341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.942 [2024-11-19 02:03:27.248466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.942 [2024-11-19 02:03:27.248491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.942 [2024-11-19 02:03:27.248507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.942 [2024-11-19 02:03:27.248681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.942 [2024-11-19 02:03:27.248849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.942 [2024-11-19 02:03:27.248870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.942 [2024-11-19 02:03:27.248884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.942 [2024-11-19 02:03:27.251047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.942 [2024-11-19 02:03:27.260332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.942 [2024-11-19 02:03:27.260652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.942 [2024-11-19 02:03:27.260773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.942 [2024-11-19 02:03:27.260799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.942 [2024-11-19 02:03:27.260815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.942 [2024-11-19 02:03:27.260980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.942 [2024-11-19 02:03:27.261152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.261171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.261184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.263095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.272484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.272765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.272904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.272929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.272945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.273093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.273299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.273318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.273331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.275289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.284842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.285252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.285403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.285428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.285443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.285608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.285786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.285808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.285822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.287790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.296910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.297276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.297398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.297423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.297438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.297586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.297743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.297764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.297778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.299784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.309038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.309337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.309457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.309482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.309498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.309629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.309806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.309826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.309840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.311832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.321252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.321509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.321649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.321675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.321691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.321808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.322033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.322053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.322065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.323997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.333572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.333847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.333969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.333994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.334010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.334188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.334346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.334365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.334378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.336321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.345550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.345893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.346016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.346042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.346058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.346206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.346394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.346414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.346427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.348311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.357789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.358165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.358295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.358320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.358336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.358485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.358731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.358754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.358768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.360881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.943 [2024-11-19 02:03:27.369765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.943 [2024-11-19 02:03:27.370146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.370245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.943 [2024-11-19 02:03:27.370270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.943 [2024-11-19 02:03:27.370285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.943 [2024-11-19 02:03:27.370466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.943 [2024-11-19 02:03:27.370696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.943 [2024-11-19 02:03:27.370719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.943 [2024-11-19 02:03:27.370733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.943 [2024-11-19 02:03:27.373013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.382084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.382489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.382580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.382610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.382626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.382799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.383038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.383058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.383070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.385013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.394245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.394646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.394731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.394755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.394770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.394903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.395082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.395101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.395114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.396830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.406407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.406615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.406778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.406803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.406819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.406935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.407126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.407145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.407158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.409275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.418634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.418939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.419040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.419065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.419093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.419273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.419414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.419433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.419445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.421366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.430792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.431167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.431292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.431318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.431334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.431510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.431711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.431732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.431745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.433716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.442917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.443319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.443471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.443496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.443512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.443667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.443858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.443878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.443891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.446097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.455120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.455423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.455554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.455579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.455595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.455805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.455964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.455984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.455997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.457949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.467462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.467747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.467871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.467897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.467913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.468046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.468214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.468235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.468247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.470167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.944 [2024-11-19 02:03:27.480002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.944 [2024-11-19 02:03:27.480294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.480422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.944 [2024-11-19 02:03:27.480447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:38.944 [2024-11-19 02:03:27.480463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:38.944 [2024-11-19 02:03:27.480632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:38.944 [2024-11-19 02:03:27.480808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.944 [2024-11-19 02:03:27.480830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.944 [2024-11-19 02:03:27.480844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.944 [2024-11-19 02:03:27.482891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.204 [2024-11-19 02:03:27.492451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.204 [2024-11-19 02:03:27.492799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.492928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.492958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.204 [2024-11-19 02:03:27.492975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.204 [2024-11-19 02:03:27.493093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.204 [2024-11-19 02:03:27.493252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.204 [2024-11-19 02:03:27.493275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.204 [2024-11-19 02:03:27.493289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.204 [2024-11-19 02:03:27.495514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.204 [2024-11-19 02:03:27.504674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.204 [2024-11-19 02:03:27.504991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.505087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.505113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.204 [2024-11-19 02:03:27.505129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.204 [2024-11-19 02:03:27.505261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.204 [2024-11-19 02:03:27.505381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.204 [2024-11-19 02:03:27.505402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.204 [2024-11-19 02:03:27.505416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.204 [2024-11-19 02:03:27.507538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.204 [2024-11-19 02:03:27.516922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.204 [2024-11-19 02:03:27.517256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.517350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.517375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.204 [2024-11-19 02:03:27.517391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.204 [2024-11-19 02:03:27.517523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.204 [2024-11-19 02:03:27.517700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.204 [2024-11-19 02:03:27.517722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.204 [2024-11-19 02:03:27.517736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.204 [2024-11-19 02:03:27.519894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.204 [2024-11-19 02:03:27.529117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.204 [2024-11-19 02:03:27.529387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.529481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.529518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.204 [2024-11-19 02:03:27.529533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.204 [2024-11-19 02:03:27.529694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.204 [2024-11-19 02:03:27.529858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.204 [2024-11-19 02:03:27.529884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.204 [2024-11-19 02:03:27.529899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.204 [2024-11-19 02:03:27.531875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.204 [2024-11-19 02:03:27.541350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.204 [2024-11-19 02:03:27.541681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.541787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.541812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.204 [2024-11-19 02:03:27.541828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.204 [2024-11-19 02:03:27.541961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.204 [2024-11-19 02:03:27.542126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.204 [2024-11-19 02:03:27.542145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.204 [2024-11-19 02:03:27.542158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.204 [2024-11-19 02:03:27.544139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.204 [2024-11-19 02:03:27.553491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.204 [2024-11-19 02:03:27.553774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.553937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.204 [2024-11-19 02:03:27.553963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.204 [2024-11-19 02:03:27.553979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.204 [2024-11-19 02:03:27.554126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.204 [2024-11-19 02:03:27.554329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.204 [2024-11-19 02:03:27.554349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.204 [2024-11-19 02:03:27.554362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.204 [2024-11-19 02:03:27.556246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.204 [2024-11-19 02:03:27.565782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.204 [2024-11-19 02:03:27.566083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.566208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.566233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.566249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.566398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.566549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.566569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.566586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.568586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.577867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.578162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.578258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.578283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.578299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.578431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.578608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.578629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.578666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.580635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.590013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.590320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.590443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.590469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.590484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.590616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.590776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.590798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.590812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.592809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.602344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.602675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.602783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.602810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.602826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.602957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.603145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.603165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.603178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.605235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.614473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.614789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.614881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.614906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.614921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.615037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.615188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.615222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.615234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.617290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.626532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.626867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.627020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.627046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.627061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.627210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.627381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.627400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.627413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.629460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.638886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.639122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.639258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.639284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.639299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.639491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.639632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.639661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.639675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.641719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.651024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.651346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.651450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.651476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.651491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.651665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.651830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.651851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.651864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.653821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.663163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.663584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.663674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.663699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.663715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.205 [2024-11-19 02:03:27.663863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.205 [2024-11-19 02:03:27.664010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.205 [2024-11-19 02:03:27.664030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.205 [2024-11-19 02:03:27.664042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.205 [2024-11-19 02:03:27.665755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.205 [2024-11-19 02:03:27.675253] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.205 [2024-11-19 02:03:27.675568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.675720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.205 [2024-11-19 02:03:27.675746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.205 [2024-11-19 02:03:27.675762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.206 [2024-11-19 02:03:27.675894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.206 [2024-11-19 02:03:27.676054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.206 [2024-11-19 02:03:27.676074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.206 [2024-11-19 02:03:27.676086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.206 [2024-11-19 02:03:27.678090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.206 [2024-11-19 02:03:27.687401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.206 [2024-11-19 02:03:27.687723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.687850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.687876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.206 [2024-11-19 02:03:27.687892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.206 [2024-11-19 02:03:27.688025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.206 [2024-11-19 02:03:27.688198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.206 [2024-11-19 02:03:27.688217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.206 [2024-11-19 02:03:27.688230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.206 [2024-11-19 02:03:27.690299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.206 [2024-11-19 02:03:27.699327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.206 [2024-11-19 02:03:27.699599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.699750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.699776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.206 [2024-11-19 02:03:27.699791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.206 [2024-11-19 02:03:27.699989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.206 [2024-11-19 02:03:27.700160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.206 [2024-11-19 02:03:27.700179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.206 [2024-11-19 02:03:27.700191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.206 [2024-11-19 02:03:27.702212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.206 [2024-11-19 02:03:27.711468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.206 [2024-11-19 02:03:27.711790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.711883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.711910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.206 [2024-11-19 02:03:27.711926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.206 [2024-11-19 02:03:27.712091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.206 [2024-11-19 02:03:27.712265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.206 [2024-11-19 02:03:27.712284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.206 [2024-11-19 02:03:27.712297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.206 [2024-11-19 02:03:27.714185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.206 [2024-11-19 02:03:27.723554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.206 [2024-11-19 02:03:27.723878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.724028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.724053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.206 [2024-11-19 02:03:27.724073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.206 [2024-11-19 02:03:27.724239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.206 [2024-11-19 02:03:27.724382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.206 [2024-11-19 02:03:27.724401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.206 [2024-11-19 02:03:27.724413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.206 [2024-11-19 02:03:27.726154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.206 [2024-11-19 02:03:27.735739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.206 [2024-11-19 02:03:27.736093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.736214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.736239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.206 [2024-11-19 02:03:27.736255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.206 [2024-11-19 02:03:27.736355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.206 [2024-11-19 02:03:27.736529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.206 [2024-11-19 02:03:27.736548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.206 [2024-11-19 02:03:27.736561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.206 [2024-11-19 02:03:27.738505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.206 [2024-11-19 02:03:27.748005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.206 [2024-11-19 02:03:27.748354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.748483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.206 [2024-11-19 02:03:27.748508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.206 [2024-11-19 02:03:27.748524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.206 [2024-11-19 02:03:27.748688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.206 [2024-11-19 02:03:27.748887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.206 [2024-11-19 02:03:27.748912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.206 [2024-11-19 02:03:27.748947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.751115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.760053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.760317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.760440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.760465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.760481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.760622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.760801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.760822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.760836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.763081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.772181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.772592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.772703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.772729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.772745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.772877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.773057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.773076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.773088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.775227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.784496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.784829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.784953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.784978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.784994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.785126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.785306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.785326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.785338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.787225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.796706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.797019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.797177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.797202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.797217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.797355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.797546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.797565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.797578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.799381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.809289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.809652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.809767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.809795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.809812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.809960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.810147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.810170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.810185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.812632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.821807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.822103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.822262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.822290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.822308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.822490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.822651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.822675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.822690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.824996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.834308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.834645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.834754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.834779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.834794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.834970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.835136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.835165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.835181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.837471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.846961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.847286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.847416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.847443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.847460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.847590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.847751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.466 [2024-11-19 02:03:27.847776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.466 [2024-11-19 02:03:27.847792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.466 [2024-11-19 02:03:27.850219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.466 [2024-11-19 02:03:27.859626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.466 [2024-11-19 02:03:27.859970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.860075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.466 [2024-11-19 02:03:27.860103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.466 [2024-11-19 02:03:27.860121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.466 [2024-11-19 02:03:27.860267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.466 [2024-11-19 02:03:27.860454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.860478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.860493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.862806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.872195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.872598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.872743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.872772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.872790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.872955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.873146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.873170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.873191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.875368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.884928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.885186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.885319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.885347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.885364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.885547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.885728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.885753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.885769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.888053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.897476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.897761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.897865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.897894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.897911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.898094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.898282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.898305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.898320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.900777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.910477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.910767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.910876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.910904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.910922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.911086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.911274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.911297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.911313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.913624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.923044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.923380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.923488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.923516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.923533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.923673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.923843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.923866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.923881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.926090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.935575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.935913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.936070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.936098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.936115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.936298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.936467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.936490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.936505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.938747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.948222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.948480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.948642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.948671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.948689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.948854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.949041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.949064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.949079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.951391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 [2024-11-19 02:03:27.960814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.467 [2024-11-19 02:03:27.961115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.961204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.467 [2024-11-19 02:03:27.961231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.467 [2024-11-19 02:03:27.961249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.467 [2024-11-19 02:03:27.961413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.467 [2024-11-19 02:03:27.961618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.467 [2024-11-19 02:03:27.961653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.467 [2024-11-19 02:03:27.961671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.467 [2024-11-19 02:03:27.963866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.467 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3561981 Killed "${NVMF_APP[@]}" "$@" 00:27:39.467 02:03:27 -- host/bdevperf.sh@36 -- # tgt_init 00:27:39.467 02:03:27 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:39.467 02:03:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:39.467 02:03:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:39.467 02:03:27 -- common/autotest_common.sh@10 -- # set +x 00:27:39.467 02:03:27 -- nvmf/common.sh@469 -- # nvmfpid=3563100 00:27:39.467 02:03:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:39.467 02:03:27 -- nvmf/common.sh@470 -- # waitforlisten 3563100 00:27:39.467 02:03:27 -- common/autotest_common.sh@829 -- # '[' -z 3563100 ']' 00:27:39.467 02:03:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:39.467 02:03:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:39.467 02:03:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:39.467 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:39.468 02:03:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:39.468 02:03:27 -- common/autotest_common.sh@10 -- # set +x 00:27:39.468 [2024-11-19 02:03:27.973572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.468 [2024-11-19 02:03:27.973826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.468 [2024-11-19 02:03:27.973973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.468 [2024-11-19 02:03:27.974016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.468 [2024-11-19 02:03:27.974032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.468 [2024-11-19 02:03:27.974132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.468 [2024-11-19 02:03:27.974301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.468 [2024-11-19 02:03:27.974324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.468 [2024-11-19 02:03:27.974340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.468 [2024-11-19 02:03:27.976584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.468 [2024-11-19 02:03:27.986346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.468 [2024-11-19 02:03:27.986667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.468 [2024-11-19 02:03:27.986819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.468 [2024-11-19 02:03:27.986844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.468 [2024-11-19 02:03:27.986860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.468 [2024-11-19 02:03:27.987016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.468 [2024-11-19 02:03:27.987186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.468 [2024-11-19 02:03:27.987209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.468 [2024-11-19 02:03:27.987225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.468 [2024-11-19 02:03:27.989542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.468 [2024-11-19 02:03:27.998978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.468 [2024-11-19 02:03:27.999370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.468 [2024-11-19 02:03:27.999483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.468 [2024-11-19 02:03:27.999508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.468 [2024-11-19 02:03:27.999524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.468 [2024-11-19 02:03:27.999683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.468 [2024-11-19 02:03:27.999820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.468 [2024-11-19 02:03:27.999841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.468 [2024-11-19 02:03:27.999855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.468 [2024-11-19 02:03:28.002253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.728 [2024-11-19 02:03:28.011551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.728 [2024-11-19 02:03:28.011846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.728 [2024-11-19 02:03:28.011951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.728 [2024-11-19 02:03:28.011994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.728 [2024-11-19 02:03:28.012013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.728 [2024-11-19 02:03:28.012196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.728 [2024-11-19 02:03:28.012366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.728 [2024-11-19 02:03:28.012389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.728 [2024-11-19 02:03:28.012404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.728 [2024-11-19 02:03:28.014633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.728 [2024-11-19 02:03:28.014977] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:39.728 [2024-11-19 02:03:28.015036] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:39.728 [2024-11-19 02:03:28.024298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.728 [2024-11-19 02:03:28.024663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.728 [2024-11-19 02:03:28.024801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.728 [2024-11-19 02:03:28.024827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.728 [2024-11-19 02:03:28.024843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.728 [2024-11-19 02:03:28.025018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.728 [2024-11-19 02:03:28.025170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.728 [2024-11-19 02:03:28.025193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.025209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.027429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 [2024-11-19 02:03:28.036660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.037027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.037205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.037231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.037246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.037442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.037670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.037709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.037724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.039907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 [2024-11-19 02:03:28.049125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.049472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.049612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.049856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.049879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.050049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.050218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.050241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.050257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.052560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 EAL: No free 2048 kB hugepages reported on node 1 00:27:39.729 [2024-11-19 02:03:28.061671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.061965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.062105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.062133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.062151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.062334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.062557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.062581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.062597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.064867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 [2024-11-19 02:03:28.074319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.074609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.074790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.074816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.074832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.075057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.075259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.075283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.075298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.077628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 [2024-11-19 02:03:28.086813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.087228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.087351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.087378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.087394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.087546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.087738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.087761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.087774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.088747] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:39.729 [2024-11-19 02:03:28.089947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 [2024-11-19 02:03:28.099438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.100130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.100254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.100283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.100303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.100514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.100712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.100735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.100751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.103032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 [2024-11-19 02:03:28.112116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.112394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.112558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.112586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.112605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.112787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.112953] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.112973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.112986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.115164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.729 [2024-11-19 02:03:28.124549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.729 [2024-11-19 02:03:28.124831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.125022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.729 [2024-11-19 02:03:28.125048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.729 [2024-11-19 02:03:28.125064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.729 [2024-11-19 02:03:28.125213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.729 [2024-11-19 02:03:28.125404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.729 [2024-11-19 02:03:28.125428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.729 [2024-11-19 02:03:28.125443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.729 [2024-11-19 02:03:28.127780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.137075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.730 [2024-11-19 02:03:28.137394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.137523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.137561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.730 [2024-11-19 02:03:28.137579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.730 [2024-11-19 02:03:28.137762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.730 [2024-11-19 02:03:28.137896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.730 [2024-11-19 02:03:28.137933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.730 [2024-11-19 02:03:28.137948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.730 [2024-11-19 02:03:28.140352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.149683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.730 [2024-11-19 02:03:28.149946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.150103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.150131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.730 [2024-11-19 02:03:28.150150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.730 [2024-11-19 02:03:28.150263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.730 [2024-11-19 02:03:28.150432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.730 [2024-11-19 02:03:28.150455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.730 [2024-11-19 02:03:28.150471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.730 [2024-11-19 02:03:28.152810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.162147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.730 [2024-11-19 02:03:28.162630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.162777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.162803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.730 [2024-11-19 02:03:28.162823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.730 [2024-11-19 02:03:28.162984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.730 [2024-11-19 02:03:28.163158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.730 [2024-11-19 02:03:28.163182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.730 [2024-11-19 02:03:28.163200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.730 [2024-11-19 02:03:28.165455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.174483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.730 [2024-11-19 02:03:28.174813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.174947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.174973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.730 [2024-11-19 02:03:28.174998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.730 [2024-11-19 02:03:28.175148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.730 [2024-11-19 02:03:28.175335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.730 [2024-11-19 02:03:28.175359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.730 [2024-11-19 02:03:28.175375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.730 [2024-11-19 02:03:28.177648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.186970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.730 [2024-11-19 02:03:28.187344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.187496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.187521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.730 [2024-11-19 02:03:28.187537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.730 [2024-11-19 02:03:28.187716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.730 [2024-11-19 02:03:28.187893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.730 [2024-11-19 02:03:28.187928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.730 [2024-11-19 02:03:28.187941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.730 [2024-11-19 02:03:28.190383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.199534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.730 [2024-11-19 02:03:28.199814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.199961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.199990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.730 [2024-11-19 02:03:28.200008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.730 [2024-11-19 02:03:28.200193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.730 [2024-11-19 02:03:28.200362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.730 [2024-11-19 02:03:28.200385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.730 [2024-11-19 02:03:28.200401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.730 [2024-11-19 02:03:28.202767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.205026] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:39.730 [2024-11-19 02:03:28.205144] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:39.730 [2024-11-19 02:03:28.205162] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:39.730 [2024-11-19 02:03:28.205174] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:39.730 [2024-11-19 02:03:28.205227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:39.730 [2024-11-19 02:03:28.205290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:39.730 [2024-11-19 02:03:28.205293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:39.730 [2024-11-19 02:03:28.211970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.730 [2024-11-19 02:03:28.212357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.212455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.730 [2024-11-19 02:03:28.212481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.730 [2024-11-19 02:03:28.212499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.730 [2024-11-19 02:03:28.212679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.730 [2024-11-19 02:03:28.212819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.730 [2024-11-19 02:03:28.212840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.730 [2024-11-19 02:03:28.212855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.730 [2024-11-19 02:03:28.214961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.730 [2024-11-19 02:03:28.224392] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.731 [2024-11-19 02:03:28.224817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.224942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.224968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.731 [2024-11-19 02:03:28.224988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.731 [2024-11-19 02:03:28.225113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.731 [2024-11-19 02:03:28.225267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.731 [2024-11-19 02:03:28.225289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.731 [2024-11-19 02:03:28.225305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.731 [2024-11-19 02:03:28.227469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.731 [2024-11-19 02:03:28.236542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.731 [2024-11-19 02:03:28.236925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.237072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.237098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.731 [2024-11-19 02:03:28.237117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.731 [2024-11-19 02:03:28.237275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.731 [2024-11-19 02:03:28.237459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.731 [2024-11-19 02:03:28.237481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.731 [2024-11-19 02:03:28.237497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.731 [2024-11-19 02:03:28.239615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.731 [2024-11-19 02:03:28.248839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.731 [2024-11-19 02:03:28.249268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.249409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.249435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.731 [2024-11-19 02:03:28.249454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.731 [2024-11-19 02:03:28.249611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.731 [2024-11-19 02:03:28.249743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.731 [2024-11-19 02:03:28.249765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.731 [2024-11-19 02:03:28.249782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.731 [2024-11-19 02:03:28.251872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.731 [2024-11-19 02:03:28.261150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.731 [2024-11-19 02:03:28.261469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.261567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.731 [2024-11-19 02:03:28.261592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.731 [2024-11-19 02:03:28.261609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.731 [2024-11-19 02:03:28.261788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.731 [2024-11-19 02:03:28.261961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.731 [2024-11-19 02:03:28.261982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.731 [2024-11-19 02:03:28.261999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.731 [2024-11-19 02:03:28.264082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.273744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.274168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.274320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.274348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.274368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.274517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.274697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.991 [2024-11-19 02:03:28.274720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.991 [2024-11-19 02:03:28.274736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.991 [2024-11-19 02:03:28.276848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.286135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.286466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.286606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.286633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.286660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.286827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.286996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.991 [2024-11-19 02:03:28.287017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.991 [2024-11-19 02:03:28.287033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.991 [2024-11-19 02:03:28.289368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.298600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.298928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.299084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.299110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.299126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.299293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.299458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.991 [2024-11-19 02:03:28.299479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.991 [2024-11-19 02:03:28.299492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.991 [2024-11-19 02:03:28.301571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.310823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.311176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.311278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.311303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.311319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.311452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.311587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.991 [2024-11-19 02:03:28.311608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.991 [2024-11-19 02:03:28.311621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.991 [2024-11-19 02:03:28.313801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.323118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.323440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.323570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.323600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.323617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.323740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.323925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.991 [2024-11-19 02:03:28.323961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.991 [2024-11-19 02:03:28.323975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.991 [2024-11-19 02:03:28.326066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.335485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.335807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.335966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.335991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.336007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.336156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.336321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.991 [2024-11-19 02:03:28.336341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.991 [2024-11-19 02:03:28.336355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.991 [2024-11-19 02:03:28.338443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.347917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.348253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.348337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.348362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.348377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.348526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.348699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.991 [2024-11-19 02:03:28.348721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.991 [2024-11-19 02:03:28.348736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.991 [2024-11-19 02:03:28.350843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.991 [2024-11-19 02:03:28.360202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.991 [2024-11-19 02:03:28.360456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.360562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.991 [2024-11-19 02:03:28.360587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.991 [2024-11-19 02:03:28.360608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.991 [2024-11-19 02:03:28.360749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.991 [2024-11-19 02:03:28.360886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.360906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.360920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.362943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.372427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.372749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.372902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.372927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.372943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.373075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.373240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.373261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.373275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.375477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.384822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.385182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.385304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.385330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.385345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.385494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.385667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.385690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.385704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.387740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.397159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.397430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.397534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.397559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.397575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.397724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.397878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.397899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.397913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.399979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.409306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.409568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.409724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.409750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.409766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.409899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.410065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.410086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.410099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.412129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.421345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.421631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.421749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.421774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.421791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.421923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.422088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.422109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.422122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.424234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.433555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.433872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.433983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.434009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.434024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.434173] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.434328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.434349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.434363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.436364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.445902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.446227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.446318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.446343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.446359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.446524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.446716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.446738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.446752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.448877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.458116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.458425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.458543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.458569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.458585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.458744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.458897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.458918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.458946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.461168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.470478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.992 [2024-11-19 02:03:28.470782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.470905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.992 [2024-11-19 02:03:28.470930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.992 [2024-11-19 02:03:28.470946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.992 [2024-11-19 02:03:28.471111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.992 [2024-11-19 02:03:28.471263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.992 [2024-11-19 02:03:28.471289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.992 [2024-11-19 02:03:28.471303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.992 [2024-11-19 02:03:28.473367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.992 [2024-11-19 02:03:28.482809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.993 [2024-11-19 02:03:28.483083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.483209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.483234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.993 [2024-11-19 02:03:28.483250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.993 [2024-11-19 02:03:28.483398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.993 [2024-11-19 02:03:28.483532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.993 [2024-11-19 02:03:28.483552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.993 [2024-11-19 02:03:28.483565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.993 [2024-11-19 02:03:28.485586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.993 [2024-11-19 02:03:28.495065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.993 [2024-11-19 02:03:28.495381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.495475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.495501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.993 [2024-11-19 02:03:28.495516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.993 [2024-11-19 02:03:28.495633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.993 [2024-11-19 02:03:28.495779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.993 [2024-11-19 02:03:28.495799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.993 [2024-11-19 02:03:28.495813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.993 [2024-11-19 02:03:28.498016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.993 [2024-11-19 02:03:28.507393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.993 [2024-11-19 02:03:28.507712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.507834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.507859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.993 [2024-11-19 02:03:28.507875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.993 [2024-11-19 02:03:28.507991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.993 [2024-11-19 02:03:28.508174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.993 [2024-11-19 02:03:28.508195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.993 [2024-11-19 02:03:28.508213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.993 [2024-11-19 02:03:28.510313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.993 [2024-11-19 02:03:28.519613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.993 [2024-11-19 02:03:28.519912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.520035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.520060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.993 [2024-11-19 02:03:28.520075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.993 [2024-11-19 02:03:28.520191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.993 [2024-11-19 02:03:28.520327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.993 [2024-11-19 02:03:28.520348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.993 [2024-11-19 02:03:28.520361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.993 [2024-11-19 02:03:28.522579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.993 [2024-11-19 02:03:28.531994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.993 [2024-11-19 02:03:28.532367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.532493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.993 [2024-11-19 02:03:28.532519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:39.993 [2024-11-19 02:03:28.532536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:39.993 [2024-11-19 02:03:28.532663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:39.993 [2024-11-19 02:03:28.532816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.993 [2024-11-19 02:03:28.532837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.993 [2024-11-19 02:03:28.532851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.993 [2024-11-19 02:03:28.535130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.252 [2024-11-19 02:03:28.544323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.252 [2024-11-19 02:03:28.544625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.252 [2024-11-19 02:03:28.544737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.252 [2024-11-19 02:03:28.544762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.252 [2024-11-19 02:03:28.544778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.252 [2024-11-19 02:03:28.544927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.252 [2024-11-19 02:03:28.545109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.252 [2024-11-19 02:03:28.545129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.252 [2024-11-19 02:03:28.545143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.252 [2024-11-19 02:03:28.547340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.252 [2024-11-19 02:03:28.556550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.252 [2024-11-19 02:03:28.556866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.252 [2024-11-19 02:03:28.556968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.252 [2024-11-19 02:03:28.556992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.252 [2024-11-19 02:03:28.557008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.252 [2024-11-19 02:03:28.557203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.252 [2024-11-19 02:03:28.557367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.252 [2024-11-19 02:03:28.557388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.252 [2024-11-19 02:03:28.557401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.252 [2024-11-19 02:03:28.559423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.252 [2024-11-19 02:03:28.568765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.252 [2024-11-19 02:03:28.569099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.569190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.569216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.569232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.569412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.569546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.569567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.569580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.571803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.581257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.581571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.581673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.581699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.581715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.581879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.582045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.582066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.582078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.584039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.593288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.593642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.593762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.593788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.593803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.593903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.594053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.594074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.594087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.596151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.605568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.605876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.605989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.606015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.606030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.606163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.606314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.606335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.606348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.608277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.617986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.618246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.618340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.618365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.618380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.618545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.618739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.618761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.618775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.620772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.630209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.630532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.630660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.630687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.630703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.630803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.630955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.630976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.630991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.632931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.642577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.642876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.643002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.643028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.643043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.643192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.643361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.643381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.643395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.645537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.655034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.655359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.655452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.655478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.655493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.655668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.655873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.655894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.655908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.658149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.667230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.667511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.667630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.667663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.667696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.253 [2024-11-19 02:03:28.667863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.253 [2024-11-19 02:03:28.668030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.253 [2024-11-19 02:03:28.668051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.253 [2024-11-19 02:03:28.668064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.253 [2024-11-19 02:03:28.670275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.253 [2024-11-19 02:03:28.679527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.253 [2024-11-19 02:03:28.679775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.679900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.253 [2024-11-19 02:03:28.679926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.253 [2024-11-19 02:03:28.679942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.680075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.680193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.680213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.680226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.682414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.691744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.692024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.692140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.692165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.692181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.692330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.692496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.692516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.692530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.694780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.704052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.704285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.704414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.704440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.704456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.704593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.704770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.704792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.704807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.706956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.716342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.716536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.716670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.716697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.716713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.716878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.717029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.717050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.717064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.719253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.728707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.728982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.729079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.729104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.729119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.729235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.729370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.729390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.729404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.731573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.740911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.741206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.741294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.741319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.741334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.741466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.741693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.741716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.741730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.743794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.753169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.753485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.753612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.753647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.753665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.753823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.753989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.754009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.754022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.755858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.765506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.765799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.765947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.765972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.765989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.766139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.766288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.766309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.766323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.768397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.777762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.778044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.778164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.778190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.778205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.778402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.778555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.778581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.254 [2024-11-19 02:03:28.778595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.254 [2024-11-19 02:03:28.780741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.254 [2024-11-19 02:03:28.790123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.254 [2024-11-19 02:03:28.790363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.790488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.254 [2024-11-19 02:03:28.790514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.254 [2024-11-19 02:03:28.790529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.254 [2024-11-19 02:03:28.790630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.254 [2024-11-19 02:03:28.790761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.254 [2024-11-19 02:03:28.790781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.255 [2024-11-19 02:03:28.790795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.255 [2024-11-19 02:03:28.792845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.802608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.802857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.803005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.803030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.803046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.803169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.803329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.803352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.803365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.805478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.814942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.815189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.815288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.815313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.815329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.815478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.815718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.815740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.815759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.818069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.827304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.827515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.827611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.827644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.827662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.827795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.827963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.827984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.827996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.830149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.839437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.839741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.839831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.839856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.839871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.840053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.840232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.840253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.840266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.842408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.851558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.851837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.851974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.852000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.852015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.852148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.852267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.852288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.852301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.854353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.863807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.864141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.864263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.864288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.864303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.864452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.864634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.864680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.864695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.866741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.876083] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.876352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.876450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.876475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.876490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.876589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.876766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.876788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.876803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.878986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.888340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.888646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.888734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.888760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.888775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.888940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.889106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.889128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.889141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.515 [2024-11-19 02:03:28.891363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.515 [2024-11-19 02:03:28.900630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.515 [2024-11-19 02:03:28.900922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.901020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.515 [2024-11-19 02:03:28.901046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.515 [2024-11-19 02:03:28.901061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.515 [2024-11-19 02:03:28.901211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.515 [2024-11-19 02:03:28.901361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.515 [2024-11-19 02:03:28.901381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.515 [2024-11-19 02:03:28.901394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.903453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.913075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.913373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.913494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.913520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.913535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.913661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.913814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.913835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.913849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.915841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.925319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.925586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.925686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.925713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.925728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.925877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.926074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.926095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.926109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.928194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.937645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.937915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.938048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.938074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.938089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.938206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.938405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.938426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.938439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.940600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.949818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.950103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.950227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.950253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.950268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.950441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.950648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.950670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.950684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.952860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.962231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.962534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.962652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.962678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.962693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.962825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.962992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.963013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.963026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.965032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.974606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.974952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.975043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.975075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.975092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.975273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.975470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.975491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.975505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.977600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.987025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.987317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.987403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.987428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.987443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.987592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.987752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.987773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.987786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:28.989723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.516 [2024-11-19 02:03:28.999160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.516 [2024-11-19 02:03:28.999483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.999630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.516 [2024-11-19 02:03:28.999663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.516 [2024-11-19 02:03:28.999688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.516 [2024-11-19 02:03:28.999822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.516 [2024-11-19 02:03:28.999958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.516 [2024-11-19 02:03:28.999978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.516 [2024-11-19 02:03:28.999991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.516 [2024-11-19 02:03:29.002260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.517 [2024-11-19 02:03:29.011668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.517 [2024-11-19 02:03:29.011928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.012020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.012045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.517 [2024-11-19 02:03:29.012066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.517 [2024-11-19 02:03:29.012233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.517 [2024-11-19 02:03:29.012367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.517 [2024-11-19 02:03:29.012387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.517 [2024-11-19 02:03:29.012400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.517 [2024-11-19 02:03:29.014525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.517 [2024-11-19 02:03:29.024144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.517 [2024-11-19 02:03:29.024403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.024492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.024518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.517 [2024-11-19 02:03:29.024533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.517 [2024-11-19 02:03:29.024692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.517 [2024-11-19 02:03:29.024845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.517 [2024-11-19 02:03:29.024866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.517 [2024-11-19 02:03:29.024880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.517 [2024-11-19 02:03:29.027065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.517 02:03:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:40.517 02:03:29 -- common/autotest_common.sh@862 -- # return 0 00:27:40.517 02:03:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:40.517 02:03:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:40.517 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:27:40.517 [2024-11-19 02:03:29.036602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.517 [2024-11-19 02:03:29.036883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.036996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.037021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.517 [2024-11-19 02:03:29.037037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.517 [2024-11-19 02:03:29.037201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.517 [2024-11-19 02:03:29.037355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.517 [2024-11-19 02:03:29.037376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.517 [2024-11-19 02:03:29.037389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.517 [2024-11-19 02:03:29.039556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.517 02:03:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:40.517 02:03:29 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:40.517 02:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:40.517 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:27:40.517 [2024-11-19 02:03:29.049082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.517 [2024-11-19 02:03:29.049365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.049467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.517 [2024-11-19 02:03:29.049494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.517 [2024-11-19 02:03:29.049509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.517 [2024-11-19 02:03:29.049626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.517 [2024-11-19 02:03:29.049772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.517 [2024-11-19 02:03:29.049793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.517 [2024-11-19 02:03:29.049807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.517 [2024-11-19 02:03:29.051738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.517 [2024-11-19 02:03:29.051788] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:40.517 02:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:40.517 02:03:29 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:40.517 02:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:40.517 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:27:40.783 [2024-11-19 02:03:29.061454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.784 [2024-11-19 02:03:29.061752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.784 [2024-11-19 02:03:29.061895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.784 [2024-11-19 02:03:29.061924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.784 [2024-11-19 02:03:29.061946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.784 [2024-11-19 02:03:29.062047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.784 [2024-11-19 02:03:29.062181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.784 [2024-11-19 02:03:29.062202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.784 [2024-11-19 02:03:29.062215] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.784 [2024-11-19 02:03:29.064246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.784 [2024-11-19 02:03:29.073787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.784 [2024-11-19 02:03:29.074111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.784 [2024-11-19 02:03:29.074205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.784 [2024-11-19 02:03:29.074231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.784 [2024-11-19 02:03:29.074247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.784 [2024-11-19 02:03:29.074427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.784 [2024-11-19 02:03:29.074601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.784 [2024-11-19 02:03:29.074646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.784 [2024-11-19 02:03:29.074668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.784 [2024-11-19 02:03:29.076642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.784 [2024-11-19 02:03:29.086171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.784 [2024-11-19 02:03:29.086518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.784 [2024-11-19 02:03:29.086666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.784 [2024-11-19 02:03:29.086693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.784 [2024-11-19 02:03:29.086711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.784 [2024-11-19 02:03:29.086898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.784 [2024-11-19 02:03:29.087077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.784 [2024-11-19 02:03:29.087098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.784 [2024-11-19 02:03:29.087114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.784 [2024-11-19 02:03:29.089154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.784 Malloc0 00:27:40.784 02:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:40.784 02:03:29 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:40.784 02:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:40.784 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:27:40.784 [2024-11-19 02:03:29.098516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.784 [2024-11-19 02:03:29.098820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.784 [2024-11-19 02:03:29.098956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.785 [2024-11-19 02:03:29.098982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.785 [2024-11-19 02:03:29.098999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.785 [2024-11-19 02:03:29.099185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.785 [2024-11-19 02:03:29.099356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.785 [2024-11-19 02:03:29.099377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.785 [2024-11-19 02:03:29.099393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.785 [2024-11-19 02:03:29.101409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.785 02:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:40.785 02:03:29 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:40.785 02:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:40.785 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:27:40.785 [2024-11-19 02:03:29.111083] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.785 [2024-11-19 02:03:29.111374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.785 [2024-11-19 02:03:29.111502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.785 [2024-11-19 02:03:29.111528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa1160 with addr=10.0.0.2, port=4420 00:27:40.785 [2024-11-19 02:03:29.111543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa1160 is same with the state(5) to be set 00:27:40.785 [2024-11-19 02:03:29.111712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa1160 (9): Bad file descriptor 00:27:40.785 [2024-11-19 02:03:29.111882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.785 [2024-11-19 02:03:29.111902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.785 [2024-11-19 02:03:29.111917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.785 02:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:40.785 02:03:29 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:40.785 02:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:40.785 02:03:29 -- common/autotest_common.sh@10 -- # set +x 00:27:40.785 [2024-11-19 02:03:29.114168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.785 [2024-11-19 02:03:29.117471] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:40.785 02:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:40.785 02:03:29 -- host/bdevperf.sh@38 -- # wait 3562413 00:27:40.785 [2024-11-19 02:03:29.123312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.785 [2024-11-19 02:03:29.153769] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:48.901 00:27:48.901 Latency(us) 00:27:48.901 [2024-11-19T01:03:37.444Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:48.901 [2024-11-19T01:03:37.444Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:48.901 Verification LBA range: start 0x0 length 0x4000 00:27:48.901 Nvme1n1 : 15.01 9377.64 36.63 16502.23 0.00 4931.30 628.05 22427.88 00:27:48.901 [2024-11-19T01:03:37.444Z] =================================================================================================================== 00:27:48.901 [2024-11-19T01:03:37.444Z] Total : 9377.64 36.63 16502.23 0.00 4931.30 628.05 22427.88 00:27:49.170 02:03:37 -- host/bdevperf.sh@39 -- # sync 00:27:49.170 02:03:37 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:49.170 02:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.170 02:03:37 -- common/autotest_common.sh@10 -- # set +x 00:27:49.170 02:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.170 02:03:37 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:49.170 02:03:37 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:49.170 02:03:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:49.170 02:03:37 -- nvmf/common.sh@116 -- # sync 00:27:49.170 02:03:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:49.170 02:03:37 -- nvmf/common.sh@119 -- # set +e 00:27:49.171 02:03:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:49.171 02:03:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:49.171 rmmod nvme_tcp 00:27:49.171 rmmod nvme_fabrics 00:27:49.171 rmmod nvme_keyring 00:27:49.429 02:03:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:49.429 02:03:37 -- nvmf/common.sh@123 -- # set -e 00:27:49.429 02:03:37 -- nvmf/common.sh@124 -- # return 0 00:27:49.429 02:03:37 -- nvmf/common.sh@477 -- # '[' -n 3563100 ']' 00:27:49.429 02:03:37 -- nvmf/common.sh@478 -- # killprocess 3563100 00:27:49.429 02:03:37 -- common/autotest_common.sh@936 -- # '[' -z 3563100 ']' 00:27:49.429 02:03:37 -- common/autotest_common.sh@940 -- # kill -0 3563100 00:27:49.429 02:03:37 -- common/autotest_common.sh@941 -- # uname 00:27:49.429 02:03:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:49.429 02:03:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3563100 00:27:49.429 02:03:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:49.429 02:03:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:49.429 02:03:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3563100' 00:27:49.429 killing process with pid 3563100 00:27:49.429 02:03:37 -- common/autotest_common.sh@955 -- # kill 3563100 00:27:49.429 02:03:37 -- common/autotest_common.sh@960 -- # wait 3563100 00:27:49.687 02:03:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:49.687 02:03:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:49.687 02:03:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:49.687 02:03:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:49.687 02:03:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:49.687 02:03:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.688 02:03:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:49.688 02:03:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:51.592 02:03:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:51.592 00:27:51.592 real 0m23.387s 00:27:51.592 user 1m3.278s 00:27:51.592 sys 0m4.184s 00:27:51.592 02:03:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:51.592 02:03:40 -- common/autotest_common.sh@10 -- # set +x 00:27:51.592 ************************************ 00:27:51.592 END TEST nvmf_bdevperf 00:27:51.592 ************************************ 00:27:51.592 02:03:40 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:51.592 02:03:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:51.592 02:03:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:51.592 02:03:40 -- common/autotest_common.sh@10 -- # set +x 00:27:51.592 ************************************ 00:27:51.592 START TEST nvmf_target_disconnect 00:27:51.592 ************************************ 00:27:51.592 02:03:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:51.850 * Looking for test storage... 00:27:51.850 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:51.850 02:03:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:51.850 02:03:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:51.850 02:03:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:51.850 02:03:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:51.850 02:03:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:51.850 02:03:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:51.850 02:03:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:51.850 02:03:40 -- scripts/common.sh@335 -- # IFS=.-: 00:27:51.850 02:03:40 -- scripts/common.sh@335 -- # read -ra ver1 00:27:51.850 02:03:40 -- scripts/common.sh@336 -- # IFS=.-: 00:27:51.850 02:03:40 -- scripts/common.sh@336 -- # read -ra ver2 00:27:51.850 02:03:40 -- scripts/common.sh@337 -- # local 'op=<' 00:27:51.850 02:03:40 -- scripts/common.sh@339 -- # ver1_l=2 00:27:51.850 02:03:40 -- scripts/common.sh@340 -- # ver2_l=1 00:27:51.850 02:03:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:51.850 02:03:40 -- scripts/common.sh@343 -- # case "$op" in 00:27:51.850 02:03:40 -- scripts/common.sh@344 -- # : 1 00:27:51.850 02:03:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:51.850 02:03:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:51.850 02:03:40 -- scripts/common.sh@364 -- # decimal 1 00:27:51.850 02:03:40 -- scripts/common.sh@352 -- # local d=1 00:27:51.850 02:03:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:51.850 02:03:40 -- scripts/common.sh@354 -- # echo 1 00:27:51.850 02:03:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:51.850 02:03:40 -- scripts/common.sh@365 -- # decimal 2 00:27:51.850 02:03:40 -- scripts/common.sh@352 -- # local d=2 00:27:51.850 02:03:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:51.850 02:03:40 -- scripts/common.sh@354 -- # echo 2 00:27:51.850 02:03:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:51.850 02:03:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:51.850 02:03:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:51.850 02:03:40 -- scripts/common.sh@367 -- # return 0 00:27:51.850 02:03:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:51.850 02:03:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:51.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.850 --rc genhtml_branch_coverage=1 00:27:51.850 --rc genhtml_function_coverage=1 00:27:51.850 --rc genhtml_legend=1 00:27:51.850 --rc geninfo_all_blocks=1 00:27:51.850 --rc geninfo_unexecuted_blocks=1 00:27:51.850 00:27:51.850 ' 00:27:51.850 02:03:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:51.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.850 --rc genhtml_branch_coverage=1 00:27:51.850 --rc genhtml_function_coverage=1 00:27:51.850 --rc genhtml_legend=1 00:27:51.850 --rc geninfo_all_blocks=1 00:27:51.850 --rc geninfo_unexecuted_blocks=1 00:27:51.850 00:27:51.850 ' 00:27:51.850 02:03:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:51.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.850 --rc genhtml_branch_coverage=1 00:27:51.850 --rc genhtml_function_coverage=1 00:27:51.850 --rc genhtml_legend=1 00:27:51.850 --rc geninfo_all_blocks=1 00:27:51.850 --rc geninfo_unexecuted_blocks=1 00:27:51.850 00:27:51.850 ' 00:27:51.850 02:03:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:51.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.850 --rc genhtml_branch_coverage=1 00:27:51.850 --rc genhtml_function_coverage=1 00:27:51.850 --rc genhtml_legend=1 00:27:51.850 --rc geninfo_all_blocks=1 00:27:51.850 --rc geninfo_unexecuted_blocks=1 00:27:51.850 00:27:51.851 ' 00:27:51.851 02:03:40 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:51.851 02:03:40 -- nvmf/common.sh@7 -- # uname -s 00:27:51.851 02:03:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:51.851 02:03:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:51.851 02:03:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:51.851 02:03:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:51.851 02:03:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:51.851 02:03:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:51.851 02:03:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:51.851 02:03:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:51.851 02:03:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:51.851 02:03:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:51.851 02:03:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:51.851 02:03:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:51.851 02:03:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:51.851 02:03:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:51.851 02:03:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:51.851 02:03:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:51.851 02:03:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:51.851 02:03:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:51.851 02:03:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:51.851 02:03:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.851 02:03:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.851 02:03:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.851 02:03:40 -- paths/export.sh@5 -- # export PATH 00:27:51.851 02:03:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.851 02:03:40 -- nvmf/common.sh@46 -- # : 0 00:27:51.851 02:03:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:51.851 02:03:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:51.851 02:03:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:51.851 02:03:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:51.851 02:03:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:51.851 02:03:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:51.851 02:03:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:51.851 02:03:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:51.851 02:03:40 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:51.851 02:03:40 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:51.851 02:03:40 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:51.851 02:03:40 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:51.851 02:03:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:51.851 02:03:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:51.851 02:03:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:51.851 02:03:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:51.851 02:03:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:51.851 02:03:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:51.851 02:03:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:51.851 02:03:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:51.851 02:03:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:51.851 02:03:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:51.851 02:03:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:51.851 02:03:40 -- common/autotest_common.sh@10 -- # set +x 00:27:54.383 02:03:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:54.383 02:03:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:54.383 02:03:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:54.383 02:03:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:54.383 02:03:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:54.383 02:03:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:54.383 02:03:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:54.383 02:03:42 -- nvmf/common.sh@294 -- # net_devs=() 00:27:54.383 02:03:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:54.383 02:03:42 -- nvmf/common.sh@295 -- # e810=() 00:27:54.383 02:03:42 -- nvmf/common.sh@295 -- # local -ga e810 00:27:54.383 02:03:42 -- nvmf/common.sh@296 -- # x722=() 00:27:54.383 02:03:42 -- nvmf/common.sh@296 -- # local -ga x722 00:27:54.383 02:03:42 -- nvmf/common.sh@297 -- # mlx=() 00:27:54.383 02:03:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:54.383 02:03:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:54.383 02:03:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:54.383 02:03:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:54.383 02:03:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:54.383 02:03:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.383 02:03:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:54.383 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:54.383 02:03:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.383 02:03:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:54.383 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:54.383 02:03:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:54.383 02:03:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:54.383 02:03:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.383 02:03:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.383 02:03:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.383 02:03:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.383 02:03:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:54.383 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:54.383 02:03:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.383 02:03:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.384 02:03:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.384 02:03:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.384 02:03:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.384 02:03:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:54.384 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:54.384 02:03:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.384 02:03:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:54.384 02:03:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:54.384 02:03:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:54.384 02:03:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:54.384 02:03:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:54.384 02:03:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:54.384 02:03:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:54.384 02:03:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:54.384 02:03:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:54.384 02:03:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:54.384 02:03:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:54.384 02:03:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:54.384 02:03:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:54.384 02:03:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:54.384 02:03:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:54.384 02:03:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:54.384 02:03:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:54.384 02:03:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:54.384 02:03:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:54.384 02:03:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:54.384 02:03:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:54.384 02:03:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:54.384 02:03:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:54.384 02:03:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:54.384 02:03:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:54.384 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:54.384 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:27:54.384 00:27:54.384 --- 10.0.0.2 ping statistics --- 00:27:54.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.384 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:27:54.384 02:03:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:54.384 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:54.384 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:27:54.384 00:27:54.384 --- 10.0.0.1 ping statistics --- 00:27:54.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.384 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:27:54.384 02:03:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:54.384 02:03:42 -- nvmf/common.sh@410 -- # return 0 00:27:54.384 02:03:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:54.384 02:03:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:54.384 02:03:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:54.384 02:03:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:54.384 02:03:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:54.384 02:03:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:54.384 02:03:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:54.384 02:03:42 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:54.384 02:03:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:54.384 02:03:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:54.384 02:03:42 -- common/autotest_common.sh@10 -- # set +x 00:27:54.384 ************************************ 00:27:54.384 START TEST nvmf_target_disconnect_tc1 00:27:54.384 ************************************ 00:27:54.384 02:03:42 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:54.384 02:03:42 -- host/target_disconnect.sh@32 -- # set +e 00:27:54.384 02:03:42 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:54.384 EAL: No free 2048 kB hugepages reported on node 1 00:27:54.384 [2024-11-19 02:03:42.579506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.384 [2024-11-19 02:03:42.579684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.384 [2024-11-19 02:03:42.579714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x205eb40 with addr=10.0.0.2, port=4420 00:27:54.384 [2024-11-19 02:03:42.579743] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:54.384 [2024-11-19 02:03:42.579762] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:54.384 [2024-11-19 02:03:42.579791] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:54.384 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:54.384 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:54.384 Initializing NVMe Controllers 00:27:54.384 02:03:42 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:54.384 02:03:42 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:54.384 02:03:42 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:54.384 02:03:42 -- common/autotest_common.sh@1142 -- # return 0 00:27:54.384 02:03:42 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:54.384 02:03:42 -- host/target_disconnect.sh@41 -- # set -e 00:27:54.384 00:27:54.384 real 0m0.087s 00:27:54.384 user 0m0.035s 00:27:54.384 sys 0m0.052s 00:27:54.384 02:03:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:54.384 02:03:42 -- common/autotest_common.sh@10 -- # set +x 00:27:54.384 ************************************ 00:27:54.384 END TEST nvmf_target_disconnect_tc1 00:27:54.384 ************************************ 00:27:54.384 02:03:42 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:54.384 02:03:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:54.384 02:03:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:54.384 02:03:42 -- common/autotest_common.sh@10 -- # set +x 00:27:54.384 ************************************ 00:27:54.384 START TEST nvmf_target_disconnect_tc2 00:27:54.384 ************************************ 00:27:54.384 02:03:42 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:54.384 02:03:42 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:54.384 02:03:42 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:54.384 02:03:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:54.384 02:03:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:54.384 02:03:42 -- common/autotest_common.sh@10 -- # set +x 00:27:54.384 02:03:42 -- nvmf/common.sh@469 -- # nvmfpid=3566304 00:27:54.384 02:03:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:54.384 02:03:42 -- nvmf/common.sh@470 -- # waitforlisten 3566304 00:27:54.384 02:03:42 -- common/autotest_common.sh@829 -- # '[' -z 3566304 ']' 00:27:54.384 02:03:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:54.384 02:03:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:54.384 02:03:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:54.384 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:54.384 02:03:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:54.384 02:03:42 -- common/autotest_common.sh@10 -- # set +x 00:27:54.384 [2024-11-19 02:03:42.662062] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:54.384 [2024-11-19 02:03:42.662137] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:54.384 EAL: No free 2048 kB hugepages reported on node 1 00:27:54.384 [2024-11-19 02:03:42.723600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:54.384 [2024-11-19 02:03:42.824215] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:54.384 [2024-11-19 02:03:42.824361] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:54.384 [2024-11-19 02:03:42.824377] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:54.384 [2024-11-19 02:03:42.824389] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:54.384 [2024-11-19 02:03:42.824475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:54.384 [2024-11-19 02:03:42.824550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:54.384 [2024-11-19 02:03:42.824618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:54.384 [2024-11-19 02:03:42.824621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:55.318 02:03:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:55.318 02:03:43 -- common/autotest_common.sh@862 -- # return 0 00:27:55.318 02:03:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:55.318 02:03:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:55.318 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:27:55.318 02:03:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:55.318 02:03:43 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:55.318 02:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:55.318 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:27:55.318 Malloc0 00:27:55.318 02:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:55.318 02:03:43 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:55.318 02:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:55.318 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:27:55.318 [2024-11-19 02:03:43.688158] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:55.318 02:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:55.318 02:03:43 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:55.318 02:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:55.318 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:27:55.318 02:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:55.318 02:03:43 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:55.318 02:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:55.318 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:27:55.318 02:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:55.318 02:03:43 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:55.318 02:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:55.318 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:27:55.318 [2024-11-19 02:03:43.716403] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:55.318 02:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:55.318 02:03:43 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:55.318 02:03:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:55.318 02:03:43 -- common/autotest_common.sh@10 -- # set +x 00:27:55.318 02:03:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:55.318 02:03:43 -- host/target_disconnect.sh@50 -- # reconnectpid=3566463 00:27:55.318 02:03:43 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:55.318 02:03:43 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:55.318 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.224 02:03:45 -- host/target_disconnect.sh@53 -- # kill -9 3566304 00:27:57.224 02:03:45 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Write completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.224 starting I/O failed 00:27:57.224 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 [2024-11-19 02:03:45.739832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 [2024-11-19 02:03:45.740132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Read completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 Write completed with error (sct=0, sc=8) 00:27:57.225 starting I/O failed 00:27:57.225 [2024-11-19 02:03:45.740441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.225 [2024-11-19 02:03:45.740604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.740735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.740763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.740857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.740982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.741163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.741421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.741633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.741823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.741931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.742074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.742263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.742502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.742709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.742827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.742913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.743109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.743134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.743306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.743416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.225 [2024-11-19 02:03:45.743442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.225 qpair failed and we were unable to recover it. 00:27:57.225 [2024-11-19 02:03:45.743576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.743663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.743700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.743803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.743885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.743916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.744054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.744281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.744506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.744726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.744836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.744960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.745193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.745425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.745650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.745854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.745994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.746110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.746360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.746557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.746769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.746887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.747028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.747255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.747504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.747715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.747836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.747956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.748179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.748428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.748668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.748808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.748897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.749124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.749348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.749668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.749812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.749897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.750005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.750029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.226 qpair failed and we were unable to recover it. 00:27:57.226 [2024-11-19 02:03:45.750146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.750227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.226 [2024-11-19 02:03:45.750254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.750368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.750482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.750507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.750621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.750717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.750743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.750864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.750941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.750966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.751070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.751382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.751663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.751869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.751985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.752098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.752181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.752205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.752302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.752392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.752417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.752690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.752834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.752859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.752976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.753224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.753475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.753686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.753827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.753951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.754172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.754399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.754646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.754882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.754987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.755072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.755398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.755631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.755820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.755958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.756044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.756302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.756585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.756798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.756958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.757071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.757180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.757204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.227 qpair failed and we were unable to recover it. 00:27:57.227 [2024-11-19 02:03:45.757326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.227 [2024-11-19 02:03:45.757492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.757516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.757604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.757699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.757724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.757821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.757928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.757952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.758057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.758167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.758190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.758369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.758447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.758472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.758615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.758742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.758767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.758891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.758997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.759108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.759337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.759570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.759786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.759894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.760005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.760273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.760509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.760774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.760892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.761035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.761225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.761449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.761768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.761903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.761983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.762233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.762520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.762763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.762900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.763015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.763252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.763527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.763756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.763859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.228 qpair failed and we were unable to recover it. 00:27:57.228 [2024-11-19 02:03:45.763969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.764064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.228 [2024-11-19 02:03:45.764088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.764200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.764317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.764341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.764425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.764533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.764558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.764661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.764755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.764779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.764869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.764986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.765141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.765396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.765662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.765880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.765990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.766100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.766313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.766550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.766799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.766905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.767060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.767310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.767504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.767768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.229 [2024-11-19 02:03:45.767913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.229 qpair failed and we were unable to recover it. 00:27:57.229 [2024-11-19 02:03:45.767994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-19 02:03:45.768181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-19 02:03:45.768454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-19 02:03:45.768803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-19 02:03:45.768972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-19 02:03:45.769119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.769257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.769299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.769388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.769478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.769504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.769601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.769733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.769760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.769876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.770153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.770441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.770675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.770812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.770894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.771146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.771422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.771718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.771858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.771972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.772235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.772511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.772750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.772871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.772994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.773288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.773501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.773788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.773959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.774072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.774213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.774238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.774360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.774443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.774468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.774587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.774729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.774754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.774910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.775196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.775432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.775694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.775883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.775995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.776143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.776168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.526 [2024-11-19 02:03:45.776287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.776399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.526 [2024-11-19 02:03:45.776424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.526 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.776534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.776652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.776677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.776804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.776894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.776918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.777063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.777166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.777202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.777333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.777491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.777519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.777655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.777792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.777819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.777907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.778160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.778468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.778702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.778818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.779001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.779118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.779142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.779280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.779397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.779427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Read completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 Write completed with error (sct=0, sc=8) 00:27:57.527 starting I/O failed 00:27:57.527 [2024-11-19 02:03:45.779745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:57.527 [2024-11-19 02:03:45.779836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.779965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.779993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.780120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.780330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.780586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.780859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.780972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.781111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.781319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.781602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.781798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.527 [2024-11-19 02:03:45.781908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.527 qpair failed and we were unable to recover it. 00:27:57.527 [2024-11-19 02:03:45.782019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.782291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.782514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.782762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.782862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.783005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.783287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.783484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.783720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.783883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.783973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.784194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.784377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.784609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.784843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.784948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.785025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.785332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.785614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.785808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.785972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.786085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.786327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.786522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.786756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.786889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.786994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.787262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.787532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.787802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.787962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.788104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.788331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.788529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.528 [2024-11-19 02:03:45.788753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.528 [2024-11-19 02:03:45.788851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.528 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.788967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.789230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.789462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.789696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.789832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.789951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.790144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.790376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.790601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.790826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.790968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.791111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.791334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.791522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.791783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.791949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.792070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.792325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.792574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.792829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.792971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.793058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.793278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.793559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.793789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.793929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.794042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.794298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.794534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.794791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.794925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.795040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.795126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.795150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.795259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.795372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.795397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.795537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.795652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.795682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.529 qpair failed and we were unable to recover it. 00:27:57.529 [2024-11-19 02:03:45.795802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.529 [2024-11-19 02:03:45.795933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.795960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.796070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.796211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.796235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.796384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.796508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.796535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.796706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.796795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.796821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.796901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.797117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.797301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.797578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.797834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.797938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.798065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.798200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.798224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.798339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.798457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.798482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.798601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.798709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.798737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.798872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.799133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.799382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.799631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.799813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.799931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.800182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.800459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.800688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.800798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.800923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.801151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.801389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.801568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.530 qpair failed and we were unable to recover it. 00:27:57.530 [2024-11-19 02:03:45.801858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.801985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.530 [2024-11-19 02:03:45.802013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.802151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.802340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.802558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.802848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.802959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.803051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.803245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.803468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.803722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.803838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.803932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.804212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.804430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.804702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.804839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.804948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.805165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.805414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.805703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.805839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.805955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.806141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.806329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.806564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.806787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.806890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.806970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.807211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.807481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.807722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.807866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.808008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.808100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.808129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.808216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.808330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.808355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.531 [2024-11-19 02:03:45.808433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.808546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.531 [2024-11-19 02:03:45.808571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.531 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.808648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.808781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.808808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.808907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.809196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.809404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.809632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.809750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.809865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.810169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.810400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.810656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.810766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.810886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.811144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.811393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.811688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.811804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.811955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.812188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.812431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.812672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.812822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.812927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.813142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.813491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.813748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.813911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.814056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.814264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.814478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.814746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.814858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.814945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.815155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.815367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.532 qpair failed and we were unable to recover it. 00:27:57.532 [2024-11-19 02:03:45.815610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.532 [2024-11-19 02:03:45.815785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.815892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.815975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.815999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.816139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.816265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.816293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.816378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.816499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.816526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.816618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.816756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.816781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.816922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.817188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.817406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.817721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.817874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.817993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.818210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.818480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.818701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.818837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.818913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.819159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.819408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.819691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.819820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.819939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.820157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.820444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.820719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.820847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.820932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.821257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.821490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.821816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.821956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.822062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.822326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.822568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.822836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.822973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.533 qpair failed and we were unable to recover it. 00:27:57.533 [2024-11-19 02:03:45.823056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.533 [2024-11-19 02:03:45.823164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.823188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.823325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.823418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.823450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.823590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.823728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.823753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.823881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.824118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.824383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.824696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.824854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.824980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.825063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.825103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.825250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.825395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.825419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.825565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.825725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.825750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.825925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.826174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.826438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.826712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.826889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.826970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.827251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.827566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.827816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.827923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.828036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.828144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.828169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.828298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.828421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.828448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.828585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.828730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.828755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.828890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.828988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.829029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.829151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.829265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.829289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.829401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.829508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.829532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.829678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.829843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.829868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.829954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.830078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.830105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.830208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.830290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.830316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.830475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.830599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.830623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.830831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.830977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.534 [2024-11-19 02:03:45.831002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.534 qpair failed and we were unable to recover it. 00:27:57.534 [2024-11-19 02:03:45.831093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.831344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.831521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.831830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.831966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.832079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.832306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.832570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.832836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.832954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.833039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.833268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.833454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.833659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.833880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.833999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.834138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.834366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.834573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.834821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.834956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.835036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.835257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.835509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.835787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.835922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.836008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.836230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.836410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.535 [2024-11-19 02:03:45.836649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.535 [2024-11-19 02:03:45.836801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.535 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.836915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.836995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.837133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.837341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.837554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.837750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.837887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.838012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.838213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.838434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.838650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.838758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.838884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.839162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.839388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.839568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.839787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.839927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.840048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.840254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.840438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.840687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.840884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.840991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.841100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.841307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.841553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.841773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.841933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.842021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.842230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.842448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.842691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.842878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.842991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.536 qpair failed and we were unable to recover it. 00:27:57.536 [2024-11-19 02:03:45.843080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.536 [2024-11-19 02:03:45.843198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.843222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.843348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.843532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.843580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.843709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.843827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.843853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.843992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.844360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.844587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.844831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.844979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.845089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.845208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.845233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.845378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.845494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.845520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.845632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.845751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.845776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.845869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.846132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.846450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.846729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.846872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.847002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.847247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.847519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.847787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.847905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.848047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.848132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.848157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.848307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.848422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.848449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.848578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.848763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.848788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.848910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.849179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.849444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.849694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.849804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.849893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.850146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.850358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.850575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.537 [2024-11-19 02:03:45.850733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.537 qpair failed and we were unable to recover it. 00:27:57.537 [2024-11-19 02:03:45.850814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.850904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.850947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.851070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.851152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.851179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.851323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.851446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.851479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.851617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.851735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.851760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.851915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.852142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.852417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.852713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.852829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.852950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.853234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.853484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.853754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.853864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.853977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.854205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.854490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.854776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.854926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.855023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.855316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.855563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.855826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.855944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.856037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.856316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.856549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.856812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.856933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.857032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.857215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.857432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.857656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.857828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.538 qpair failed and we were unable to recover it. 00:27:57.538 [2024-11-19 02:03:45.857917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.858029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.538 [2024-11-19 02:03:45.858071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.858181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.858372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.858619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.858840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.858948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.859036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.859272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.859526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.859752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.859893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.859977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.860207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.860397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.860658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.860837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.860922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.861184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.861396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.861675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.861843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.861992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.862237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.862469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.862697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.862815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.862900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.863130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.863353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.863624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.539 [2024-11-19 02:03:45.863855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.539 [2024-11-19 02:03:45.863989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.539 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.864074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.864332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.864548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.864757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.864897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.865041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.865184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.865208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.865349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.865462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.865487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.865627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.865744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.865769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.865883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.866198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.866467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.866771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.866873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.866959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.867158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.867437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.867732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.867867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.867973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.868227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.868511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.868708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.868807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.868939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.869189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.869400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.869645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.869802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.869909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.870126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.870448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.870693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.870831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.870974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.871086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.871112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.540 qpair failed and we were unable to recover it. 00:27:57.540 [2024-11-19 02:03:45.871212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.540 [2024-11-19 02:03:45.871333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.871361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.871464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.871538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.871562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.871692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.871811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.871836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.871922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.872192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.872447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.872693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.872826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.872949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.873176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.873439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.873669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.873783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.873945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.874163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.874382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.874593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.874825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.874927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.875001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.875222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.875550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.875803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.875977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.876060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.876303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.876565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.876798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.876945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.877034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.877309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.877595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.877838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.877969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.878080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.878217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.878240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.541 qpair failed and we were unable to recover it. 00:27:57.541 [2024-11-19 02:03:45.878396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.541 [2024-11-19 02:03:45.878494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.878520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.878625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.878784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.878812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.878978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.879223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.879495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.879823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.879978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.880092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.880212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.880252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.880394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.880559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.880586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.880694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.880809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.880833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.880924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.881231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.881522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.881834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.881956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.882054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.882309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.882596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.882821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.882945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.883055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.883296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.883529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.883792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.883927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.884044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.884178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.884206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.884328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.884453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.884479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.884677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.884784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.884808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.884958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.885251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.885503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.885716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.885877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.542 [2024-11-19 02:03:45.885968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.886129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.542 [2024-11-19 02:03:45.886152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.542 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.886294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.886435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.886459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.886543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.886625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.886682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.886800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.886879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.886903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.887060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.887280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.887529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.887761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.887897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.888010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.888310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.888573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.888810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.888930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.889045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.889295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.889537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.889766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.889870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.889976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.890243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.890527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.890785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.890950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.891089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.891369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.891672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.891875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.891984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.892077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.892296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.892569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.892791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.892904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.893045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.893129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.893153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.543 qpair failed and we were unable to recover it. 00:27:57.543 [2024-11-19 02:03:45.893228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.543 [2024-11-19 02:03:45.893350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.893374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.893457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.893559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.893583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.893730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.893810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.893834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.893980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.894196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.894388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.894630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.894834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.894940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.895050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.895307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.895560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.895767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.895904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.896015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.896232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.896445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.896665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.896851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.896990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.897122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.897402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.897620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.897872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.897982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.898101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.898313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.898498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.898749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.898854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.544 qpair failed and we were unable to recover it. 00:27:57.544 [2024-11-19 02:03:45.898972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.544 [2024-11-19 02:03:45.899064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.899088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.899211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.899324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.899348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.899432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.899510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.899551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.899698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.899810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.899834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.899954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.900188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.900468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.900727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.900865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.900940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.901189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.901458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.901690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.901903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.901986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.902133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.902383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.902609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.902837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.902971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.903079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.903289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.903515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.903785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.903906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.904000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.904246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.904461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.904692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.904856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.904963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.905211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.905410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.905622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.545 [2024-11-19 02:03:45.905794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.545 qpair failed and we were unable to recover it. 00:27:57.545 [2024-11-19 02:03:45.905891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.905988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.906091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.906334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.906550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.906773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.906893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.906981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.907175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.907406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.907669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.907771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.907881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.908106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.908323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.908508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.908770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.908875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.908981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.909200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.909473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.909712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.909852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.909977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.910204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.910468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.910720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.910834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.910992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.911222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.911534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.911737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.911884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.911973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.912088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.912115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.912268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.912410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.912437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.546 qpair failed and we were unable to recover it. 00:27:57.546 [2024-11-19 02:03:45.912570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.912715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.546 [2024-11-19 02:03:45.912740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.912875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.913173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.913381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.913643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.913781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.913915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.914215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.914463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.914757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.914899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.914983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.915238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.915459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.915716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.915847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.915982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.916153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.916178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.916291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.916463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.916487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.916623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.916762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.916787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.916896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.917187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.917512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.917769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.917916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.918044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.918229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.918432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.918722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.918865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.919023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.919220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.919521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.919790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.919974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.920105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.920241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.920265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.547 qpair failed and we were unable to recover it. 00:27:57.547 [2024-11-19 02:03:45.920370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.547 [2024-11-19 02:03:45.920495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.920522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.920617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.920752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.920780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.920943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.921183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.921436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.921670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.921819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.921934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.922153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.922370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.922604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.922827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.922947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.923057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.923287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.923514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.923792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.923901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.923991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.924252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.924498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.924770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.924906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.925033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.925270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.925493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.925791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.925930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.926013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.926151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.926175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.926313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.926436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.926463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.548 qpair failed and we were unable to recover it. 00:27:57.548 [2024-11-19 02:03:45.926613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.548 [2024-11-19 02:03:45.926701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.926726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.926833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.926912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.926936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.927068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.927206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.927231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.927380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.927503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.927530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.927659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.927772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.927796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.927928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.928177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.928431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.928720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.928851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.929002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.929305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.929528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.929827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.929990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.930116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.930239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.930266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.930368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.930462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.930486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.930608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.930778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.930803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.930897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.931125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.931417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.931674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.931810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.931899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.932207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.932508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.932734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.932852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.932963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.933264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.933509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.933740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.933867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.933975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.934062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.549 [2024-11-19 02:03:45.934089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.549 qpair failed and we were unable to recover it. 00:27:57.549 [2024-11-19 02:03:45.934185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.934300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.934327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.934433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.934537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.934560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.934692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.934767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.934791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.934930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.935113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.935356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.935600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.935862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.935984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.936147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.936347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.936618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.936876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.936981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.937135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.937326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.937570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.937823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.937960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.938063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.938194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.938221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.938326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.938411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.938436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.938596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.938740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.938765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.938897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.938981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.939098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.939354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.939610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.939869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.939983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.940007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.940147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.940230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.940254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.940364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.940501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.940525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.940644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.940814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.940839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.940960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.941097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.550 [2024-11-19 02:03:45.941124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.550 qpair failed and we were unable to recover it. 00:27:57.550 [2024-11-19 02:03:45.941215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.941341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.941367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.941504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.941610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.941634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.941798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.941913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.941936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.942046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.942186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.942210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.942333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.942442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.942484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.942651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.942737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.942763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.942923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.943173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.943440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.943735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.943879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.944016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.944138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.944179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.944327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.944451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.944492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.944606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.944746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.944774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.944908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.945145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.945420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.945619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.945789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.945895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.946189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.946480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.946707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.946852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.946997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.947263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.947548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.947820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.947965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.948071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.948179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.948203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.948291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.948427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.948454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.948591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.948748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.948776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.551 [2024-11-19 02:03:45.948903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.949060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.551 [2024-11-19 02:03:45.949083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.551 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.949204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.949287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.949311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.949397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.949551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.949578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.949675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.949806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.949832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.949959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.950184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.950470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.950763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.950903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.950994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.951250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.951496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.951758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.951910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.952009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.952263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.952557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.952837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.952991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.953114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.953235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.953261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.953436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.953526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.953550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.953663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.953804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.953828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.953942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.954196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.954476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.954783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.954930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.955073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.955195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.955221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.955315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.955440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.955467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.955607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.955738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.955762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.955903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.956145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.956483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.552 qpair failed and we were unable to recover it. 00:27:57.552 [2024-11-19 02:03:45.956772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.552 [2024-11-19 02:03:45.956883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.956973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.957200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.957479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.957760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.957901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.958030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.958166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.958190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.958277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.958432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.958457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.958618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.958777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.958804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.958915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.959134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.959355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.959595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.959829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.959945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.960060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.960313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.960533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.960828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.960964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.961065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.961195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.961218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.961328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.961474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.961500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.553 qpair failed and we were unable to recover it. 00:27:57.553 [2024-11-19 02:03:45.961585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.961693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.553 [2024-11-19 02:03:45.961718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.961826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.961918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.961941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.962065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.962198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.962221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.962310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.962447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.962486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.962618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.962756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.962783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.962924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.963156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.963382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.963622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.963770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.963898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.964152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.964374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.964600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.964796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.964934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.965033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.965287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.965491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.965814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.965979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.966085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.966341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.966602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.966880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.966993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.967110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.967219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.967261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.967414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.967536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.967563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.967693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.967819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.967846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.967983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.968062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.968087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.554 [2024-11-19 02:03:45.968187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.968266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.554 [2024-11-19 02:03:45.968289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.554 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.968379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.968488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.968512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.968626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.968711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.968735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.968827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.968905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.968928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.969047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.969177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.969204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.969356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.969481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.969508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.969649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.969732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.969756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.969894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.970222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.970521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.970740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.970885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.970993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.971221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.971426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.971679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.971830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.971937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.972164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.972406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.972688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.972808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.972923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.973209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.973462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.973771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.973948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.974072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.974337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.974562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.974816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.974965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.975078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.975190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.975214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.555 qpair failed and we were unable to recover it. 00:27:57.555 [2024-11-19 02:03:45.975293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.975442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.555 [2024-11-19 02:03:45.975473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.975595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.975756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.975784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.975922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.976147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.976425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.976669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.976819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.976935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.977195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.977462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.977703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.977858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.977959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.978250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.978487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.978842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.978962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.979090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.979239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.979266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.979376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.979488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.979513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.979625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.979784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.979809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.979919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.980134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.980431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.980646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.980832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.980933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.981057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.981084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.981219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.981362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.556 [2024-11-19 02:03:45.981386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.556 qpair failed and we were unable to recover it. 00:27:57.556 [2024-11-19 02:03:45.981471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.981558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.981582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.981680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.981794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.981820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.981962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.982181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.982443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.982625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.982791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.982948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.983222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.983480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.983720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.983883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.983969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.984262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.984578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.984814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.984917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.984996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.985222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.985470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.985671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.985801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.985909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.986186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.986436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.986709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.986817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.986902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.987226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.987453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.987708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.987811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.987929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.988035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.988075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.988213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.988303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.988326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.557 [2024-11-19 02:03:45.988444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.988583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.557 [2024-11-19 02:03:45.988611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.557 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.988774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.988855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.988878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.988992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.989245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.989509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.989796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.989937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.990080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.990365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.990568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.990797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.990895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.991037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.991227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.991457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.991660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.991825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.991942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.992200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.992458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.992707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.992835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.992933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.993034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.558 [2024-11-19 02:03:45.993064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.558 qpair failed and we were unable to recover it. 00:27:57.558 [2024-11-19 02:03:45.993165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.993406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.993665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.993871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.993987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.994129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.994397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.994593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.994798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.994960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.995093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.995359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.995553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.995755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.995874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.995968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.996236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.996449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.996671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.996842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.996982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.997174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.997425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.997614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.997828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.997962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.998106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.998247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.998271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.998363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.998449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.998474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.998587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.998769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.998798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.998928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.999022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.999050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.999194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.999300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.999323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.999448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.999542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.999566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.559 qpair failed and we were unable to recover it. 00:27:57.559 [2024-11-19 02:03:45.999662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.559 [2024-11-19 02:03:45.999775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:45.999798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:45.999878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.000125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.000351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.000612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.000736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.000888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.001187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.001455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.001655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.001794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.001886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.002168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.002433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.002682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.002829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.002925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.003217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.003420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.003666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.003896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.003998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.004086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.004329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.004585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.004833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.004978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.005100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.005308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.005563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.560 qpair failed and we were unable to recover it. 00:27:57.560 [2024-11-19 02:03:46.005773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.560 [2024-11-19 02:03:46.005907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.006001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.006228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.006452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.006812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.006999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.007143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.007339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.007541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.007787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.007919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.007997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.008198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.008403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.008677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.008832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.008993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.009224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.009429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.009662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.009807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.009922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.010134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.010408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.010681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.010830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.010973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.011201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.011438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.011669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.561 [2024-11-19 02:03:46.011785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.561 qpair failed and we were unable to recover it. 00:27:57.561 [2024-11-19 02:03:46.011880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.011994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.012019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.012129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.012236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.012270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.012407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.012537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.012565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.012673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.012808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.012836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.012968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.013176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.013371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.013595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.013818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.013919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.014036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.014264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.014528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.014796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.014927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.015016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.015239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.015433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.015631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.015803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.015919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.016182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.016453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.016756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.016866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.016965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.017199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.017412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.017606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.017842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.017989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.018075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.018159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.018185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.018310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.018395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.018420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.562 qpair failed and we were unable to recover it. 00:27:57.562 [2024-11-19 02:03:46.018541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.018664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.562 [2024-11-19 02:03:46.018690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.018781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.018898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.018923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.019076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.019281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.019498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.019720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.019856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.019932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.020174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.020398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.020650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.020800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.020896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.021164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.021448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.021700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.021892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.021984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.022146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.022371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.022577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.022837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.022963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.023090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.023291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.023510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.023721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.023837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.023947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.024088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.024118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.563 qpair failed and we were unable to recover it. 00:27:57.563 [2024-11-19 02:03:46.024223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.024362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.563 [2024-11-19 02:03:46.024386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.024512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.024619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.024654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.024779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.024916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.024944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.025069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.025322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.025573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.025811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.025977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.026077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.026316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.026568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.026784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.026951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.027064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.027261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.027517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.027723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.027826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.027918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.028119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.028355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.028578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.028832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.028959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.029097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.029284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.029511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.029761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.029933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.030076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.030316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.030545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.030767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.030872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.030960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.031049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.031074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.564 qpair failed and we were unable to recover it. 00:27:57.564 [2024-11-19 02:03:46.031164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.564 [2024-11-19 02:03:46.031242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.031266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.031349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.031433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.031458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.031578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.031666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.031691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.031780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.031892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.031916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.032034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.032319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.032617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.032875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.032995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.033116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.033349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.033571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.033803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.033905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.034001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.034243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.034440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.034640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.034869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.034981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.035009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.035213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.035331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.035359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.565 [2024-11-19 02:03:46.035460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.035581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.565 [2024-11-19 02:03:46.035608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.565 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.035731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.035856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.035882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.035972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.036259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.036457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.036667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.036871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.036976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.037083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.037232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.037259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.037380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.037508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.037536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.037678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.037755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.037780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.037894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.038120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.038348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.038555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.038787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.038894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.039017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.039248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.039550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.039784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.039932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.040025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.040143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.040168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-19 02:03:46.040358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-19 02:03:46.040470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.040494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.040577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.040703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.040729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.040821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.040935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.040961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.041045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.041143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.041170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.041367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.041483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.041510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.041664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.041755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.041779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.041973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.042297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.042548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.042852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.042991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.043116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.043249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.043293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.043409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.043512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.043547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.043691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.043809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.043845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.043983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.044086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.044121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.044234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.044364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.044399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.044541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.044650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.044687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.044862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.044993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.045110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.045319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.045553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.045759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.045924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.046061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.046230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.046266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.046407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.046507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.046542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.046680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.046786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.046821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.046966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.047295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.047501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.047798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.047936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-19 02:03:46.048047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.048134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-19 02:03:46.048158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.048265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.048409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.048434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.048532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.048647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.048682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.048793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.048899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.048935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.049079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.049349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.049555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.049789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.049926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.050062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.050223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.050250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.050350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.050515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.050542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.050675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.050775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.050802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.050897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.050999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.051026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.051214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.051332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.051359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.051493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.051611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.051645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.051739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.051823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.051847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.051931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.052160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.052364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.052581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.052832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.052947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.053081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.053303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.053584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.053834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.053963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.054064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.054329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.054557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.054823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.054937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-19 02:03:46.055048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.055167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-19 02:03:46.055192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.055333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.055434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.055461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.055591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.055718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.055743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.055840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.055958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.055982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.056094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.056334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.056562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.056817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.056925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.057058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.057270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.057510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.057787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.057888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.058035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.058282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.058510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.058720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.058867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.058960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.059194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.059432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.059652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.059806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.059901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.060145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.060375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.060696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.060830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.060951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.061164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.061413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.061626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.061860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.061998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-19 02:03:46.062111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-19 02:03:46.062254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.062281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.062413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.062511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.062538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.062677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.062766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.062791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.062892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.062979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.063086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.063350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.063625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.063870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.063981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.064108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.064318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.064543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.064827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.064940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.065061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.065288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.065565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.065788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.065904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.065989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.066243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.066476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.066772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.066909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.066991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.067184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.067400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.067609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-19 02:03:46.067761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-19 02:03:46.067840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.067979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.068106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.068392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.068605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.068849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.068964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.069054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.069286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.069582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.069843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.069950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.070110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.070235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.070263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.070399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.070522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.070547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.070663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.070749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.070773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.070925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.071167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.071394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.071584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.071779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.071893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.072007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.072252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.072520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.072717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.072934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.073021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.073265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.073578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.073838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.073952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.074043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.074120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.074144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.074269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.074380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.074404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.074479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.074568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-19 02:03:46.074593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-19 02:03:46.074711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.074800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.074824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.074917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.075132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.075335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.075581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.075788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.075896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.075978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.076198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.076481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.076719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.076859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.076956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.077212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.077445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.077691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.077827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.077950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.078260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.078546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.078774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.078886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.079004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.079274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.079498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.079735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.079846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.079961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.080178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.080392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.080619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.080824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.080927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.081067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.081179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.081204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-19 02:03:46.081318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.081406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-19 02:03:46.081429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.081526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.081608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.081633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.081731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.081812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.081836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.081926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.082202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.082409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.082619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.082872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.082977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.083096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.083314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.083527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.083749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.083883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.083974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.084194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.084451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.084662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.084811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.084927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.085136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.085370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.085647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.085765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.085877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.086142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.086392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.086652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-19 02:03:46.086849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.086994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-19 02:03:46.087018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.087113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.087231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.087257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.087347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.087457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.087481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.087586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.087745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.087771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.087888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.088213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.088463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.088698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.088889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.088977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.089089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.089300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.089551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.089817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.089956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.090072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.090208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.090236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.090333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.090472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.090500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.090616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.090745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.090771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.090853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.090976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.091127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.091324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.091519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.091784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.091890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.092015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.092260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.092556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.092838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.092946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-19 02:03:46.093040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.093123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-19 02:03:46.093146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.093234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.093325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.093350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.093490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.093566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.093591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.093670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.093754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.093778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.093861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.093991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.094020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.094105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.094228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.094255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.094372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.094450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.094475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.094601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.094739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.094769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.094937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.095199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.095384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.095623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.095852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.095993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.096068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.096290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.096513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.096742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.096858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.096983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.097270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.097461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.097730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.097842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.097931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.098061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.098086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.098175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.098273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.098298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-19 02:03:46.098374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.098486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-19 02:03:46.098511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.098611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.098740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.098768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.098868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.098962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.098989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.099099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.099216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.099241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.099384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.099508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.099535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.099664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.099783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.099810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.099950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.100196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.100431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.100653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.100863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.100998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.101107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.101307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.101606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.101867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.101969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.102085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.102163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.102187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.102283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.102379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.102405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-19 02:03:46.102492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.102569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-19 02:03:46.102593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.102687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.102798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.102828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.102957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.103156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.103403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.103644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.103891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.103997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.104021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.104111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.104199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.104225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.104342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.104454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.104479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.104575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.104721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.104751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.104879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.105130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.105356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.105613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.105817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.105959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.106034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.106268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.106484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.106752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.106856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.106948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.107153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.107387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.107643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.107838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.107945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.108037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.108266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.108527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.108729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.108837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.108962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.109066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.109091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-19 02:03:46.109181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-19 02:03:46.109306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.109337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.109428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.109511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.109537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.109653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.109783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.109809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.109927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.110141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.110376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.110652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.110881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.110991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.111089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.111333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.111583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.111850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.111957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.112045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.112265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.112474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.112686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.112832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.112954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.113153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.113392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.113661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.113827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.113973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.114286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.114520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.114723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.114851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-19 02:03:46.114940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.115052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-19 02:03:46.115078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.115197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.115419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.115647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.115837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.115976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.116078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.116284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.116503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.116714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.116840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.116943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.117163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.117400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.117622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.117741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.117863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.118205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.118444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.118695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.118822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.118926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.119194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.119419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.119668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.119866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.119973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.120060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.120278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.120505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.120752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-19 02:03:46.120880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-19 02:03:46.120974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.121186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.121377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.121646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.121847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.121962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.122091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.122392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.122645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.122844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.122964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.123049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.123291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.123498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.123708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.123820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.123940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.124156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.124352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.124605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.124803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.124901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.125005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.125204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.125465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.125717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.125851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.125963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.126180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.126391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.126678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.126809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.126895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.127012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.127041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.127177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.127262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.127288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-19 02:03:46.127374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.127489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-19 02:03:46.127515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.127633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.127722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.127748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.127859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.127971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.127995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.128112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.128229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.128254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.128346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.128502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.128528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.128672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.128771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.128799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.128885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.128985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.129141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.129345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.129559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.129802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.129911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.130034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.130252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.130446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.130692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.130795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.130877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.131005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.131030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.131152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.131233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.131259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.131376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.131491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.872 [2024-11-19 02:03:46.131515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.872 qpair failed and we were unable to recover it. 00:27:57.872 [2024-11-19 02:03:46.131641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.131755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.131779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.131866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.131986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.132105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.132324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.132578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.132864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.132983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.133080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.133277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.133473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.133697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.133896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.133995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.134130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.134317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.134549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.134794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.134988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.135136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.135375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.135604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.135871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.135983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.136070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.136302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.136493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.136716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.136901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.136987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.137011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.137156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.137269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.137294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.137405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.137485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.137509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.873 qpair failed and we were unable to recover it. 00:27:57.873 [2024-11-19 02:03:46.137649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.873 [2024-11-19 02:03:46.137768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.137802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.137928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1510600 is same with the state(5) to be set 00:27:57.874 [2024-11-19 02:03:46.138138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.138260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.138293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.138431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.138519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.138545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.138712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.138810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.138838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.138929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.139228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.139481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.139753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.139898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.140026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.140271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.140532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.140792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.140910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.141039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.141303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.141571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.141840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.141949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.142035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.142225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.142508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.142769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.142930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.143076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.143318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.143547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.143743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.143863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.143990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.144226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.144483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.874 qpair failed and we were unable to recover it. 00:27:57.874 [2024-11-19 02:03:46.144777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.874 [2024-11-19 02:03:46.144880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.144995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.145229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.145477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.145783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.145925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.146017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.146135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.146160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.146331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.146418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.146446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.146579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.146704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.146734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.146873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.146985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.147010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.147111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.147234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.147262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.147393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.147507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.147532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.147658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.147751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.147777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.147887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.148124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.148369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.148590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.148827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.148995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.149103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.149383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.149612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.149841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.149979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.150097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.150180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.150207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.150319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.150415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.150443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.150577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.150697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.150727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.150900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.151209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.151452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.151711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.151850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.875 [2024-11-19 02:03:46.151980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.152149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.875 [2024-11-19 02:03:46.152177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.875 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.152337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.152470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.152499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.152609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.152702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.152727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.152821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.152953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.152983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.153075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.153203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.153231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.153336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.153421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.153446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.153597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.153740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.153770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.153866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.153974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.154101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.154327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.154590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.154856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.154980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.155005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.155106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.155226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.155254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.155380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.155474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.155501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.155702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.155817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.155842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.155924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.156197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.156451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.156685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.156820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.156945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.157279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.157488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.157745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.157858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.157964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.158153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.158442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.158706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.158853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.158992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.159121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.159148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.159274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.159361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.159388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.876 qpair failed and we were unable to recover it. 00:27:57.876 [2024-11-19 02:03:46.159500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.876 [2024-11-19 02:03:46.159649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.159674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.159794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.159891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.159916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.160005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.160277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.160471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.160775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.160914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.161039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.161312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.161585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.161831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.161947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.162035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.162344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.162616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.162829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.162935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.163087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.163246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.163273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.163417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.163500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.163524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.163657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.163788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.163813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.163926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.164191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.164447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.164705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.164845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.164938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.165053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.165080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.165236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.165329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.165357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.165492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.165577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.165602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.877 qpair failed and we were unable to recover it. 00:27:57.877 [2024-11-19 02:03:46.165716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.877 [2024-11-19 02:03:46.165796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.165821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.165911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.166175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.166433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.166749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.166901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.167001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.167256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.167464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.167756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.167858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.167945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.168188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.168414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.168673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.168807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.168954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.169236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.169488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.169730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.169871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.169952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.170185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.170404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.170730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.170905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.171020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.171207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.171407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.171665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.171802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.171969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.172211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.172531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.878 qpair failed and we were unable to recover it. 00:27:57.878 [2024-11-19 02:03:46.172783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.878 [2024-11-19 02:03:46.172896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.173012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.173214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.173415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.173675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.173816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.173930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.174163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.174382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.174602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.174839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.174953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.175038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.175294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.175505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.175816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.175976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.176111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.176225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.176250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.176366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.176482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.176506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.176622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.176717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.176742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.176863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.176986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.177123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.177344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.177609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.177858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.177979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.178120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.178356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.178549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.178806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.178943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.179028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.179134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.179158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.179268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.179408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.179432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.879 [2024-11-19 02:03:46.179518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.179628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.879 [2024-11-19 02:03:46.179660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.879 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.179747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.179826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.179850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.179934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.180189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.180477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.180774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.180885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.181018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.181210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.181445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.181679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.181901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.181988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.182100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.182340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.182641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.182853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.182995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.183106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.183326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.183532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.183750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.183866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.183972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.184225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.184488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.184706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.184817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.184943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.185143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.185346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.185632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.185871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.185988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.186012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.186105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.186194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.186218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.880 qpair failed and we were unable to recover it. 00:27:57.880 [2024-11-19 02:03:46.186298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.880 [2024-11-19 02:03:46.186414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.186441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.186532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.186670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.186696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.186778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.186862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.186886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.186970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.187202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.187469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.187706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.187818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.187938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.188133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.188367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.188612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.188861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.188980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.189063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.189283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.189481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.189741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.189851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.189935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.190160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.190479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.190753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.190887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.190966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.191192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.191404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.191621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.191862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.881 [2024-11-19 02:03:46.191974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.881 qpair failed and we were unable to recover it. 00:27:57.881 [2024-11-19 02:03:46.192058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.192168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.192192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.192305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.192415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.192440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.192542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.192694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.192723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.192850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.192973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.193137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.193342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.193557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.193812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.193913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.194025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.194216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.194436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.194626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.194777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.194887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.195167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.195390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.195631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.195868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.195972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.196122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.196316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.196584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.196827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.196988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.197123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.197349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.197571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.197846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.197955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.198105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.198190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.198216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.198305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.198419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.198446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.198603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.198736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.198764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.882 qpair failed and we were unable to recover it. 00:27:57.882 [2024-11-19 02:03:46.198935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.882 [2024-11-19 02:03:46.199036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.199179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.199424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.199663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.199866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.199991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.200078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.200270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.200455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.200712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.200905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.200992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.201104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.201378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.201614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.201846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.201980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.202007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.202129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.202280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.202307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.202472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.202564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.202593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.202745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.202828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.202857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.203023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.203256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.203499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.203763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.203909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.204028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.204219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.204487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.204804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.204917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.205063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.205150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.205191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.205319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.205421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.205451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.883 [2024-11-19 02:03:46.205571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.205708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.883 [2024-11-19 02:03:46.205734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.883 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.205864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.205989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.206116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.206383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.206613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.206867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.206986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.207138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.207366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.207629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.207905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.207988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.208021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.208135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.208278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.208305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.208430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.208525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.208552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.208684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.208762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.208787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.208921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.209154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.209408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.209696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.209817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.209913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.210165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.210419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.210647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.210813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.210895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.211150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.211374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.211694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.211805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.211938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.212158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.212437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.212659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.212797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.884 qpair failed and we were unable to recover it. 00:27:57.884 [2024-11-19 02:03:46.212892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.884 [2024-11-19 02:03:46.213027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.213053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.213195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.213351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.213376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.213490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.213649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.213678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.213801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.213922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.213950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.214090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.214201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.214225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.214389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.214479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.214508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.214602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.214748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.214773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.214888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.215155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.215423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.215730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.215901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.216033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.216288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.216561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.216817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.216923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.217061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.217365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.217602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.217829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.217976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.218109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.218253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.218278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.218449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.218533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.218560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.218670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.218827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.218854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.218990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.219266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.219475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.219777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.219922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.220016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.220152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.220179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.220313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.220393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.220418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-11-19 02:03:46.220533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.220616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.885 [2024-11-19 02:03:46.220649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.220760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.220856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.220884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.221052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.221286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.221522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.221805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.221926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.222041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.222284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.222527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.222846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.222947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.223078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.223229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.223256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.223414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.223569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.223596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.223712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.223798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.223822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.223926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.224197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.224550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.224749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.224859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.224943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.225268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.225539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.225779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.225920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.226035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.226225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.226473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.226678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.226814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-11-19 02:03:46.226963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.886 [2024-11-19 02:03:46.227044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.227087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.227221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.227340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.227367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.227512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.227601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.227625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.227766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.227902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.227928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.228022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.228294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.228507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.228812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.228960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.229108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.229348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.229602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.229838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.229980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.230064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.230303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.230565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.230788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.230916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.231010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.231303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.231512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.231799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.231956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.232136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.232277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.232320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.232447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.232567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.232594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.232725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.232868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.232893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.233035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.233301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.233547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.233830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.233968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.234082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.234174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.234200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.887 [2024-11-19 02:03:46.234296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.234393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.887 [2024-11-19 02:03:46.234420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.887 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.234552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.234666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.234692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.234858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.234986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.235094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.235359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.235549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.235800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.235921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.236052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.236301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.236570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.236827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.236973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.237086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.237259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.237284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.237399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.237514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.237556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.237650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.237767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.237791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.237874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.237974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.238018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.238143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.238251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.238275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.238386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.238492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.238516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.238647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.238799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.238824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.238918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.239239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.239484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.239699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.239866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.239959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.240160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.240377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.240695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.240799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.240918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.241013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.241038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.241152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.241244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.241268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.241379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.241460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.241485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.888 qpair failed and we were unable to recover it. 00:27:57.888 [2024-11-19 02:03:46.241596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.888 [2024-11-19 02:03:46.241713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.241738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.241831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.241952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.241977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.242059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.242247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.242504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.242717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.242881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.243024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.243300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.243523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.243763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.243870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.243962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.244225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.244455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.244657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.244852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.244986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.245077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.245297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.245492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.245731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.245865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.245975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.246232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.246482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.246723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.246832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.246921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.247163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.247370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.247624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.247881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.247996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.248020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.889 qpair failed and we were unable to recover it. 00:27:57.889 [2024-11-19 02:03:46.248107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.889 [2024-11-19 02:03:46.248220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.248244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.248353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.248467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.248492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.248575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.248708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.248734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.248844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.248933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.248961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.249046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.249263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.249510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.249772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.249889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.250028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.250257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.250476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.250704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.250817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.250937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.251190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.251436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.251666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.251862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.251976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.252093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.252327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.252576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.252794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.252957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.253042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.253296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.253492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.253715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.253881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.253998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.254215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.254524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.890 qpair failed and we were unable to recover it. 00:27:57.890 [2024-11-19 02:03:46.254775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.890 [2024-11-19 02:03:46.254912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.255023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.255261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.255523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.255843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.255964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.256091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.256382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.256564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.256813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.256967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.257090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.257336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.257625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.257857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.257967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.258090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.258337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.258583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.258855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.258977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.259060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.259183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.259209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.259362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.259479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.259504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.259647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.259804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.259828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.259937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.260159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.260412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.260621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.260850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.260968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.891 qpair failed and we were unable to recover it. 00:27:57.891 [2024-11-19 02:03:46.261080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.891 [2024-11-19 02:03:46.261195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.261219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.261315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.261401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.261426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.261586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.261750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.261775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.261889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.262105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.262300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.262519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.262732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.262866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.262978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.263189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.263413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.263702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.263846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.263934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.264166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.264356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.264577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.264810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.264926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.265070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.265273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.265502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.265726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.265840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.265922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.266112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.266303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.266556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.266780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.266887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.266973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.267065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.267090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.267168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.267283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.267307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.892 qpair failed and we were unable to recover it. 00:27:57.892 [2024-11-19 02:03:46.267428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.892 [2024-11-19 02:03:46.267518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.267542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.267662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.267748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.267775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.267884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.267992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.268136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.268365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.268571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.268767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.268880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.269007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.269218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.269410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.269633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.269858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.269974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.270085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.270291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.270495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.270731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.270867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.270988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.271191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.271425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.271626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.271868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.271975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.272063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.272272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.272506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.272721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.272883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.272966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.273243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.273469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.893 [2024-11-19 02:03:46.273712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.893 [2024-11-19 02:03:46.273878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.893 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.273961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.274188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.274490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.274749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.274887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.274978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.275203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.275435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.275658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.275859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.275997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.276111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.276316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.276514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.276745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.276884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.276965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.277209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.277405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.277600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.277828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.277965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.278043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.278284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.278504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.278717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.278831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.278948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.279165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.279423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.279662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.279914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.279998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.280023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.280133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.280273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.280297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.894 qpair failed and we were unable to recover it. 00:27:57.894 [2024-11-19 02:03:46.280375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.894 [2024-11-19 02:03:46.280492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.280517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.280600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.280687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.280712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.280791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.280882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.280906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.280995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.281187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.281401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.281616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.281761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.281905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.282118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.282337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.282590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.282846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.282989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.283109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.283385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.283603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.283880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.283984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.284093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.284349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.284565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.284818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.284956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.285039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.285264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.285462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.285651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.285911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.285990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.895 [2024-11-19 02:03:46.286014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.895 qpair failed and we were unable to recover it. 00:27:57.895 [2024-11-19 02:03:46.286133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.286339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.286537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.286792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.286905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.286995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.287190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.287414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.287619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.287827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.287963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.288052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.288306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.288503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.288739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.288854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.288968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.289233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.289415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.289634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.289864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.289994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.290108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.290359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.290565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.290831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.290978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.291072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.291288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.291500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.291755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.291918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.292026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.292165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.292189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.292278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.292363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.292387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.896 qpair failed and we were unable to recover it. 00:27:57.896 [2024-11-19 02:03:46.292477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.896 [2024-11-19 02:03:46.292591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.292615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.292721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.292796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.292821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.292937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.293162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.293416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.293676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.293890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.293977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.294109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.294365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.294562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.294795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.294913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.294996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.295201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.295450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.295673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.295813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.295962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.296175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.296390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.296595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.296847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.296989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.297082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.297305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.297528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.297762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.297865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.297960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.298190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.298385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.298617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.897 qpair failed and we were unable to recover it. 00:27:57.897 [2024-11-19 02:03:46.298825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.897 [2024-11-19 02:03:46.298958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.299101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.299323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.299541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.299774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.299885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.299974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.300200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.300449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.300681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.300873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.300973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.301080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.301291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.301515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.301740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.301857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.301972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.302208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.302411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.302628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.302859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.302975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.303105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.303299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.303515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.303747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.303885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.303966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.304221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.304413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.304660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.304802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.304884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.305027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.305051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.305132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.305243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.898 [2024-11-19 02:03:46.305267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.898 qpair failed and we were unable to recover it. 00:27:57.898 [2024-11-19 02:03:46.305352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.305440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.305464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.305542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.305624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.305656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.305736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.305851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.305875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.306014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.306201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.306409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.306622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.306846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.306960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.307037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.307283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.307486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.307681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.307900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.307983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.308093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.308338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.308560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.308854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.308966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.309069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.309297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.309493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.309727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.309896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.309977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.310227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.310449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.310644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.310875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.310984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.311133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.311216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.311241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.311325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.311466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.311490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.899 qpair failed and we were unable to recover it. 00:27:57.899 [2024-11-19 02:03:46.311598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.899 [2024-11-19 02:03:46.311753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.311779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.311887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.311963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.311987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.312077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.312276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.312538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.312746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.312858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.312978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.313196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.313393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.313609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.313810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.313921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.314032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.314251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.314458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.314688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.314883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.314979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.315119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.315328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.315580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.315768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.315886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.316007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.316226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.316440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.316662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.900 [2024-11-19 02:03:46.316771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.900 qpair failed and we were unable to recover it. 00:27:57.900 [2024-11-19 02:03:46.316888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.316980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.317093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.317314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.317526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.317720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.317859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.317950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.318180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.318378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.318613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.318866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.318995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.319110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.319344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.319561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.319809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.319919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.320006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.320193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.320416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.320624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.320861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.320967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.321080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.321306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.321554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.321768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.321904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.321989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.322180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.322400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.322626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.322828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.322968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.901 qpair failed and we were unable to recover it. 00:27:57.901 [2024-11-19 02:03:46.323049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.901 [2024-11-19 02:03:46.323165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.323189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.323307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.323426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.323451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.323564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.323664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.323690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.323805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.323896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.323922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.324006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.324291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.324486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.324711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.324825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.324918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.325136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.325394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.325656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.325879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.325991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.326107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.326308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.326559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.326784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.326922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.327036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.327290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.327509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.327746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.327885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.327974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.328173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.328387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.328604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.328815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.328952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.329035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.329145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.329170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.329281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.329397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.329422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.902 [2024-11-19 02:03:46.329518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.329606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.902 [2024-11-19 02:03:46.329630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.902 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.329723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.329810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.329836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.329944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.330198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.330394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.330577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.330759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.330873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.330983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.331244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.331470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.331703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.331839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.331929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.332180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.332398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.332621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.332883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.332995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.333136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.333329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.333547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.333771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.333915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.334029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.334255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.334491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.334721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.334829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.334920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.335171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.335421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.335615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.335983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.336008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.903 qpair failed and we were unable to recover it. 00:27:57.903 [2024-11-19 02:03:46.336097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.903 [2024-11-19 02:03:46.336216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.336240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.336326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.336403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.336427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.336537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.336648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.336673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.336757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.336867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.336891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.336974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.337231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.337457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.337724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.337829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.337922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.338148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.338334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.338591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.338815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.338939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.339052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.339254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.339480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.339692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.339807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.339917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.340141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.340396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.340627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.340893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.340982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.341128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.341311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.341601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.904 [2024-11-19 02:03:46.341872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.904 [2024-11-19 02:03:46.341983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.904 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.342071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.342363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.342552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.342814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.342951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.343042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.343258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.343466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.343751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.343857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.343958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.344138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.344340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.344543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.344739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.344877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.344994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.345242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.345471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.345674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.345817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.905 qpair failed and we were unable to recover it. 00:27:57.905 [2024-11-19 02:03:46.345903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.905 [2024-11-19 02:03:46.346013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.346151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.346397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.346617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.346875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.346994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.347111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.347337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.347529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.347754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.347890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.348012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.348214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.348463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.348689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.348915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.348990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.349104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.349344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.349569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.349767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.349909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.350022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.350130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.350153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.906 [2024-11-19 02:03:46.350302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.350442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.906 [2024-11-19 02:03:46.350466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.906 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.350590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.350706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.350737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.350889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.351166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.351475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.351775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.351911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.352005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.352263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.352484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.352727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.352836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.352934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.353195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.353474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.353718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.353860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.353950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.354235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.354460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.354688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.354856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.354990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.355120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.355147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.355344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.355475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.355502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.355624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.355760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.355785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.355929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.356194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.356443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.356743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.356879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.356971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.357055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.907 [2024-11-19 02:03:46.357079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.907 qpair failed and we were unable to recover it. 00:27:57.907 [2024-11-19 02:03:46.357210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.357309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.357335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.357462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.357593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.357617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.357764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.357880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.357904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.358073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.358296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.358535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.358784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.358912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.359044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.359164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.359190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.359318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.359443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.359470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.359604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.359773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.359798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.359936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.360262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.360578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.360800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.360939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.361042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.361370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.361605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.361815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.361980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.362093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.362214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.362241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.362363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.362482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.362509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.362663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.362781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.362805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.362913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.363221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.363503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.908 [2024-11-19 02:03:46.363831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.908 [2024-11-19 02:03:46.363958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.908 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.364087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.364250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.364274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.364359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.364498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.364522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.364625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.364756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.364780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.364896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.365177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.365397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.365663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.365779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.365937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.366254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.366511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.366751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.366898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.366993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.367146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.367173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.367293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.367386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.367413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.367581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.367679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.367714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.367827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.367988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.368139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.368394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.368628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.368851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.368968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.369101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.369242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.369266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.369364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.369502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.369531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.369664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.369799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.369827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:57.909 qpair failed and we were unable to recover it. 00:27:57.909 [2024-11-19 02:03:46.369939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.909 [2024-11-19 02:03:46.370022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.370132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.370365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.370620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.370809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.370915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.371007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.371229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.371467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.371797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.371911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.372064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.372183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.372207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.372332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.372454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.372481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.372573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.372724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.372752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.372852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.372984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.373106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.373302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.373509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.373792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.373936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.213 qpair failed and we were unable to recover it. 00:27:58.213 [2024-11-19 02:03:46.374037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.213 [2024-11-19 02:03:46.374161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.374188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.374354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.374441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.374470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.374585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.374691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.374718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.374822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.374921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.374950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.375090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.375197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.375221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.375321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.375440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.375469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.375568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.375692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.375721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.375835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.375975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.376108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.376357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.376581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.376793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.376960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.377056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.377292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.377505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.377802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.377941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.378056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.378277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.378468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.378742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.378881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.378959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.379184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.379508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.379790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.379950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.380044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.380313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.380533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.380824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.380952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.214 [2024-11-19 02:03:46.381067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.381175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.214 [2024-11-19 02:03:46.381200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.214 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.381288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.381404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.381432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.381518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.381605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.381631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.381746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.381864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.381887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.382017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.382296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.382538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.382760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.382935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.383029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.383238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.383444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.383763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.383934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.384037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.384268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.384530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.384819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.384970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.385094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.385222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.385252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.385354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.385447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.385476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.385643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.385729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.385756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.385883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.385989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.386018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.386147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.386277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.386307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.386419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.386530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.386556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.386656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.386749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.386777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.386878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.387145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.387406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.387665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.387790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.387934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.388050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.388076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.388204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.388331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.215 [2024-11-19 02:03:46.388361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.215 qpair failed and we were unable to recover it. 00:27:58.215 [2024-11-19 02:03:46.388492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.388619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.388659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.388794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.388878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.388904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.389013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.389271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.389545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.389796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.389919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.390045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.390310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.390554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.390828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.390953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.391063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.391168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.391193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.391326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.391458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.391486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.391585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.391710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.391739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.391886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.391976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.392097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.392354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.392607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.392888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.392986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.393013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.393141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.393286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.393311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.393412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.393534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.393561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.393683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.393798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.393823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.393950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.394242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.394493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.394707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.394864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.394997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.395115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.395144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.395269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.395388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.395416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.216 [2024-11-19 02:03:46.395539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.395629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.216 [2024-11-19 02:03:46.395666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.216 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.395774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.395867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.395893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.395983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.396090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.396117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.396208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.396378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.396403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.396524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.396630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.396671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.396821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.396974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.397094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.397360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.397594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.397876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.397993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.398133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.398404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.398617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.398876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.398992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.399016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.399154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.399307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.399335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.399478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.399631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.399665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.399785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.399904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.399929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.400063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.400303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.400525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.400798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.400928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.401030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.401252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.401476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.401761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.401902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.402053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.402168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.402195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.402274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.402369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.217 [2024-11-19 02:03:46.402397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.217 qpair failed and we were unable to recover it. 00:27:58.217 [2024-11-19 02:03:46.402478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.402604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.402631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.402756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.402893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.402918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.403061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.403194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.403222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.403348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.403502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.403530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.403676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.403766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.403791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.403905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.404234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.404450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.404718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.404879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.405019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.405316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.405564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.405830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.405984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.406092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.406354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.406580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.406836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.406942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.407029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.407322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.407545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.407812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.407960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.408080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.408202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.408230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.408386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.408472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.408497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.408588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.408732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.408762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.408897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.409011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.409035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.409125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.409235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.218 [2024-11-19 02:03:46.409259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.218 qpair failed and we were unable to recover it. 00:27:58.218 [2024-11-19 02:03:46.409389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.409474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.409502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.409587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.409714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.409742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.409874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.409988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.410013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.410153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.410242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.410269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.410369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.410461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.410489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.410629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.410776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.410801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.410921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.411259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.411512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.411773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.411898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.412055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.412176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.412204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.412307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.412433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.412458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.412617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.412750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.412780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.412876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.413134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.413421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.413650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.413875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.413986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.414012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.414115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.414242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.414269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.414425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.414523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.414551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.414666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.414749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.414774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.414904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.415151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.415446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.415666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.415833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.415974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.416147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.416172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.416298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.416379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.416404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.416537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.416631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.416668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.219 qpair failed and we were unable to recover it. 00:27:58.219 [2024-11-19 02:03:46.416796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.219 [2024-11-19 02:03:46.416922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.416949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.417127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.417248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.417274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.417415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.417504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.417533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.417669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.417764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.417793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.417930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.418207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.418495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.418783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.418923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.419089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.419215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.419243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.419375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.419528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.419557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.419709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.419825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.419851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.419944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.420204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.420508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.420733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.420860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.420982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.421138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.421166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.421328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.421445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.421470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.421607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.421740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.421768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.421903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.422214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.422463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.422728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.422883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.423023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.423262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.423536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.423799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.423914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.424015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.424147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.424172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.424292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.424378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.424418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.220 [2024-11-19 02:03:46.424560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.424712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.220 [2024-11-19 02:03:46.424738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.220 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.424870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.425211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.425499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.425805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.425955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.426047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.426182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.426207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.426319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.426434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.426460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.426598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.426699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.426728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.426862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.426982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.427118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.427340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.427673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.427892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.427997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.428116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.428398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.428675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.428872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.428999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.429081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.429306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.429492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.429779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.429929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.430066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.430207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.430231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.430365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.430494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.430521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.430627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.430726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.430757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.430897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.431150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.431439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.431704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.431817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.431984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.432152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.432176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.221 qpair failed and we were unable to recover it. 00:27:58.221 [2024-11-19 02:03:46.432318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.221 [2024-11-19 02:03:46.432469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.432509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.432627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.432759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.432784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.432920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.433221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.433495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.433705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.433814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.433937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.434204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.434443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.434757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.434910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.435018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.435277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.435583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.435861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.435978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.436062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.436190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.436218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.436370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.436489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.436516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.436630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.436727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.436752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.436889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.437163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.437387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.437675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.437801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.437935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.438074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.438102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.438194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.438276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.438300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.438407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.438505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.438532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.222 qpair failed and we were unable to recover it. 00:27:58.222 [2024-11-19 02:03:46.438664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.222 [2024-11-19 02:03:46.438752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.438777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.438856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.438941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.438966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.439050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.439269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.439526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.439841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.439953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.440074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.440239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.440265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.440376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.440515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.440543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.440701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.440800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.440824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.440940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.441204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.441463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.441787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.441939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.442074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.442271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.442546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.442826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.442968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.443074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.443350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.443604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.443866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.443998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.444082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.444392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.444634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.444868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.444999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.445166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.445307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.445332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.445484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.445644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.445672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.445804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.445896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.445923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.223 [2024-11-19 02:03:46.446066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.446184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.223 [2024-11-19 02:03:46.446208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.223 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.446385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.446512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.446539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.446644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.446748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.446775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.446883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.446995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.447143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.447378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.447613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.447862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.447977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.448098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.448328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.448518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.448775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.448926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.449027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.449299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.449541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.449828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.449971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.450074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.450172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.450201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.450322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.450455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.450482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.450575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.450679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.450705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.450845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.450976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.451003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.451151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.451268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.451292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.451437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.451548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.451573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.451712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.451843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.451871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.451968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.452249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.452559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.452836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.452970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.453077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.453227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.453251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.453359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.453458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.453485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.224 qpair failed and we were unable to recover it. 00:27:58.224 [2024-11-19 02:03:46.453611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.224 [2024-11-19 02:03:46.453746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.453774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.453885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.454191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.454448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.454752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.454886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.455044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.455293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.455539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.455798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.455953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.456080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.456306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.456535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.456816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.456959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.457073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.457266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.457482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.457681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.457822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.457951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.458218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.458513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.458783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.458919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.459014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.459266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.459515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.459792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.459915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.460020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.460208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.460425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.225 qpair failed and we were unable to recover it. 00:27:58.225 [2024-11-19 02:03:46.460689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.225 [2024-11-19 02:03:46.460824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.460952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.461168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.461427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.461656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.461844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.461945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.462178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.462421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.462650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.462821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.462965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.463179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.463408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.463664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.463778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.463928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.464270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.464493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.464751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.464860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.464982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.465236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.465458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.465749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.465857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.465974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.466177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.466455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.466699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.466891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.466998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.467185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.467287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.467312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.467396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.467503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.467527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.467610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.467716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.467742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.226 qpair failed and we were unable to recover it. 00:27:58.226 [2024-11-19 02:03:46.467829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.226 [2024-11-19 02:03:46.467988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.468016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.468128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.468245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.468270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.468385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.468532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.468559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.468651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.468771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.468799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.468927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.469208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.469457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.469708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.469820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.469984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.470226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.470492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.470686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.470795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.470883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.471207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.471479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.471761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.471875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.471954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.472155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.472380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.472618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.472763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.472878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.473193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.473504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.473797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.473901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.474009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.474133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.474160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.227 [2024-11-19 02:03:46.474274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.474381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.227 [2024-11-19 02:03:46.474406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.227 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.474529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.474662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.474710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.474786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.474867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.474892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.475042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.475148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.475173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.475304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.475464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.475491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.475610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.475758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.475784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.475902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.475981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.476005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.476101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.476184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.476208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.476326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.476463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.476490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.476592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.476706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.476732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.476853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.477163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.477458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.477776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.477943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.478034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.478286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.478489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.478784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.478892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.479031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.479293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.479522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.479743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.479858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.479984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.480230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.480487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.480734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.480878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.481009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.481136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.481163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.481293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.481381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.481405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.481552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.481691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.481719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.228 qpair failed and we were unable to recover it. 00:27:58.228 [2024-11-19 02:03:46.481849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.228 [2024-11-19 02:03:46.482003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.482030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.482157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.482250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.482274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.482401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.482557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.482583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.482742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.482834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.482858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.482977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.483239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.483480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.483730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.483874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.483972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.484236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.484494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.484728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.484869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.485015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.485168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.485195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.485322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.485431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.485455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.485618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.485792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.485817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.485906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.486195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.486474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.486787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.486926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.487082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.487197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.487222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.487304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.487435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.487462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.487593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.487748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.487774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.487895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.488143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.488384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.488633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.488863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.488987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.489015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.489121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.489252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.489277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.229 [2024-11-19 02:03:46.489390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.489475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.229 [2024-11-19 02:03:46.489499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.229 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.489620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.489754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.489779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.489866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.490164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.490414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.490623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.490909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.490996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.491134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.491366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.491628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.491900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.491983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.492101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.492331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.492579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.492783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.492926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.493022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.493251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.493461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.493763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.493871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.493990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.494254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.494463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.494709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.494853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.494983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.495245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.495469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.495743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.495878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.496002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.496094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.496119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.496201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.496291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.496316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.230 qpair failed and we were unable to recover it. 00:27:58.230 [2024-11-19 02:03:46.496401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.230 [2024-11-19 02:03:46.496529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.496554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.496669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.496756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.496781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.496873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.496963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.496988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.497073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.497328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.497575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.497776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.497891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.498034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.498265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.498528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.498764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.498885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.498966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.499177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.499407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.499607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.499815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.499955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.500040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.500264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.500465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.500736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.500876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.500956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.501253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.501466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.501752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.501915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.502028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.502111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.502138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.231 qpair failed and we were unable to recover it. 00:27:58.231 [2024-11-19 02:03:46.502225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.231 [2024-11-19 02:03:46.502305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.502336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.502424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.502545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.502588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.502712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.502802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.502827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.502915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.503134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.503368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.503611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.503873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.503978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.504122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.504405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.504669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.504883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.504997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.505140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.505345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.505554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.505765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.505928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.506014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.506248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.506473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.506742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.506886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.507010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.507213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.507403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.507595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.507864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.507971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.508052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.508281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.508532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.232 qpair failed and we were unable to recover it. 00:27:58.232 [2024-11-19 02:03:46.508770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.232 [2024-11-19 02:03:46.508887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.509002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.509244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.509436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.509661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.509854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.509993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.510077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.510263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.510509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.510743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.510880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.510999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.511223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.511453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.511677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.511781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.511893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.512123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.512350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.512571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.512805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.512913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.513035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.513258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.513477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.513741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.513851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.513950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.514177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.514396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.514623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.514827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.514942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.515030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.515171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.233 [2024-11-19 02:03:46.515196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.233 qpair failed and we were unable to recover it. 00:27:58.233 [2024-11-19 02:03:46.515344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.515491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.515516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.515635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.515771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.515796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.515912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.516156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.516390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.516659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.516847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.516961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.517074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.517331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.517597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.517812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.517955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.518044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.518267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.518522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.518795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.518901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.518994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.519188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.519418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.519673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.519870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.519990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.520105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.520302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.520552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.520788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.520906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.521026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.521315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.521538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.521798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.521935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.234 qpair failed and we were unable to recover it. 00:27:58.234 [2024-11-19 02:03:46.522027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.234 [2024-11-19 02:03:46.522107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.522217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.522442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.522662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.522881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.522994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.523077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.523310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.523547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.523757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.523859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.523972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.524194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.524387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.524611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.524883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.524990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.525104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.525308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.525537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.525748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.525854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.525967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.526192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.526416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.526609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.526841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.526951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.527029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.527303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.527518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.527771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.527888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.527973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.528069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.528093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.235 [2024-11-19 02:03:46.528176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.528260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.235 [2024-11-19 02:03:46.528285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.235 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.528371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.528464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.528488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.528599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.528733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.528759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.528855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.528970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.528995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.529142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.529345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.529538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.529782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.529896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.529978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.530242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.530437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.530622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.530875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.530981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.531065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.531287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.531569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.531844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.531991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.532129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.532259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.532286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.532379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.532516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.532544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.532659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.532745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.532770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.532854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.533165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.533464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.533729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.533845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.533927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.534035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.236 [2024-11-19 02:03:46.534061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.236 qpair failed and we were unable to recover it. 00:27:58.236 [2024-11-19 02:03:46.534141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.534368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.534550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.534776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.534883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.534978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.535229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.535455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.535713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.535823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.535909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.536144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.536414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.536670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.536811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.536898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.537158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.537386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.537597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.537835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.537980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.538093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.538313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.538511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.538723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.538835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.538952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.539184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.539409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.539699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.539895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.539978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.540002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.540090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.540174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.540198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.540315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.540440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.540464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.237 qpair failed and we were unable to recover it. 00:27:58.237 [2024-11-19 02:03:46.540559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.237 [2024-11-19 02:03:46.540643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.540668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.540811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.540897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.540923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.541004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.541233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.541459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.541690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.541896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.541978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.542090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.542289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.542512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.542768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.542909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.543020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.543227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.543475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.543676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.543895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.543982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.544101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.544337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.544557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.544791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.544952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.545040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.545281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.545460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.545660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.545913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.545997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.546104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.546338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.546532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.238 [2024-11-19 02:03:46.546783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.238 [2024-11-19 02:03:46.546919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.238 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.547040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.547261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.547514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.547770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.547875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.547987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.548183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.548427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.548660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.548879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.548994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.549134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.549336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.549573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.549764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.549875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.549965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.550191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.550407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.550626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.550741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.550890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.551143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.551360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.551545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.551758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.551899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.551983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.552202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.552422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.552650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.552842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.552978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.553066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.553151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.553175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.239 qpair failed and we were unable to recover it. 00:27:58.239 [2024-11-19 02:03:46.553264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.239 [2024-11-19 02:03:46.553351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.553376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.553485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.553600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.553624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.553764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.553878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.553902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.553992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.554214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.554495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.554688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.554828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.554915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.555146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.555347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.555550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.555768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.555875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.555958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.556188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.556409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.556595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.556857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.556964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.557048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.557281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.557482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.557782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.557927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.558041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.558289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.558495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.558718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.558827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.558946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.559164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.559422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.240 qpair failed and we were unable to recover it. 00:27:58.240 [2024-11-19 02:03:46.559614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.240 [2024-11-19 02:03:46.559757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.559904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.559989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.560127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.560329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.560587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.560776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.560876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.560989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.561184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.561432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.561647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.561791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.561876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.562109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.562333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.562552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.562757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.562894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.563037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.563268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.563455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.563674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.563812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.563926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.564146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.564401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.564654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.564881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.564993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.565086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.565171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.565194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.241 qpair failed and we were unable to recover it. 00:27:58.241 [2024-11-19 02:03:46.565310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.565421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.241 [2024-11-19 02:03:46.565445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.565535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.565656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.565682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.565774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.565893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.565918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.566057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.566317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.566530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.566722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.566868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.566981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.567193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.567412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.567647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.567848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.567959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.568097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.568347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.568545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.568774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.568938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.569050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.569251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.569445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.569669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.569805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.569922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.570135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.570361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.570579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.570788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.570921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.571014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.571208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.571446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.571706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.571813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.571926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.572036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.572060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.242 qpair failed and we were unable to recover it. 00:27:58.242 [2024-11-19 02:03:46.572148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.242 [2024-11-19 02:03:46.572254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.572277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.572389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.572464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.572487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.572601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.572698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.572722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.572815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.572920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.572943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.573029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.573257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.573484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.573746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.573885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.573972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.574224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.574425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.574649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.574897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.574978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.575091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.575288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.575506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.575748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.575890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.576010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.576225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.576445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.576675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.576780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.576895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.577125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.577354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.577553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.577774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.577886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.578026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.578260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.578455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.578677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.578813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.578897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.579010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.243 [2024-11-19 02:03:46.579034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.243 qpair failed and we were unable to recover it. 00:27:58.243 [2024-11-19 02:03:46.579121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.579206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.579230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.579344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.579453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.579477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.579654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.579775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.579799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.579887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.580163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.580351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.580584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.580834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.580940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.581027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.581260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.581542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.581763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.581882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.581973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.582198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.582450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.582672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.582813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.582904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.583166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.583382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.583602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.583838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.583946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.584029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.584249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.584525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.584762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.584870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.584991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.585218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.585450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.585765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.585903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.586029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.586116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.586142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.244 [2024-11-19 02:03:46.586233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.586344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.244 [2024-11-19 02:03:46.586369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.244 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.586482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.586568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.586594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.586721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.586833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.586858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.586945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.587168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.587421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.587691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.587807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.587887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.588169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.588423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.588688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.588801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.588919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.589167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.589396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.589618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.589812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.589957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.590045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.590260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.590513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.590731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.590841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.590920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.591234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.591428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.591630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.591867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.591982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.592061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.592322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.592558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.592782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.592900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.245 [2024-11-19 02:03:46.592989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.593081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.245 [2024-11-19 02:03:46.593108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.245 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.593249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.593339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.593370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.593521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.593608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.593632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.593732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.593843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.593868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.593993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.594252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.594467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.594700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.594841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.594976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.595236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.595515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.595803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.595916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.596096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.596355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.596558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.596809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.596951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.597044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.597255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.597492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.597767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.597871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.597989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.598254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.598448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.598640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.598867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.598985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.599126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.599363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.599560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.599804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.599942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.600057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.600288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.600514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.600750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.600862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.246 [2024-11-19 02:03:46.600985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.601115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.246 [2024-11-19 02:03:46.601139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.246 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.601283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.601395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.601420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.601504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.601586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.601611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.601737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.601856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.601883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.601970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.602211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.602420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.602676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.602876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.602987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.603140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.603359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.603597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.603861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.603985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.604011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.604105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.604219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.604244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.604439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.604533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.604560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.604676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.604772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.604797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.604991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.605225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.605461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.605715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.605931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.606048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.606278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.606526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.606810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.606947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.607034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.607268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.607506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.607736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.607961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.608077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.608304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.608562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.608854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.608969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.609090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.609205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.609229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.609380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.609575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.247 [2024-11-19 02:03:46.609600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.247 qpair failed and we were unable to recover it. 00:27:58.247 [2024-11-19 02:03:46.609695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.609779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.609803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.609923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.610149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.610338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.610607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.610813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.610930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.611039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.611240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.611497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.611762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.611989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.612131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.612253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.612294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.612444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.612559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.612583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.612740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.612892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.612920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.613012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.613268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.613541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.613815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.613964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.614074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.614261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.614555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.614808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.614951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.615082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.615173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.615200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.615323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.615402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.615428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.615532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.615673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.615698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.615820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.615976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.616000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.616113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.616244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.616271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.616378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.616495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.616520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.616662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.616816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.616841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.616944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.617143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.617170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.248 qpair failed and we were unable to recover it. 00:27:58.248 [2024-11-19 02:03:46.617289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.248 [2024-11-19 02:03:46.617368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.617392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.617532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.617614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.617685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.617820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.617948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.617974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.618076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.618202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.618226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.618344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.618471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.618498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.618661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.618790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.618819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.618936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.619157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.619515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.619794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.619899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.620013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.620151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.620175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.620282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.620401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.620428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.620560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.620706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.620730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.620840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.621114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.621386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.621579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.621847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.621961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.622069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.622359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.622567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.622814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.622913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.623033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.623216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.623503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.623713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.623849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.623948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.624236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.624539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.624759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.624865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.625029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.625151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.625176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.625318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.625415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.625442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.625588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.625695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.625719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.625862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.626006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.626047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.626208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.626371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.626397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.626498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.626581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.249 [2024-11-19 02:03:46.626608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.249 qpair failed and we were unable to recover it. 00:27:58.249 [2024-11-19 02:03:46.626717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.626825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.626849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.626986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.627275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.627538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.627834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.627984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.628111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.628361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.628566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.628822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.628967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.629131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.629246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.629270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.629413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.629528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.629553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.629672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.629799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.629826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.629958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.630190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.630430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.630761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.630905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.631046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.631323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.631608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.631859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.631971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.632139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.632248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.632272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.632350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.632462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.632486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.632576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.632793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.632821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.632953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.633177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.633395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.633623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.633849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.633977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.634147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.634273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.634300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.634426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.634548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.634576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.634743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.634881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.634906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.635060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.635169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.635193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.635387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.635538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.635565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.635704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.635778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.635802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.635894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.635985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.636009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.250 [2024-11-19 02:03:46.636106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.636199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.250 [2024-11-19 02:03:46.636226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.250 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.636324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.636435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.636460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.636549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.636647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.636675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.636792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.636914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.636948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.637049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.637162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.637186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.637318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.637406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.637432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.637590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.637709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.637735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.637877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.637990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.638014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.638116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.638310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.638337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.638427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.638580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.638607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.638765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.638883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.638908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.639005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.639112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.639141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.639262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.639388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.639412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.639558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.639749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.639776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.639907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.639999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.640026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.640184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.640268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.640295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.640425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.640509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.640534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.640614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.640740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.640768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.640924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.641166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.641419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.641630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.641861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.641974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.642183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.642494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.642801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.642966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.643044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.643298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.643563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.643814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.643965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.644054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.644171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.644197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.644362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.644482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.644506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.644649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.644799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.644826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.644958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.645208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.645478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.251 qpair failed and we were unable to recover it. 00:27:58.251 [2024-11-19 02:03:46.645787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.251 [2024-11-19 02:03:46.645950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.646082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.646337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.646543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.646824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.646961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.647099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.647325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.647572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.647812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.647940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.648034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.648295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.648584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.648828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.648976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.649113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.649252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.649276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.649386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.649494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.649518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.649631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.649765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.649792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.649916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.650218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.650534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.650734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.650866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.650953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.651228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.651487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.651751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.651908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.652034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.652173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.652197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.652307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.652418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.652442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.652609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.652785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.652811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.652939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.653029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.653064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.653204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.653324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.653349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.653471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.653608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.653633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.653813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.653978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.654005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.654141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.654253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.654277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.252 qpair failed and we were unable to recover it. 00:27:58.252 [2024-11-19 02:03:46.654376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.252 [2024-11-19 02:03:46.654459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.654486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.654628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.654775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.654799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.654886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.654974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.654998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.655138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.655279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.655306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.655438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.655542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.655567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.655680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.655761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.655785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.655896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.656149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.656457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.656712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.656831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.656949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.657073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.657101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.657204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.657327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.657351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.657460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.657613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.657646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.657845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.658039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.658066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.658197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.658337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.658361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.658503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.658597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.658626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.658772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.659197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.659465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.659811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.659946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.660087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.660226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.660251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.660408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.660549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.660574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.660682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.660786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.660813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.660980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.661262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.661526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.661795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.661910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.662021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.662148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.662175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.662298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.662422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.662450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.662556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.662668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.662694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.662870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.662987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.663012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.663093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.663220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.663248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.663384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.663499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.663524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.663653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.663779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.663806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.663931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.664022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.664050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.664154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.664343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.664382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.253 qpair failed and we were unable to recover it. 00:27:58.253 [2024-11-19 02:03:46.664510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.253 [2024-11-19 02:03:46.664644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.664673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.664797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.664948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.664981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.665114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.665191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.665215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.665358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.665477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.665504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.665628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.665750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.665778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.665917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.666189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.666493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.666789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.666928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.667026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.667274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.667492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.667705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.667822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.667914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.668176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.668459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.668751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.668890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.669013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.669289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.669502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.669817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.669955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.670066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.670205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.670230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.670384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.670535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.670562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.670704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.670789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.670813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.670925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.671199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.671463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.671729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.671873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.671960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.672240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.672472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.672786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.672909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.673047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.673283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.673565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.673837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.254 [2024-11-19 02:03:46.673944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.254 qpair failed and we were unable to recover it. 00:27:58.254 [2024-11-19 02:03:46.674122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.674266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.674290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.674417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.674548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.674575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.674679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.674765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.674790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.674901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.675183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.675445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.675745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.675864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.675998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.676261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.676579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.676836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.676996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.677122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.677238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.677262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.677385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.677549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.677576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.677731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.677814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.677841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.677978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.678260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.678579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.678863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.678969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.679068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.679321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.679600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.679886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.679996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.680146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.680233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.680259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.680399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.680487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.680512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.680620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.680791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.680819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.680947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.681193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.681429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.681717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.681920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.682062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.682172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.682196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.682336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.682455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.682483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.255 qpair failed and we were unable to recover it. 00:27:58.255 [2024-11-19 02:03:46.682644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.682741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.255 [2024-11-19 02:03:46.682769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.682908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.682997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.683022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.683181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.683303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.683330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.683431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.683521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.683550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.683710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.683828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.683853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.683935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.684233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.684551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.684786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.684904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.684996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.685278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.685536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.685765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.685901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.686076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.686153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.686177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.686303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.686471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.686496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.686613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.686742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.686769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.686881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.687150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.687457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.687718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.687905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.687999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.688026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.688153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.688255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.688282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.688384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.688536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.688563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.688731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.688840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.688864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.688998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.689084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.689111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.689277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.689418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.689442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.689581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.689750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.689776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.689866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.690170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.690465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.690782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.690910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.691010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.691261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.691514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.691788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.691924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.256 qpair failed and we were unable to recover it. 00:27:58.256 [2024-11-19 02:03:46.692036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.256 [2024-11-19 02:03:46.692177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.692202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.692286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.692397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.692425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.692530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.692625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.692660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.692772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.692892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.692932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.693085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.693213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.693240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.693371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.693515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.693540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.693656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.693745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.693772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.693862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.693977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.694004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.694124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.694201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.694226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.694345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.694451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.694479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.694579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.694730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.694758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.694889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.695178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.695456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.695789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.695901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.696032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.696287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.696549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.696867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.696986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.697077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.697325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.697559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.257 [2024-11-19 02:03:46.697787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.257 [2024-11-19 02:03:46.697943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.257 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.698082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.698196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.698221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.698350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.698469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.698512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.698599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.698755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.698781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.698866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.698979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.699091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.699403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.699656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.699858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.699989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.700124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.700356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.700585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.700793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.700940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.701053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.701281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.701532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.701844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.701954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.702062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.702300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.702550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.702780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.702925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.703045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.703269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.703580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.703856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.258 [2024-11-19 02:03:46.703967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.258 qpair failed and we were unable to recover it. 00:27:58.258 [2024-11-19 02:03:46.704070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.704207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.704232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.704351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.704469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.704493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.704626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.704770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.704797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.704926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.705140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.705400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.705697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.705833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.705967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.706220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.706465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.706716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.706893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.707025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.707317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.707577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.707823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.707948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.708076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.708317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.708608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.708836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.708943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.709036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.709294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.709509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.709736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.709904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.710023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.710135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.710162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.259 qpair failed and we were unable to recover it. 00:27:58.259 [2024-11-19 02:03:46.710275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.259 [2024-11-19 02:03:46.710359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.710384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.710472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.710559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.710583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.710699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.710790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.710816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.710914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.711185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.711403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.711685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.711803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.711903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.712149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.712413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.712693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.712878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.712977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.713262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.713561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.713815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.713942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.714103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.714186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.714210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.714311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.714443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.714485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.714628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.714730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.714756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.714903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.714986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.715011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.715091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.715172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.715197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.715311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.715387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.715412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.715587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.715730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.715756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.260 [2024-11-19 02:03:46.715864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.716023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.260 [2024-11-19 02:03:46.716056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.260 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.716230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.716336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.716365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.716505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.716632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.716667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.716812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.716919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.716946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.717113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.717223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.717252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.717390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.717485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.717511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.717607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.717766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.717796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.717923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.718220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.718472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.718740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.718903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.719039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.719126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.719153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.719295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.719462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.719489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.719631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.719729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.719754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.719869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.719985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.720010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.720093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.720253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.720298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.720490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.720622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.720659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.720794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.720875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.720900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.720986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.721259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.721533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.261 qpair failed and we were unable to recover it. 00:27:58.261 [2024-11-19 02:03:46.721777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.261 [2024-11-19 02:03:46.721885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.262 qpair failed and we were unable to recover it. 00:27:58.262 [2024-11-19 02:03:46.721998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.722181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.722208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.262 qpair failed and we were unable to recover it. 00:27:58.262 [2024-11-19 02:03:46.722351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.722440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.722465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.262 qpair failed and we were unable to recover it. 00:27:58.262 [2024-11-19 02:03:46.722551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.722669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.722714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.262 qpair failed and we were unable to recover it. 00:27:58.262 [2024-11-19 02:03:46.722956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.723063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.723090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.262 qpair failed and we were unable to recover it. 00:27:58.262 [2024-11-19 02:03:46.723250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.723336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.262 [2024-11-19 02:03:46.723360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.262 qpair failed and we were unable to recover it. 00:27:58.555 [2024-11-19 02:03:46.723523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.555 [2024-11-19 02:03:46.723643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.555 [2024-11-19 02:03:46.723669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.555 qpair failed and we were unable to recover it. 00:27:58.555 [2024-11-19 02:03:46.723759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.555 [2024-11-19 02:03:46.723870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.723894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.723988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.724247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.724434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.724762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.724928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.725097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.725249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.725284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.725419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.725542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.725578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.725714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.725849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.725883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.725999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.726119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.726155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.726302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.726444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.726483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.726607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.726716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.726750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.726881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.727031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.727069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.727267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.727404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.727439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.727591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.727733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.727767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.727879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.728175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.728487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.728749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.728863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.728946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.729084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.729111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.729220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.729323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.729347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.729481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.729599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.729627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.556 qpair failed and we were unable to recover it. 00:27:58.556 [2024-11-19 02:03:46.729781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.556 [2024-11-19 02:03:46.729873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.729899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.730093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.730219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.730243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.730353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.730533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.730558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.730677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.730790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.730815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.730923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.731146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.731459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.731716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.731828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.731919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.732136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.732408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.732698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.732813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.732944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.733187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.733400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.733657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.733772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.733934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.734183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.734425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.734704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.734815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.734900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.735036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.735063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.557 qpair failed and we were unable to recover it. 00:27:58.557 [2024-11-19 02:03:46.735152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.735303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.557 [2024-11-19 02:03:46.735345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.735486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.735593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.735617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.735799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.735970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.736001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.736100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.736221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.736249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.736411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.736520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.736545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.736687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.736783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.736810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.736905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.737196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.737455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.737667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.737855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.737972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.738223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.738500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.738793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.738899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.738998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.739244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.739480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.739698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.739801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.739882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.740175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.740426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.740633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.558 [2024-11-19 02:03:46.740753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.558 qpair failed and we were unable to recover it. 00:27:58.558 [2024-11-19 02:03:46.740850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.740937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.740962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.741090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.741219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.741244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.741375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.741466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.741494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.741596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.741726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.741751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.741869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.742153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.742434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.742696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.742831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.742939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.743258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.743566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.743823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.743935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.744088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.744341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.744542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.744767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.744877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.744962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.745283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.745531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.745790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.745932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.746064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.746187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.746214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.559 qpair failed and we were unable to recover it. 00:27:58.559 [2024-11-19 02:03:46.746332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.559 [2024-11-19 02:03:46.746413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.746437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.746554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.746630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.746660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.746755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.746853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.746879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.746985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.747254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.747490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.747748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.747885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.747988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.748227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.748496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.748726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.748898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.749043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.749340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.749566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.749788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.749892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.750017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.750267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.750485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.750798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.750916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.751078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.751202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.751229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.560 [2024-11-19 02:03:46.751362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.751469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.560 [2024-11-19 02:03:46.751494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.560 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.751611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.751730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.751755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.751844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.751958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.751983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.752086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.752246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.752273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.752389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.752502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.752527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.752656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.752747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.752774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.752891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.753228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.753492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.753770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.753882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.754038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.754325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.754581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.754868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.754972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.755099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.755257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.755281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.755410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.755528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.755556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.755707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.755852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.755877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.756012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.756263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.756487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.756805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.756994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.757106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.757202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.561 [2024-11-19 02:03:46.757227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.561 qpair failed and we were unable to recover it. 00:27:58.561 [2024-11-19 02:03:46.757346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.757425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.757449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.757559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.757674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.757702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.757786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.757902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.757930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.758055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.758136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.758161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.758251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.758395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.758423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.758564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.758715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.758741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.758855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.758994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.759018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.759183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.759307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.759335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.759497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.759584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.759611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.759777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.759863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.759887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.759981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.760244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.760526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.760818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.760934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.761073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.761195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.761222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.761322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.761402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.761426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.761508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.761663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.761688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.562 qpair failed and we were unable to recover it. 00:27:58.562 [2024-11-19 02:03:46.761829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.562 [2024-11-19 02:03:46.761995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.762022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.762131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.762215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.762239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.762400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.762521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.762549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.762634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.762758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.762786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.762924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.763169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.763411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.763625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.763863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.763984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.764012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.764149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.764246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.764273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.764379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.764489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.764518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.764598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.764728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.764753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.764884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.765137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.765357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.765685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.765841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.765951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.766177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.766397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.766718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.766832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.766946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.767098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.767139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.767231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.767352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.767394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.563 qpair failed and we were unable to recover it. 00:27:58.563 [2024-11-19 02:03:46.767521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.767666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.563 [2024-11-19 02:03:46.767691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.767776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.767896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.767936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.768064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.768159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.768187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.768324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.768434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.768459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.768585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.768710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.768738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.768834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.768979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.769006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.769146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.769252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.769277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.769376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.769490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.769518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.769607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.769699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.769727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.769877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.770216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.770515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.770777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.770884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.771042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.771219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.771244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.771364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.771520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.771547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.771652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.771770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.771795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.771882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.771980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.772007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.772099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.772248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.772274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.772442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.772557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.772581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.772746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.772858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.772883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.773064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.773320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.773595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.773862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.773979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.774118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.774208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.774233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.774338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.774421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.774445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.564 [2024-11-19 02:03:46.774554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.774669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.564 [2024-11-19 02:03:46.774696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.564 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.774800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.774906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.774931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.775019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.775233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.775484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.775707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.775848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.775977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.776229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.776417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.776688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.776805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.776906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.777129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.777379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.777656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.777852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.777983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.778010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.778106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.778246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.778271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.778356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.778495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.778519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.778602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.778749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.778776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.778909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.779131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.779448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.779694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.779833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.565 [2024-11-19 02:03:46.779972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.780083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.565 [2024-11-19 02:03:46.780107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.565 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.780233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.780363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.780390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.780519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.780605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.780633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.780777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.780889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.780913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.781023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.781130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.781154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.781321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.781447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.781474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.781642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.781759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.781783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.781922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.782200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.782526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.782803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.782920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.783027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.783277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.783546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.783779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.783932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.784083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.784289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.784572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.784844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.784944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.785053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.785157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.785184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.785307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.785439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.785464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.785579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.785725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.785751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.785898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.786159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.786446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.566 qpair failed and we were unable to recover it. 00:27:58.566 [2024-11-19 02:03:46.786700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.566 [2024-11-19 02:03:46.786864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.786972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.787249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.787517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.787737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.787853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.787952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.788180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.788475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.788720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.788851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.788926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.789207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.789471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.789697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.789859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.789961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.790268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.790507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.790758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.790861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.790943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.791061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.791089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.791260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.791380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.567 [2024-11-19 02:03:46.791408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.567 qpair failed and we were unable to recover it. 00:27:58.567 [2024-11-19 02:03:46.791503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.791625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.791659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.791798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.791912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.791936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.792037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.792151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.792178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.792294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.792418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.792445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.792553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.792684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.792710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.792871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.792997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.793021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.793117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.793262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.793289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.793392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.793533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.793557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.793721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.793848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.793875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.794006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.794291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.794503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.794782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.794903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.795026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.795229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.795513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.795782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.795923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.796024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.796366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.796625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.796857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.796998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.797187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.797303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.797328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.797414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.797500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.797526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.797647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.797791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.797817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.568 qpair failed and we were unable to recover it. 00:27:58.568 [2024-11-19 02:03:46.797912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.568 [2024-11-19 02:03:46.798036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.798063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.798198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.798313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.798337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.798475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.798576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.798603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.798720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.798820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.798847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.798977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.799197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.799517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.799819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.799953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.800060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.800335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.800597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.800799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.800954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.801125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.801237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.801261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.801377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.801495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.801521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.801651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.801763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.801787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.801901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.801990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.802130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.802356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.802599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.802859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.802964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.803074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.803324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.803543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.803806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.803908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.804021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.804109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.804133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.569 qpair failed and we were unable to recover it. 00:27:58.569 [2024-11-19 02:03:46.804246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.569 [2024-11-19 02:03:46.804358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.804387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.804520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.804662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.804704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.804850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.804967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.804994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.805135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.805281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.805306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.805434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.805527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.805553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.805677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.805796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.805823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.805981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.806292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.806552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.806839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.806954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.807070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.807304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.807573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.807817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.807951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.808038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.808206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.808233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.808367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.808449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.808474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.808599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.808737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.808765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.808866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.809175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.809404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.809729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.809858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.809998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.810294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.810549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.810813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.810961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.570 qpair failed and we were unable to recover it. 00:27:58.570 [2024-11-19 02:03:46.811102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.811228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.570 [2024-11-19 02:03:46.811259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.811379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.811542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.811570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.811705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.811822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.811847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.811985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.812226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.812455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.812764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.812955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.813109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.813321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.813348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.813456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.813572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.813597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.813724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.813863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.813888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.814003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.814129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.814156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.814264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.814456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.814481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.814617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.814721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.814749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.814872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.815141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.815360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.815614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.815757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.815954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.816243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.816476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.816788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.816928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.817033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.817382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.817616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.817882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.817996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.818125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.818320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.818348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.818514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.818673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.818699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.571 qpair failed and we were unable to recover it. 00:27:58.571 [2024-11-19 02:03:46.818862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.571 [2024-11-19 02:03:46.818984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.819008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.819118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.819269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.819294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.819486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.819566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.819592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.819770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.819890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.819914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.820013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.820245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.820518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.820776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.820929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.821059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.821165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.821189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.821320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.821473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.821505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.821627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.821756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.821783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.821890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.822178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.822476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.822801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.822938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.823032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.823278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.823502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.823714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.823812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.823952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.824235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.824520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.824789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.824918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.825004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.825110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.825134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.572 [2024-11-19 02:03:46.825217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.825390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.572 [2024-11-19 02:03:46.825415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.572 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.825533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.825653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.825694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.825811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.825922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.825947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.826058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.826309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.826610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.826875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.826981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.827067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.827208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.827249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.827350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.827463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.827487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.827601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.827744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.827771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.827899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.828173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.828441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.828741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.828852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.828964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.829206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.829535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.829778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.829878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.829995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.830106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.830130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.830290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.830375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.830402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.830568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.830684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.830710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.830841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.830999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.831026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.573 qpair failed and we were unable to recover it. 00:27:58.573 [2024-11-19 02:03:46.831123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.831249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.573 [2024-11-19 02:03:46.831276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.831410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.831523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.831548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.831654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.831783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.831808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.831966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.832240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.832442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.832661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.832823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.832963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.833192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.833515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.833772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.833947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.834039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.834308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.834526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.834816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.834970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.835103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.835250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.835277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.835411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.835514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.835538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.835667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.835793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.835820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.835954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.836197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.836512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.836797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.836938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.837069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.837217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.837241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.837415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.837522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.837547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.837716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.837815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.837842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.837981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.838101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.838125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.838241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.838350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.838391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.574 qpair failed and we were unable to recover it. 00:27:58.574 [2024-11-19 02:03:46.838480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.574 [2024-11-19 02:03:46.838602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.838629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.838778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.838859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.838884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.839029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.839283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.839557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.839821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.839965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.840092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.840193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.840222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.840334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.840438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.840462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.840602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.840733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.840773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.840865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.840984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.841025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.841166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.841274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.841298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.841442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.841570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.841597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.841727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.841877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.841904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.842062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.842293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.842549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.842798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.842941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.843027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.843154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.843180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.843305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.843420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.843447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.843576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.843703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.843728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.843852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.843978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.844005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.844131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.844261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.844288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.844396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.844483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.844507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.844617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.844815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.844843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.844970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.845121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.845148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.845282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.845366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.575 [2024-11-19 02:03:46.845391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.575 qpair failed and we were unable to recover it. 00:27:58.575 [2024-11-19 02:03:46.845543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.845621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.845668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.845767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.845862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.845889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.845990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.846285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.846486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.846732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.846859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.846993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.847234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.847519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.847788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.847936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.848062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.848231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.848257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.848396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.848484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.848510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.848660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.848762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.848794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.848943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.849211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.849438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.849715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.849819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.849937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.850114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.850409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.850697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.850902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.850991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.851017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.851185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.851282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.851319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.576 qpair failed and we were unable to recover it. 00:27:58.576 [2024-11-19 02:03:46.851420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.576 [2024-11-19 02:03:46.851526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.851550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.851729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.851848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.851875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.852007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.852259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.852501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.852760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.852920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.853033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.853267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.853544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.853836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.853982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.854073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.854199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.854226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.854344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.854426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.854453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.854619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.854744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.854769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.854900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.855169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.855465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.855728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.855866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.855986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.856114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.856141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.856303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.856391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.856417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.856524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.856668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.856698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.856862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.856982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.857009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.857124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.857231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.857255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.857363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.857467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.857494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.857600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.857735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.857763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.857909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.858019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.858043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.858135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.858241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.577 [2024-11-19 02:03:46.858268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.577 qpair failed and we were unable to recover it. 00:27:58.577 [2024-11-19 02:03:46.858378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.858496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.858540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.858620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.858766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.858791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.858914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.859187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.859446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.859743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.859888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.860005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.860289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.860577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.860836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.860984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.861091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.861301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.861596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.861860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.861964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.862073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.862223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.862248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.862360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.862494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.862521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.862634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.862725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.862750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.862882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.863151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.863405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.863631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.863807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.578 qpair failed and we were unable to recover it. 00:27:58.578 [2024-11-19 02:03:46.863952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.864079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.578 [2024-11-19 02:03:46.864108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.864225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.864340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.864364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.864444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.864577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.864604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.864723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.864846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.864892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.864999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.865255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.865477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.865753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.865868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.866002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.866323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.866598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.866814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.866932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.867053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.867298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.867536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.867808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.867963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.868067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.868256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.868518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.868766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.868877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.868957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.869058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.869085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.869237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.869362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.579 [2024-11-19 02:03:46.869389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.579 qpair failed and we were unable to recover it. 00:27:58.579 [2024-11-19 02:03:46.869563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.869681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.869706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.869842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.869930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.869957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.870076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.870295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.870598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.870842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.870949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.871088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.871205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.871229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.871340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.871437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.871465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.871569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.871725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.871753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.871886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.872184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.872468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.872760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.872899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.873031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.873298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.873584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.873802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.873958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.874078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.874330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.874575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.874849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.874966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.875065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.875292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.875507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.875821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.580 [2024-11-19 02:03:46.875962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.580 qpair failed and we were unable to recover it. 00:27:58.580 [2024-11-19 02:03:46.876092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.876256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.876280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.876391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.876511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.876538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.876659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.876766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.876791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.876907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.877196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.877456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.877695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.877851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.877949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.878246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.878473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.878748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.878880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.879004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.879265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.879541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.879785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.879928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.880058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.880192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.880219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.880319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.880467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.880507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.880623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.880753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.880778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.880895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.881229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.881513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.881765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.881883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.881982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.882076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.581 [2024-11-19 02:03:46.882103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.581 qpair failed and we were unable to recover it. 00:27:58.581 [2024-11-19 02:03:46.882242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.882359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.882383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.882512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.882628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.882661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.882795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.882900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.882924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.883037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.883242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.883523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.883759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.883893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.884011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.884231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.884509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.884769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.884883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.885009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.885317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.885579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.885847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.885961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.886096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.886284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.886324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.886412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.886500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.886527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.886647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.886742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.886768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.886875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.886981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.887137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.887345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.887592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.887831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.887992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.582 [2024-11-19 02:03:46.888019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.582 qpair failed and we were unable to recover it. 00:27:58.582 [2024-11-19 02:03:46.888148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.888263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.888290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.888434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.888547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.888572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.888684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.888797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.888824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.888945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.889285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.889588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.889837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.889979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.890097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.890291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.890529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.890826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.890990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.891084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.891399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.891687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.891873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.891987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.892124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.892240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.892267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.892407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.892494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.892520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.892660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.892776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.892803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.892894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.893151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.893446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.893725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.893834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.583 [2024-11-19 02:03:46.893973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.894082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.583 [2024-11-19 02:03:46.894106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.583 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.894213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.894299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.894325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.894486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.894603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.894630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.894778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.894893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.894917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.895057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.895289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.895569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.895845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.895957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.896048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.896202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.896229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.896362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.896466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.896491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.896594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.896778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.896808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.896908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.897188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.897407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.897690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.897804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.897964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.898231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.898471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.898789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.898894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.899034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.899158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.899185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.899308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.899433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.899460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.899613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.899756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.899781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.899868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.899999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.900026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.900150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.900312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.900336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.584 [2024-11-19 02:03:46.900499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.900621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.584 [2024-11-19 02:03:46.900679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.584 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.900807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.900925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.900952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.901113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.901221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.901245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.901331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.901443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.901485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.901572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.901695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.901719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.901840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.901974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.902002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.902172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.902318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.902359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.902502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.902647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.902673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.902824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.902925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.902952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.903078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.903167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.903191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.903289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.903460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.903484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.903626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.903722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.903749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.903861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.903998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.904025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.904141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.904244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.904268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.904380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.904460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.904499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.904629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.904752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.904776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.904935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.905201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.905457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.905725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.905844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.905968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.906277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.906564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.906782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.906952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.907062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.907169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.907193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.907315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.907411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.907438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.907556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.907695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.907720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.585 qpair failed and we were unable to recover it. 00:27:58.585 [2024-11-19 02:03:46.907838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.585 [2024-11-19 02:03:46.907949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.907977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.908079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.908330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.908624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.908875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.908997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.909124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.909291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.909315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.909430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.909571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.909596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.909761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.909871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.909895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.909992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.910293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.910569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.910819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.910924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.911007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.911146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.911170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.911333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.911458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.911485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.911619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.911705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.911730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.911871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.911981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.912006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.912114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.912201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.912228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.912383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.912511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.912538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.912667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.912746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.912770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.912927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.913182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.913425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.913611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.913841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.913978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.914005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.914103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.914262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.914286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.914404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.914494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.586 [2024-11-19 02:03:46.914521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.586 qpair failed and we were unable to recover it. 00:27:58.586 [2024-11-19 02:03:46.914617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.914715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.914740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.914868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.914982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.915110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.915378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.915601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.915795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.915920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.916005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.916279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.916463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.916712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.916827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.916929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.917236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.917483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.917715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.917849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.917965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.918066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.918093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.918247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.918345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.918372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.918483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.920791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.920835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.920949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.921113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.921141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.921300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.921425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.921452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.921613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.921715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.921740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.921868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.921984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.922011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.922096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.922188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.922214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.922352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.922469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.922493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.922595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.922703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.587 [2024-11-19 02:03:46.922732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.587 qpair failed and we were unable to recover it. 00:27:58.587 [2024-11-19 02:03:46.922861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.922982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.923122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.923340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.923612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.923893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.923978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.924003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.924136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.924260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.924287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.924386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.924476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.924503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.924649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.924794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.924819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.924932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.925176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.925465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.925704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.925856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.925955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.926223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.926429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.926713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.926882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.926992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.927171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.927462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.927752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.927869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.927984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.928275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.928504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.928764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.928869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.928970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.929097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.929124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.929253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.929363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.929388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.588 qpair failed and we were unable to recover it. 00:27:58.588 [2024-11-19 02:03:46.929470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.588 [2024-11-19 02:03:46.929608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.929655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.929786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.929938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.929965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.930102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.930326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.930539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.930793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.930954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.931140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.931262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.931291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.931427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.931523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.931551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.931712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.931828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.931853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.931959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.932245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.932466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.932723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.932879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.933017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.933280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.933523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.933771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.933939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.934038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.934272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.934549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.934812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.934933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.935052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.935185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.935214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.935343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.935471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.935498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.935632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.935748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.935773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.935912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.936150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.936397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.936685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.936836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.589 qpair failed and we were unable to recover it. 00:27:58.589 [2024-11-19 02:03:46.936939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.589 [2024-11-19 02:03:46.937028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.937166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.937367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.937559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.937835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.937945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.938115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.938246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.938273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.938412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.938535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.938560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.938673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.938756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.938782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.938858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.938988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.939021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.939106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.939224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.939251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.939394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.939509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.939534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.939620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.939727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.939755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.939885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.940168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.940440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.940706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.940828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.940950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.941167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.941412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.941703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.941839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.941966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.942231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.942468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.942720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.942836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.942931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.943204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.943414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.943655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.943824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.943970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.944076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.590 [2024-11-19 02:03:46.944101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.590 qpair failed and we were unable to recover it. 00:27:58.590 [2024-11-19 02:03:46.944244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.944377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.944405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.944493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.944584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.944611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.944761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.944851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.944876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.945006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.945249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.945525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.945785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.945961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.946081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.946325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.946551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.946823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.946941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.947058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.947198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.947222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.947314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.947469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.947494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.947574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.947731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.947756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.947861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.947979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.948004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.948133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.948258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.948285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.948443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.948540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.948567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.948674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.948792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.948817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.948952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.949233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.949512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.949795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.949921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.950014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.950272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.950467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.950740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.950890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.950976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.951107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.591 [2024-11-19 02:03:46.951132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.591 qpair failed and we were unable to recover it. 00:27:58.591 [2024-11-19 02:03:46.951260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.951352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.951379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.951544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.951663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.951688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.951806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.951891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.951915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.952037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.952277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.952527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.952816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.952968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.953068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.953159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.953186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.953317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.953434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.953459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.953580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.953705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.953733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.953853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.953984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.954095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.954345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.954559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.954846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.954979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.955074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.955193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.955220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.955352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.955487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.955512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.955693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.955817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.955842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.955953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.956283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.956571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.956820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.956942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.957067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.957190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.957217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.957321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.957427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.957451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.592 qpair failed and we were unable to recover it. 00:27:58.592 [2024-11-19 02:03:46.957584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.592 [2024-11-19 02:03:46.957706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.957734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.957825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.957916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.957943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.958084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.958173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.958197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.958311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.958491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.958515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.958607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.958700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.958728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.958878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.958994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.959019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.959179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.959304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.959331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.959455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.959611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.959642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.959784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.959896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.959921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.960023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.960302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.960579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.960793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.960924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.961007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.961251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.961531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.961799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.961930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.962072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.962307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.962582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.962842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.962989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.963111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.963360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.963546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.963822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.963942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.593 qpair failed and we were unable to recover it. 00:27:58.593 [2024-11-19 02:03:46.964066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.593 [2024-11-19 02:03:46.964201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.964229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.964361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.964479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.964503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.964663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.964756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.964784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.964904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.964991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.965018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.965165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.965274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.965298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.965405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.965508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.965540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.965670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.965766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.965794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.965924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.966176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.966398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.966650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.966792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.966877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.967122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.967369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.967593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.967854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.967982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.968070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.968293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.968538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.968775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.968914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.969024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.969271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.969545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.969800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.969938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.970083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.970294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.970577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.970803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.970939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.971056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.971135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.971160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.971241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.971356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.971381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.594 qpair failed and we were unable to recover it. 00:27:58.594 [2024-11-19 02:03:46.971500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.594 [2024-11-19 02:03:46.971613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.971644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.971741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.971832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.971856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.971934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.972158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.972410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.972603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.972822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.972926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.973038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.973290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.973484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.973776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.973889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.974006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.974223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.974434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.974669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.974865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.974985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.975161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.975366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.975617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.975848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.975989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.976128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.976354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.976644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.976883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.976991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.977068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.977149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.977173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.977253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.977326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.977351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.977463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.977547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.977576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.595 qpair failed and we were unable to recover it. 00:27:58.595 [2024-11-19 02:03:46.977703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.595 [2024-11-19 02:03:46.977814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.977839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.977972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.978160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.978361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.978621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.978770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.978946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.979192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.979473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.979728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.979895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.979994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.980240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.980463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.980704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.980803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.980892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.981105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.981349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.981602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.981895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.981982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.982006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.982123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.982259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.982284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.982373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.982517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.982542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.982660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.982799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.982823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.982928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.983172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.983430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.983613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.983811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.983977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.984063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.984286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.984505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.984746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.984881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.596 qpair failed and we were unable to recover it. 00:27:58.596 [2024-11-19 02:03:46.985010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.596 [2024-11-19 02:03:46.985129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.985153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.985249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.985360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.985385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.985513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.985599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.985624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.985779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.985898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.985923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.986050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.986329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.986518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.986771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.986891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.987014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.987164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.987191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.987272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.987400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.987427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.987551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.987721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.987746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.987854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.988170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.988468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.988689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.988807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.988940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.989190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.989417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.989740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.989900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.990035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.990262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.990583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.990847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.990955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.991114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.991237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.991264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.991392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.991510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.991537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.991647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.991732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.991766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.991916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.992157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.992438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.992700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.992854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.992952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.993076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.993110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.597 [2024-11-19 02:03:46.993245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.993368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.597 [2024-11-19 02:03:46.993392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.597 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.993525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.993650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.993679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.993810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.993905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.993933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.994094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.994209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.994233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.994396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.994552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.994593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.994725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.994831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.994858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.994973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.995223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.995485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.995775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.995882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.995996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.996233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.996494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.996723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.996862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.996968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.997220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.997501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.997767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.997903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.998014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.998306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.998511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.998752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.998896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.999022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.999148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.999172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.999316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.999401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.999442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.999545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.999705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.999730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:46.999852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:46.999998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:47.000023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:47.000165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:47.000254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:47.000295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.598 qpair failed and we were unable to recover it. 00:27:58.598 [2024-11-19 02:03:47.000414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.598 [2024-11-19 02:03:47.000537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.000564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.000659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.000755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.000780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.000892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.001198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.001452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.001716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.001813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.001931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.002160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.002422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.002694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.002845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.002970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.003223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.003442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.003779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.003920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.004011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.004300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.004620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.004821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.004985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.005095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.005188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.005212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.005321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.005445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.005472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.005599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.005730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.005758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.005887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.006161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.006403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.006650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.006760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.006857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.007199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.007457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.007693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.007835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.599 [2024-11-19 02:03:47.007940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.008068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.599 [2024-11-19 02:03:47.008095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.599 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.008233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.008343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.008367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.008472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.008644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.008680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.008798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.008971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.008995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.009108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.009225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.009250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.009385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.009503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.009530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.009624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.009742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.009769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.009873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.009985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.010010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.010140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.010287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.010314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.010430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.010562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.010586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.010703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.010809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.010834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.010973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.011206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.011465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.011735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.011900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.012078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.012225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.012253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.012356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.012440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.012464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.012578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.012712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.012740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.012849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.012978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.013092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.013354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.013589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.013873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.013977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.014002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.014103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.014219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.014246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.014351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.014514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.014538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.014654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.014766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.014791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.014905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.015160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.015393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.015687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.015880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.015998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.600 qpair failed and we were unable to recover it. 00:27:58.600 [2024-11-19 02:03:47.016172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.600 [2024-11-19 02:03:47.016263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.016287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.016418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.016541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.016568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.016700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.016786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.016814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.016944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.017246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.017528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.017783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.017918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.018084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.018350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.018576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.018822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.018986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.019081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.019338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.019525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.019761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.019925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.020053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.020284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.020576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.020836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.020946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.021032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.021310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.021559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.021801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.021920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.022067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.022352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.022540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.022785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.022897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.023063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.023264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.023548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.023809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.023942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.024029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.024132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.024160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.601 [2024-11-19 02:03:47.024254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.024338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.601 [2024-11-19 02:03:47.024365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.601 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.024493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.024605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.024630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.024742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.024900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.024927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.025071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.025287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.025498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.025738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.025895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.025979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.026199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.026497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.026742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.026880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.026974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.027230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.027486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.027717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.027854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.027966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.028095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.028123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.028250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.028363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.028387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.028522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.028670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.028695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.028848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.029194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.029459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.029704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.029814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.029921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.030133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.030400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.030652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.030813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.030943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.031228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.031494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.031850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.031962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.032073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.032203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.602 [2024-11-19 02:03:47.032230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.602 qpair failed and we were unable to recover it. 00:27:58.602 [2024-11-19 02:03:47.032337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.032476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.032501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.032670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.032797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.032824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.032909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.033238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.033542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.033756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.033916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.034050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.034264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.034500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.034777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.034892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.035003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.035318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.035594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.035803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.035986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.036105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.036205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.036234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.036365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.036476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.036501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.036655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.036778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.036806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.036958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.037206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.037458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.037799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.037949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.038075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.038188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.038213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.038349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.038463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.038490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.038650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.038770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.038798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.038935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.039080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.039104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.039242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.039399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.039427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.039577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.039723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.039748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.039862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.039980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.040123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.040324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.040599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.040856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.040995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.041107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.041197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.041221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.041304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.041445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.041469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.603 qpair failed and we were unable to recover it. 00:27:58.603 [2024-11-19 02:03:47.041580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.041691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.603 [2024-11-19 02:03:47.041716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.041829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.041938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.041962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.042046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.042303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.042520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.042730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.042847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.042935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.043115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.043297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.043545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.043798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.043949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.044060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.044275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.044524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.044781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.044917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.045036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.045256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.045452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.045804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.045919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.046028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.046232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.046440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.046631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.046833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.046970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.047087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.047344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.047595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.047853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.047988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.048106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.048329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.048586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.048780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.048916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.049035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.049289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.049565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.049823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.049990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.050097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.050206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.050230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.604 qpair failed and we were unable to recover it. 00:27:58.604 [2024-11-19 02:03:47.050371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.604 [2024-11-19 02:03:47.050481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.050506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.050615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.050761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.050786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.050899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.050978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.051002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.051117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.051195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.051219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.051328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.051472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.051496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.051642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.051754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.051778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.051890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.052143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.052392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.052692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.052848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.053008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.053263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.053445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.053670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.053840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.053932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.054121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.054330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.054642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.054806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.054925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.055144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.055397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.055647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.055844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.055946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.056061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.056278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.056530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.056784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.056883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.056962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.057191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.057417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.057625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.057868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.057980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.058121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.058229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.058253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.605 qpair failed and we were unable to recover it. 00:27:58.605 [2024-11-19 02:03:47.058366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.058450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.605 [2024-11-19 02:03:47.058475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.058586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.058670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.058695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.058790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.058902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.058926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.059063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.059337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.059591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.059780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.059882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.059965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.060151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.060365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.060619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.060861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.060981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.061006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.061134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.061260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.061287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.061421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.061503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.061528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.061680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.061803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.061831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.061930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.062196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.062420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.062765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.062889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.063006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.063251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.063532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.063843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.063988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.064118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.064346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.064582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.064813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.064943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.606 qpair failed and we were unable to recover it. 00:27:58.606 [2024-11-19 02:03:47.065031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.606 [2024-11-19 02:03:47.065155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.065182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.065320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.065428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.065453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.065592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.065726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.065751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.065888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.066153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.066392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.066687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.066919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.066998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.067108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.067331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.067591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.067849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.067981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.068008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.068100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.068260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.068284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.068427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.068509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.068535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.068717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.068862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.068887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.068985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.069253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.069523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.069757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.069874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.069988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.070253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.070478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.070756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.070920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.071081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.071175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.071202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.607 [2024-11-19 02:03:47.071296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.071424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.607 [2024-11-19 02:03:47.071451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.607 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.071569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.071707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.071733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.071880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.072132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.072435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.072671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.072899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.072998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.073025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.073172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.073250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.073274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.073382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.073492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.073534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.073663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.073784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.073813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.073918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.074202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.074434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.074696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.074873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.074975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.075065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.075092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.075249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.075368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.075395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.075519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.075634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.075671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.608 qpair failed and we were unable to recover it. 00:27:58.608 [2024-11-19 02:03:47.075834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.608 [2024-11-19 02:03:47.075963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.075991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.076092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.076332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.076551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.076790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.076912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.077040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.077156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.077181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.077314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.077438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.077466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.077594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.077723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.077752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.077887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.077996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.078156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.078391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.078579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.078871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.078993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.079021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.891 [2024-11-19 02:03:47.079114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.079246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.891 [2024-11-19 02:03:47.079273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.891 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.079376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.079483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.079508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.079650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.079737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.079766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.079925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.080150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.080407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.080684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.080837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.080944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.081143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.081350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.081596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.081846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.081998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.082121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.082217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.082246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.082351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.082488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.082513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.082613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.082773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.082801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.082921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.083212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.083390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.083682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.083915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.083993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.084018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.084146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.084239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.084268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.084395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.084485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.084512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.084654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.084783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.084808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.084894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.085120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.085416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.085684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.085834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.085936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.086023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.086050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.086177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.086287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.086312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.892 qpair failed and we were unable to recover it. 00:27:58.892 [2024-11-19 02:03:47.086412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.892 [2024-11-19 02:03:47.086539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.086566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.086667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.086792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.086819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.086917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.087224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.087447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.087721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.087824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.087949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.088164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.088460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.088696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.088868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.088972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.089229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.089494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.089801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.089921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.090062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.090367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.090591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.090845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.090945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.091065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.091242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.091266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.091379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.091516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.091543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.091672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.091790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.091815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.091927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.092204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.092519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.092756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.092915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.093017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.093252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.093469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.893 [2024-11-19 02:03:47.093731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.893 [2024-11-19 02:03:47.093916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.893 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.094045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.094246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.094501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.094768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.094904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.095031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.095301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.095512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.095759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.095882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.096011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.096305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.096577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.096819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.096960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.097077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.097323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.097610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.097852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.097991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.098114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.098388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.098610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.098876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.098990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.099098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.099200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.099228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.099394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.099509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.099534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.099633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.099756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.099784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.099926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.100174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.100451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.100716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.100855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.100996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.101119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.101143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.894 qpair failed and we were unable to recover it. 00:27:58.894 [2024-11-19 02:03:47.101280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.894 [2024-11-19 02:03:47.101405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.101432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.101522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.101634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.101668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.101769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.101878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.101903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.102029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.102264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.102509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.102745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.102882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.103055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.103341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.103601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.103838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.103966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.104077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.104183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.104210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.104353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.104465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.104489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.104578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.104730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.104759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.104902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.105167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.105449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.105692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.105831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.105921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.106145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.106452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.106687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.106868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.106951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.107226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.107482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.107788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.107915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.108047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.108156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.108181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.108282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.108427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.108455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.108549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.108644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.895 [2024-11-19 02:03:47.108672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.895 qpair failed and we were unable to recover it. 00:27:58.895 [2024-11-19 02:03:47.108790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.108870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.108895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.108973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.109190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.109471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.109798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.109932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.110020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.110247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.110455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.110700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.110814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.110951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.111145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.111390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.111687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.111818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.111919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.112184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.112488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.112743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.112866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.112996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.113299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.113501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.113769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.113869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.114009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.114127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.114151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.114290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.114451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.114478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.114598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.114746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.896 [2024-11-19 02:03:47.114775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.896 qpair failed and we were unable to recover it. 00:27:58.896 [2024-11-19 02:03:47.114941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.115250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.115483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.115810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.115980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.116094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.116189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.116222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.116343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.116457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.116484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.116675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.116775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.116800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.116910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.117160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.117441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.117622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.117784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.117914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.118161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.118397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.118706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.118856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.119030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.119252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.119564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.119856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.119969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.120078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.120318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.120545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.120744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.120904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.121032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.121161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.121188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.121297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.121440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.121465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.121580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.121704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.121732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.121834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.121978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.122003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.122082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.122194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.122218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.897 [2024-11-19 02:03:47.122355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.122462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.897 [2024-11-19 02:03:47.122490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.897 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.122585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.122750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.122778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.122902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.122993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.123017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.123129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.123246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.123288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.123446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.123534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.123562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.123696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.123802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.123826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.123910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.124171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.124453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.124718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.124914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.125023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.125276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.125481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.125758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.125885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.126050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.126164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.126188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.126285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.126421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.126445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.126565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.126667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.126696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.126871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.127237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.127453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.127727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.127901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.128036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.128156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.128184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.128334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.128499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.128526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.128633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.128744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.128769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.128891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.128979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.129007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.129133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.129258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.129285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.129414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.129530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.129554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.129691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.129777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.129811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.129966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.130085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.130112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.898 qpair failed and we were unable to recover it. 00:27:58.898 [2024-11-19 02:03:47.130222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.130329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.898 [2024-11-19 02:03:47.130353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.130519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.130676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.130701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.130842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.130966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.130993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.131143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.131234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.131258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.131338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.131422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.131447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.131558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.131713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.131741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.131878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.131994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.132019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.132134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.132220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.132245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.132383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.132457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.132505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.132739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.132882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.132921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.133020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.133168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.133195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.133348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.133475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.133502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.133603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.133714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.133739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.133852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.133983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.134010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.134112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.134245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.134271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.134389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.134504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.134528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.134615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.134733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.134758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.134886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.135227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.135519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.135812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.135947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.136087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.136200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.136225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.136360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.136446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.136473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.136591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.136762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.136787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.136899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.137142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.137377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.137594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.137710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.137855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.138013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.138040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.899 qpair failed and we were unable to recover it. 00:27:58.899 [2024-11-19 02:03:47.138196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.899 [2024-11-19 02:03:47.138327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.138354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.138482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.138591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.138615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.138732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.138808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.138833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.138961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.139199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.139448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.139661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.139856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.139991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.140015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.140131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.140238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.140262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.140381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.140495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.140519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.140612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.140732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.140757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.140900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.141199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.141422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.141675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.141877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.142030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.142177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.142205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.142327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.142450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.142474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.142597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.142757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.142798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.142917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.143196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.143454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.143787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.143905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.144008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.144286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.144525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.900 qpair failed and we were unable to recover it. 00:27:58.900 [2024-11-19 02:03:47.144819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.900 [2024-11-19 02:03:47.144960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.145083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.145318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.145562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.145808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.145937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.146014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.146266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.146475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.146788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.146929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.147050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.147314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.147588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.147835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.147971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.148105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.148319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.148563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.148832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.148939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.149078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.149209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.149236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.149359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.149449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.149475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.149646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.149788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.149812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.149935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.150185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.150403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.150660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.150773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.150907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.151222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.151547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.151822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.151968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.152106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.152185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.901 [2024-11-19 02:03:47.152209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.901 qpair failed and we were unable to recover it. 00:27:58.901 [2024-11-19 02:03:47.152290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.152458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.152485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.152613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.152746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.152771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.152876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.153189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.153440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.153704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.153808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.153951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.154253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.154530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.154787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.154902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.155003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.155118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.155145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.155252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.155360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.155384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.155504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.155678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.155703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.155811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.155974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.156004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.156103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.156232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.156259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.156408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.156485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.156509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.156599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.156749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.156781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.156910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.157225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.157515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.157787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.157904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.158028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.158300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.158529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.158747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.158875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.158966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.159059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.159085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.159238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.159389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.159416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.159558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.159666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.159696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.902 [2024-11-19 02:03:47.159857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.160012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.902 [2024-11-19 02:03:47.160039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.902 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.160137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.160251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.160278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.160399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.160526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.160553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.160692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.160830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.160854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.160966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.161278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.161517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.161782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.161894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.161978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.162255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.162523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.162815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.162917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.163033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.163175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.163202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.163327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.163463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.163488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.163599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.163721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.163765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.163900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.163989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.164012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.164120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.164245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.164278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.164405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.164526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.164554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.164676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.164808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.164835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.164961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.165185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.165480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.165806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.165909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.166060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.166176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.166201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.166307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.166429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.166455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.166582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.166718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.166743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.166856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.166984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.167011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.167142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.167252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.167276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.167407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.167522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.167548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.903 qpair failed and we were unable to recover it. 00:27:58.903 [2024-11-19 02:03:47.167669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.167793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.903 [2024-11-19 02:03:47.167820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.167953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.168207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.168469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.168755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.168904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.169042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.169328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.169522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.169780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.169915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.170046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.170166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.170206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.170352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.170463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.170488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.170598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.170742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.170770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.170861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.171162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.171390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.171608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.171750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.171903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.172172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.172451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.172677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.172841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.172966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.173216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.173482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.173728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.173832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.173920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.174205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.174414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.174689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.174807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.174927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.175046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.175073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.904 qpair failed and we were unable to recover it. 00:27:58.904 [2024-11-19 02:03:47.175191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.904 [2024-11-19 02:03:47.175309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.175336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.175439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.175517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.175541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.175683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.175785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.175817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.175946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.176226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.176522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.176771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.176904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.177049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.177323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.177591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.177845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.177976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.178131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.178216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.178242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.178364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.178458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.178486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.178642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.178759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.178784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.178880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.179109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.179421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.179674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.179811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.179932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.180149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.180424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.180748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.180889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.181021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.181173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.181200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.181361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.181486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.181513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.181643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.181768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.181795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.905 qpair failed and we were unable to recover it. 00:27:58.905 [2024-11-19 02:03:47.181937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.182052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.905 [2024-11-19 02:03:47.182077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.182208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.182337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.182364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.182520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.182660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.182689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.182789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.182878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.182905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.183042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.183284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.183490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.183732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.183844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.183958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.184264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.184532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.184769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.184883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.185013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.185218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.185561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.185787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.185946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.186058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.186168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.186192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.186323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.186477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.186504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.186630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.186765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.186790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.186911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.187200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.187479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.187734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.187850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.187998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.188247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.188523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.188789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.188951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.189035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.189140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.189164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.189244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.189356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.189385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.906 qpair failed and we were unable to recover it. 00:27:58.906 [2024-11-19 02:03:47.189522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.906 [2024-11-19 02:03:47.189618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.189651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.189780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.189876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.189903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.190030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.190280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.190548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.190819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.190979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.191119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.191377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.191648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.191825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.191984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.192129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.192362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.192592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.192845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.192983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.193087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.193220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.193248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.193391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.193501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.193526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.193614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.193763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.193790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.193914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.194210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.194469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.194712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.194817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.194907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.195197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.195456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.195733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.195926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.196069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.196229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.196256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.196377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.196472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.196499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.196630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.196776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.196801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.196903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.197028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.907 [2024-11-19 02:03:47.197055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.907 qpair failed and we were unable to recover it. 00:27:58.907 [2024-11-19 02:03:47.197180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.197338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.197365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.197458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.197542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.197569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.197702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.197843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.197868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.198031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.198147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.198174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.198296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.198423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.198450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.198608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.198752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.198780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.198955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.199150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.199387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.199724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.199902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.200043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.200159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.200183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.200319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.200446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.200473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.200593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.200726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.200754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.200894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.201137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.201444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.201706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.201819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.201911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.202106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.202364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.202611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.202792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.202902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.203188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.203458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.203755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.203865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.203997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.204256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.204513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.908 [2024-11-19 02:03:47.204757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.908 [2024-11-19 02:03:47.204908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.908 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.205018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.205172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.205199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.205338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.205422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.205446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.205584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.205699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.205728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.205850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.205973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.206160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.206380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.206648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.206895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.206982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.207009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.207131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.207249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.207275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.207444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.207552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.207577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.207751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.207837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.207861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.208012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.208130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.208157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.208281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.208429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.208457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.208612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.208709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.208734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.208819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.208961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.209003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.209122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.209271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.209298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.209427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.209545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.209573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.209744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.209832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.209856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.209962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.210210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.210413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.210697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.210813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.210941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.211063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.211090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.211138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1510600 (9): Bad file descriptor 00:27:58.909 [2024-11-19 02:03:47.211338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.211451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.211484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.909 qpair failed and we were unable to recover it. 00:27:58.909 [2024-11-19 02:03:47.211624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.211779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.909 [2024-11-19 02:03:47.211805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.211975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.212296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.212584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.212809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.212958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.213087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.213186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.213214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.213355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.213499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.213524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.213673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.213765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.213792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.213952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.214211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.214498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.214786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.214954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.215101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.215183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.215208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.215348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.215479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.215507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.215642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.215750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.215776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.215895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.216172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.216451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.216760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.216882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.217024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.217268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.217506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.217823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.217956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.218049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.218281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.218478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.218744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.218899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.219033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.219146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.219171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.910 [2024-11-19 02:03:47.219304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.219430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.910 [2024-11-19 02:03:47.219457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.910 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.219635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.219769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.219796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.219912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.220220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.220544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.220780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.220923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.221055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.221185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.221210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.221360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.221440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.221480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.221625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.221742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.221767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.221940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.222222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.222519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.222783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.222901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.223027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.223293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.223594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.223856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.223981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.224113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.224257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.224282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.224420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.224571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.224598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.224744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.224853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.224878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.224992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.225262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.225577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.225857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.225958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.226048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.226276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.226498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.226805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.226928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.227055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.227153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.227181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.911 qpair failed and we were unable to recover it. 00:27:58.911 [2024-11-19 02:03:47.227323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.911 [2024-11-19 02:03:47.227443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.227467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.227633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.227807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.227833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.227978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.228262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.228533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.228794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.228914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.229047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.229160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.229185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.229305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.229430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.229458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.229593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.229717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.229743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.229885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.230161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.230466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.230660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.230805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.230921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.231198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.231517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.231789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.231959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.232074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.232319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.232550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.232858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.232974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.233135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.233229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.233254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.233340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.233455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.233498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.233653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.233784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.233812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.233917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.234181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.234429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.234727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.234835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.912 qpair failed and we were unable to recover it. 00:27:58.912 [2024-11-19 02:03:47.234972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.235099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.912 [2024-11-19 02:03:47.235128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.235218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.235353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.235382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.235527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.235661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.235695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.235833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.235987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.236110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.236374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.236630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.236877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.236992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.237099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.237182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.237207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.237319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.237453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.237481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.237575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.237696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.237725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.237865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.237990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.238016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.238122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.238248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.238290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.238408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.238484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.238509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.238625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.238759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.238785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.238908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.239177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.239433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.239624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.239793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.239918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.240204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.240443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.240679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.240823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.240969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.241167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.241485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.241809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.241953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.242056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.242159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.242187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.242321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.242452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.913 [2024-11-19 02:03:47.242480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.913 qpair failed and we were unable to recover it. 00:27:58.913 [2024-11-19 02:03:47.242597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.242722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.242747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.242837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.242947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.242975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.243133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.243236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.243264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.243406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.243504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.243529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.243662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.243795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.243824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.243958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.244266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.244534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.244811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.244931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.245040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.245147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.245172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.245261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.245437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.245465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.245624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.245762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.245789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.245877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.246186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.246460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.246723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.246870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.247020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.247272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.247552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.247787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.247939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.248095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.248214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.248241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.248348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.248490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.248515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.248674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.248802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.248829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.248951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.249112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.249138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.249248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.249364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-19 02:03:47.249390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.914 qpair failed and we were unable to recover it. 00:27:58.914 [2024-11-19 02:03:47.249564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.249646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.249677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.249821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.249993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.250018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.250162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.250272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.250296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.250431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.250552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.250580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.250732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.250859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.250886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.251020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.251298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.251547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.251822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.251986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.252101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.252251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.252279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.252412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.252531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.252558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.252705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.252825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.252850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.252932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.253209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.253519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.253831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.253982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.254106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.254230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.254258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.254423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.254506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.254531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.254687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.254790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.254819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.254911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.255178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.255408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.255736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.255877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.256016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.256257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.256502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.256773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.256911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.257018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.257167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.257194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.915 qpair failed and we were unable to recover it. 00:27:58.915 [2024-11-19 02:03:47.257320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.257444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.915 [2024-11-19 02:03:47.257471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.257610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.257706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.257733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.257868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.257967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.257997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.258094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.258194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.258220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.258364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.258453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.258478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.258614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.258767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.258793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.258904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.259167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.259427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.259687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.259796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.259922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.260169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.260452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.260732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.260839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.260973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.261258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.261521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.261824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.261956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.262113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.262203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.262232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.262337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.262424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.262449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.262609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.262751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.262777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.262862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.262971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.263014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.263123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.263205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.263230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.263345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.263487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.263515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.263615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.263807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.263836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.263946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.264207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.264443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.264726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.916 [2024-11-19 02:03:47.264868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.916 qpair failed and we were unable to recover it. 00:27:58.916 [2024-11-19 02:03:47.264954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.265228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.265537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.265780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.265945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.266034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.266342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.266578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.266826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.266943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.267082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.267191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.267216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.267350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.267525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.267553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.267679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.267832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.267860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.267970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.268227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.268484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.268758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.268898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.269066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.269305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.269568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.269772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.269936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.270068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.270332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.270521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.270803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.270918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.271054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.271283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.271561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.271858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.271968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.272068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.272193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.272222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.917 qpair failed and we were unable to recover it. 00:27:58.917 [2024-11-19 02:03:47.272346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.917 [2024-11-19 02:03:47.272458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.272485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.272596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.272713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.272738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.272824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.272961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.272988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.273121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.273341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.273564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.273814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.273966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.274074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.274302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.274589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.274827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.274965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.275090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.275178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.275201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.275379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.275508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.275532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.275685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.275773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.275797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.275919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.275991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.276014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.276130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.276221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.276262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.276370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.276488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.276512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.276626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.276744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.276771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.276910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.277159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.277388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.277603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.277885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.277996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.278020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.278126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.278261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.278289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.278447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.278545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.278575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.278684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.278765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.278789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.278896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.279014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.279041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.279164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.279248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.279275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.918 [2024-11-19 02:03:47.279404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.279486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.918 [2024-11-19 02:03:47.279510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.918 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.279605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.279707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.279732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.279887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.279978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.280111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.280391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.280604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.280852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.280988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.281154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.281278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.281305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.281427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.281549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.281575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.281711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.281805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.281829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.281915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.282197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.282437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.282634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.282837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.282961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.283252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.283527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.283764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.283911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.284052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.284338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.284586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.284868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.284977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.285091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.285224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.285252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.285371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.285496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.285523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.919 qpair failed and we were unable to recover it. 00:27:58.919 [2024-11-19 02:03:47.285652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.285771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.919 [2024-11-19 02:03:47.285796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.285882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.285987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.286015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.286122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.286270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.286297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.286434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.286576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.286603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.286716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.286833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.286862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.286964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.287211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.287482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.287741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.287866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.287992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.288244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.288496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.288811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.288954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.289092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.289220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.289247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.289338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.289473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.289502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.289648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.289807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.289831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.289961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.290252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.290472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.290716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.290870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.290966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.291221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.291445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.291770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.291884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.292012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.292230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.292556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.292837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.292999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.293082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.293254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.920 [2024-11-19 02:03:47.293281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.920 qpair failed and we were unable to recover it. 00:27:58.920 [2024-11-19 02:03:47.293404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.293524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.293551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.293695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.293807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.293831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.293960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.294232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.294476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.294706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.294866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.294993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.295264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.295525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.295778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.295920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.296059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.296170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.296194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.296337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.296459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.296485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.296614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.296724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.296751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.296895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.296977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.297086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.297307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.297567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.297800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.297951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.298081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.298215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.298239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.298324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.298406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.298431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.298591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.298749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.298776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.298901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.298999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.299155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.299395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.299645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.299868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.299980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.300124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.300251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.300279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.300367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.300533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.300557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.921 qpair failed and we were unable to recover it. 00:27:58.921 [2024-11-19 02:03:47.300685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.921 [2024-11-19 02:03:47.300830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.300854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.300985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.301293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.301534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.301814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.301934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.302038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.302190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.302217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.302332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.302412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.302435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.302550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.302682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.302706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.302853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.302985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.303013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.303144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.303281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.303305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.303431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.303562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.303589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.303736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.303854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.303878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.303977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.304229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.304500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.304793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.304932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.305072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.305324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.305609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.305819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.305975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.306107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.306358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.306553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.306829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.306953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.307094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.307342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.307618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.307849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.307958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.922 [2024-11-19 02:03:47.308046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.308173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.922 [2024-11-19 02:03:47.308200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.922 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.308303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.308418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.308444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.308555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.308671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.308695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.308827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.308954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.308982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.309115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.309210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.309238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.309377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.309497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.309522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.309617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.309790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.309818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.309955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.310216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.310513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.310783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.310902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.311010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.311245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.311554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.311745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.311851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.312017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.312335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.312588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.312784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.312896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.313018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.313192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.313216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.313365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.313502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.313543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.313697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.313785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.313812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.313930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.314154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.314376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.923 [2024-11-19 02:03:47.314625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.923 [2024-11-19 02:03:47.314808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.923 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.314907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.315171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.315474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.315722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.315881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.315981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.316234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.316545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.316791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.316918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.317048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.317170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.317196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.317340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.317428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.317454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.317594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.317728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.317754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.317859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.318145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.318437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.318693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.318859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.318974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.319248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.319498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.319778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.319941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.320054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.320292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.320559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.320837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.320964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.321061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.321186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.321214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.321370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.321491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.321515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.321658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.321780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.321808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.321906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.322054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.322081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.322215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.322294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.924 [2024-11-19 02:03:47.322319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.924 qpair failed and we were unable to recover it. 00:27:58.924 [2024-11-19 02:03:47.322452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.322573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.322601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.322748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.322862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.322886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.322980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.323251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.323517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.323789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.323926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.324011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.324270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.324557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.324757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.324858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.324937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.325187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.325423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.325603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.325768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.325888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.326190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.326473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.326739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.326849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.326979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.327217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.327525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.327804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.327957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.328082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.328361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.328572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.328827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.328950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.329067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.329204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.329233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.329365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.329520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.329546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.925 qpair failed and we were unable to recover it. 00:27:58.925 [2024-11-19 02:03:47.329669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.329793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.925 [2024-11-19 02:03:47.329820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.329921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.330188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.330451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.330764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.330873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.330958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.331219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.331507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.331802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.331972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.332064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.332197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.332225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.332356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.332466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.332489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.332624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.332751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.332777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.332914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.333207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.333492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.333751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.333869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.333982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.334098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.334123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.334280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.334375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.334401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.334554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.334703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.334732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.334905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.335137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.335354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.335649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.335846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.335988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.336129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.336224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.336250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.336385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.336475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.336499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.336665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.336801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.336829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.336952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.337050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.337079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.926 [2024-11-19 02:03:47.337181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.337262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.926 [2024-11-19 02:03:47.337287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.926 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.337375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.337502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.337528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.337623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.337734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.337759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.337842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.337953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.337978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.338145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.338246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.338273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.338363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.338451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.338479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.338608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.338734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.338760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.338899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.339159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.339405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.339650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.339812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.339958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.340219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.340476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.340737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.340888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.341022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.341219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.341450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.341739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.341874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.342013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.342235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.342502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.342748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.342881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.342975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.343228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.343449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.343719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.343867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.343980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.344070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.344095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.344212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.344285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.344309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.927 qpair failed and we were unable to recover it. 00:27:58.927 [2024-11-19 02:03:47.344425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.927 [2024-11-19 02:03:47.344548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.344574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.344684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.344772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.344797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.344896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.345172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.345491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.345832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.345975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.346093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.346356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.346579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.346807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.346962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.347063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.347189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.347213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.347350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.347472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.347498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.347609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.347767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.347794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.347957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.348185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.348437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.348667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.348782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.348911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.349143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.349457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.349712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.349855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.349987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.350218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.350488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.350731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.350886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-11-19 02:03:47.351018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.928 [2024-11-19 02:03:47.351103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.351126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.351265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.351416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.351443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.351571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.351699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.351727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.351858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.351969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.351993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.352127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.352253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.352281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.352403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.352558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.352584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.352690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.352813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.352838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.352964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.353276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.353505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.353807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.353928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.354018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.354281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.354555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.354798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.354903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.355057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.355141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.355164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.355246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.355409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.355436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.355552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.355649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.355692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.355803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.355980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.356138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.356412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.356699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.356901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.356987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.357105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.357382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.357604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.357870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.357985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.358097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.358187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.358211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-11-19 02:03:47.358306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.358413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.929 [2024-11-19 02:03:47.358437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.358518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.358648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.358675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.358815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.358904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.358928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.359081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.359350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.359615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.359833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.359972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.360114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.360221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.360244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.360388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.360501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.360524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.360659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.360794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.360822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.360958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.361193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.361466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.361761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.361912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.362042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.362277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.362526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.362772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.362915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.363019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.363286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.363548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.363817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.363953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.364107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.364245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.364272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.364418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.364554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.364579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.364686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.364820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.364844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.364983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.365224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.365478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.365793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.365917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.930 qpair failed and we were unable to recover it. 00:27:58.930 [2024-11-19 02:03:47.366021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.930 [2024-11-19 02:03:47.366098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.366127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.366236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.366347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.366374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.366499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.366618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.366652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.366797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.366880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.366904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.367031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.367124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.367152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.367287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.367395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.367420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.367529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.367673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.367698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.367838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.367987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.368015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.368141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.368299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.368326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.368487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.368594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.368618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.368765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.368895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.368927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.369051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.369171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.369199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.369313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.369454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.369478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.369661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.369802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.369826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.369956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.370247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.370446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.370660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.370843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.370961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.371179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.371462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.371737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.371923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.372028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.372333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.372600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.372846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.372950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.373061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.373191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.373217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.373357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.373475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.373500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.931 [2024-11-19 02:03:47.373660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.373786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.931 [2024-11-19 02:03:47.373813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.931 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.373939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.374192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.374435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.374768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.374875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.374986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.375257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.375506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.375748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.375912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.376022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.376149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.376175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.376328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.376479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.376505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.376616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.376707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.376733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.376847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.376985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.377119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.377372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.377585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.377880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.377981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.378009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.378143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.378280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.378305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.378412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.378507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.378534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.378683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.378776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.378803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.378935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.379185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.379485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.379790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.379924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.380020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.380119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.380146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.380240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.380361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.932 [2024-11-19 02:03:47.380387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.932 qpair failed and we were unable to recover it. 00:27:58.932 [2024-11-19 02:03:47.380513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.380609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.380642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.380779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.380864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.380890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.381026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.381168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.381192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.381303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.381416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.381439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.381584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.381664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.381688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.381845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.381996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.382022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.382178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.382284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.382308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.382428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.382506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.382531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.382646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.382765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.382791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.382921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.383139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.383448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.383667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.383857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.383997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.384075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.384181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.384205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.384306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.384421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.384444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.384577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.384670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.384696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.384832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.384984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.385011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.385113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.385226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.385250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.385388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.385510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.385536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.385666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.385823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.385848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.385990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.386231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.386500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.386786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.386919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.387028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.387126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.387156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.387243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.387364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.387391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.387526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.387649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.387674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.933 qpair failed and we were unable to recover it. 00:27:58.933 [2024-11-19 02:03:47.387783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.933 [2024-11-19 02:03:47.387896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.387936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.388032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.388286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.388512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.388776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.388955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.389109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.389348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.389608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.389886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.389996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.390116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.390250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.390276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.390402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.390548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.390572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.390677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.390820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.390844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.390967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.391241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.391517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.391797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.391947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.392072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.392163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.392191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.392357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.392470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.392494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.392598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.392729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.392757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.392862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.393163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.393414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.393748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.393882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.393997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.394272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.394540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.394821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.394925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.395091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.395188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.395215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.395340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.395468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.395495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.395672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.395799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.934 [2024-11-19 02:03:47.395839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.934 qpair failed and we were unable to recover it. 00:27:58.934 [2024-11-19 02:03:47.395993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.396233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.396484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.396667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.396829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.396957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.397260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.397489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.397748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.397905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.398036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.398305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.398560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.398846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.398955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.399050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.399247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.399518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.399767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.399900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.400015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.400277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.400523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.400801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.400994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.401108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.401302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.401557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.401840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.401981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.402095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.402190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.402219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.402346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.402484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.402508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.402701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.402788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.402813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.402932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.403018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.403045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.403132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.403238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.403262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.403383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.403516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.935 [2024-11-19 02:03:47.403545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.935 qpair failed and we were unable to recover it. 00:27:58.935 [2024-11-19 02:03:47.403649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.403747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.403772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.403852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.403961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.404004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.404132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.404263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.404290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.404387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.404518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.404559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.404673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.404839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.404878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.404989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.405231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.405528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.405786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.405893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.405970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.406194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.406421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.406700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.406890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.407030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.407288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.407506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.407813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.407962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.408127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.408228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.408252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.408390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.408475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.408502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.408589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.408732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.408776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.408903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.408997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.409022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.409188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.409315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.409346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.409469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.409620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.409676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.409790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.409932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.409957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.410123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.410364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.410656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.410871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.410991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.411121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.411200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.411224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.411312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.411451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.411480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.411577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.411720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.936 [2024-11-19 02:03:47.411744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.936 qpair failed and we were unable to recover it. 00:27:58.936 [2024-11-19 02:03:47.411886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.937 [2024-11-19 02:03:47.412041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.937 [2024-11-19 02:03:47.412065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.937 qpair failed and we were unable to recover it. 00:27:58.937 [2024-11-19 02:03:47.412211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.937 [2024-11-19 02:03:47.412323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.937 [2024-11-19 02:03:47.412350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.937 qpair failed and we were unable to recover it. 00:27:58.937 [2024-11-19 02:03:47.412526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.937 [2024-11-19 02:03:47.412688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.937 [2024-11-19 02:03:47.412714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:58.937 qpair failed and we were unable to recover it. 00:27:58.937 [2024-11-19 02:03:47.412813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.412906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.412950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.413087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.413178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.413202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.413331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.413424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.413451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.413557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.413696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.413734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.413867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.413973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.414006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.414158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.414297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.414340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.414445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.414541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.414569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.414687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.414832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.414858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.414997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.415123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.415154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.415323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.415451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.415476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.219 [2024-11-19 02:03:47.415622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.415745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.219 [2024-11-19 02:03:47.415772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.219 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.415928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.416159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.416467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.416740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.416896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.417016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.417145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.417180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.417330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.417446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.417473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.417660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.417778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.417804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.417944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.418190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.418436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.418683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.418831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.418926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.419164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.419436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.419733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.419873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.420039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.420151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.420177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.420289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.420469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.420513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.420690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.420823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.420848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.420963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.421182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.421400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.421662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.421807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.421935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.422219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.422504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.422735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.422844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.422974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.423086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.423111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.423236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.423360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.220 [2024-11-19 02:03:47.423387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.220 qpair failed and we were unable to recover it. 00:27:59.220 [2024-11-19 02:03:47.423513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.423603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.423631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.423772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.423891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.423916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.424091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.424368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.424619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.424858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.424974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.425100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.425220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.425248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.425395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.425545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.425586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.425756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.425877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.425904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.426069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.426193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.426220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.426357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.426475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.426502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.426622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.426749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.426778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.426903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.427162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.427361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.427608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.427775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.427887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.428158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.428429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.428699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.428836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.428949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.429228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.429511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.429824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.429957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.430075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.430341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.430546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.430794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.221 [2024-11-19 02:03:47.430901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.221 qpair failed and we were unable to recover it. 00:27:59.221 [2024-11-19 02:03:47.431015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.431102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.431128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.431307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.431448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.431472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.431625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.431769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.431794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.431908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.432169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.432468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.432746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.432854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.432989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.433233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.433517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.433772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.433890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.434013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.434277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.434548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.434811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.434928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.435035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.435244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.435550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.435806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.435925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.436054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.436299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.436575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.436862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.436992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.437118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.437213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.437241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.437353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.437465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.437491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.437623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.437750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.437777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.437893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.438016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.438043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.438208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.438289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.438313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.222 qpair failed and we were unable to recover it. 00:27:59.222 [2024-11-19 02:03:47.438453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.222 [2024-11-19 02:03:47.438538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.438561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.438648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.438757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.438784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.438924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.439185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.439490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.439752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.439868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.439997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.440238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.440502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.440761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.440921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.441002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.441271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.441542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.441807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.441961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.442093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.442208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.442233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.442356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.442444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.442471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.442573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.442693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.442722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.442894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.442980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.443005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.443087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.443206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.443248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.443374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.443523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.443550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.443715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.443828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.443852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.444010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.444234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.444497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.444687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.444786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.444893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.445220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.445466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.445720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.223 [2024-11-19 02:03:47.445828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.223 qpair failed and we were unable to recover it. 00:27:59.223 [2024-11-19 02:03:47.445925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.446227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.446545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.446792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.446933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.447063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.447188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.447212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.447346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.447496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.447522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.447714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.447801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.447828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.447932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.448230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.448497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.448686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.448820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.448932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.449245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.449468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.449784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.449902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.450041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.450341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.450650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.450871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.450976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.451140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.451267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.451294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.451451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.451542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.451569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.451698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.451843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.451868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.452011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.452144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.452176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.224 [2024-11-19 02:03:47.452299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.452381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.224 [2024-11-19 02:03:47.452408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.224 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.452510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.452616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.452647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.452758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.452884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.452911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.453034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.453274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.453524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.453785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.453975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.454079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.454216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.454241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.454382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.454515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.454541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.454679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.454833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.454866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.455009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.455103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.455128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.455288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.455439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.455466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.455626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.455730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.455757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.455875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.455988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.456092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.456382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.456669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.456910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.456988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.457012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.457157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.457244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.457271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.457411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.457544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.457577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.457665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.457800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.457825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.457911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.458235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.458547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.458818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.458968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.459066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.459297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.459509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.459779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.459921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.225 qpair failed and we were unable to recover it. 00:27:59.225 [2024-11-19 02:03:47.460006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.225 [2024-11-19 02:03:47.460089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.460114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.460221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.460316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.460343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.460473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.460612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.460643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.460780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.460899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.460928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.461051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.461274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.461495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.461795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.461911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.462080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.462323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.462581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.462833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.462979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.463137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.463230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.463257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.463391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.463507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.463533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.463646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.463758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.463783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.463889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.463993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.464022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.464109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.464214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.464241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.464381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.464498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.464524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.464665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.464770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.464798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.464925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.465176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.465424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.465647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.465885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.465998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.466022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.466112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.466201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.466226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.466345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.466453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.466480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.466618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.466776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.466801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.466915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.467069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.467096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.226 qpair failed and we were unable to recover it. 00:27:59.226 [2024-11-19 02:03:47.467198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.226 [2024-11-19 02:03:47.467319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.467346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.467478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.467587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.467611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.467715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.467833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.467859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.467955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.468249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.468456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.468650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.468771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.468881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.469165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.469460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.469733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.469900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.470060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.470189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.470215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.470371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.470526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.470553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.470740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.470820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.470844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.470980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.471283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.471521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.471828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.471984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.472099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.472333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.472610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.472847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.472970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.473133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.473253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.473277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.473387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.473523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.473549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.473630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.473745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.473788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.473926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.474215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.474448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.474773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.227 [2024-11-19 02:03:47.474888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.227 qpair failed and we were unable to recover it. 00:27:59.227 [2024-11-19 02:03:47.475019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.475263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.475551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.475829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.475977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.476112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.476394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.476615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.476887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.476995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.477137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.477671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.477705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.477836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.477942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.477970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.478116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.478375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.478586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.478823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.478954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.479042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.479304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.479542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.479844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.479991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.480103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.480227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.480255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.480384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.480485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.480512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.480612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.480759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.480784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.480899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.480989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.481017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.481175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.481298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.481325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.481458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.481534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.481559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.228 [2024-11-19 02:03:47.481656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.481782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.228 [2024-11-19 02:03:47.481810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.228 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.481934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.482212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.482424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.482701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.482815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.482918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.483145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.483391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.483649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.483847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.483955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.484072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.484372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.484598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.484821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.484939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.485126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.485205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.485238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.485389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.485538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.485564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.485676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.485794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.485837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.486008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.486241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.486548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.486791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.486933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.487020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.487250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.487552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.487814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.487945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.488030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.488283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.488547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.488760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.229 [2024-11-19 02:03:47.488940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.229 qpair failed and we were unable to recover it. 00:27:59.229 [2024-11-19 02:03:47.489076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.489347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.489584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.489844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.489988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.490102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.490380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.490633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.490884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.490996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.491123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.491274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.491300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.491453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.491569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.491593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.491706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.491786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.491813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.491912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.492173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.492447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.492674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.492833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.492950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.493212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.493452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.493674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.493836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.493990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.494270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.494528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.494805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.494959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.495090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.495365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.495587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.495793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.495945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.496110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.496188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.496212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.230 qpair failed and we were unable to recover it. 00:27:59.230 [2024-11-19 02:03:47.496312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.230 [2024-11-19 02:03:47.496439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.496466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.496562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.496681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.496708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.496820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.496940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.496964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.497130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.497255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.497286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.497414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.497504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.497531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.497651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.497766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.497791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.497950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.498246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.498512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.498778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.498908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.499002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.499277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.499510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.499740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.499846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.499932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.500183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.500402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.500642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.500835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.500975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.501065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.501313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.501525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.501769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.501870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.501987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.502301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.502494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.502830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.502929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.503038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.503169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.503193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.231 qpair failed and we were unable to recover it. 00:27:59.231 [2024-11-19 02:03:47.503312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.231 [2024-11-19 02:03:47.503439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.503466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.503569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.503727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.503752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.503895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.504178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.504410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.504673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.504867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.504993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.505099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.505288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.505518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.505783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.505881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.506038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.506131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.506159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.506279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.506405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.506432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.506598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.506727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.506753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.506870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.506998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.507025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.507116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.507234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.507261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.507401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.507512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.507536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.507661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.507755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.507783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.507906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.508212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.508524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.508801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.508931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.509073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.509159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.509183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.509347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.509476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.509503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.509661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.509762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.509789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.509928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.510204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.510517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.232 [2024-11-19 02:03:47.510786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.232 [2024-11-19 02:03:47.510926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.232 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.511056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.511214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.511238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.511363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.511478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.511506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.511629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.511759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.511784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.511890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.511980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.512103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.512346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.512551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.512795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.512935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.513037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.513256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.513502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.513798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.513916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.514028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.514107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.514133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.514303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.514423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.514450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.514590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.514669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.514695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.514856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.514983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.515010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.515148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.515257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.515281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.515372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.515457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.515481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.515649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.515781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.515809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.515927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.516202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.516443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.516679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.516812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.516912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.517031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.517055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.517139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.517222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.233 [2024-11-19 02:03:47.517262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.233 qpair failed and we were unable to recover it. 00:27:59.233 [2024-11-19 02:03:47.517386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.517482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.517509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.517647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.517765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.517789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.517884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.517991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.518100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.518382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.518615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.518840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.518958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.519065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.519150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.519174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.519313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.519442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.519470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.519627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.519734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.519761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.519895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.520162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.520435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.520693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.520792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.520886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.521157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.521427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.521695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.521810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.521907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.522204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.522424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.522713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.522857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.522938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.523213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.523427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.523724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.523838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.523913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.524021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.524046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.524170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.524294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.524318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.234 qpair failed and we were unable to recover it. 00:27:59.234 [2024-11-19 02:03:47.524451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.524548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.234 [2024-11-19 02:03:47.524575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.524711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.524822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.524847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.525026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.525118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.525147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.525283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.525426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.525450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.525583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.525725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.525753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.525917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.526237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.526496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.526811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.526959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.527089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.527281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.527492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.527793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.527923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.528024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.528227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.528508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.528747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.528871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.528959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.529271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.529505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.529752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.529879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.530020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.530163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.530187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.530350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.530503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.530529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.530627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.530799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.530826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.530992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.531244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.531518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.531794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.531929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.532060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.532208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.235 [2024-11-19 02:03:47.532235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.235 qpair failed and we were unable to recover it. 00:27:59.235 [2024-11-19 02:03:47.532352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.532502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.532542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.532656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.532768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.532793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.532892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.533182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.533463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.533724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.533879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.533978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.534231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.534472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.534755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.534863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.534976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.535207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.535501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.535764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.535909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.536015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.536229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.536538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.536844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.536965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.537050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.537304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.537581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.537802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.537951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.538118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.538200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.538225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.538358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.538479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.538507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.538659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.538808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.538835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.538941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.539175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.539467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.236 qpair failed and we were unable to recover it. 00:27:59.236 [2024-11-19 02:03:47.539728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.236 [2024-11-19 02:03:47.539831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.539940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.540192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.540481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.540723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.540844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.540970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.541249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.541488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.541816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.541947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.542062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.542341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.542543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.542820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.542935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.543050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.543275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.543524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.543831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.543942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.544096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.544229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.544253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.544377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.544506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.544533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.544670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.544812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.544837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.544969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.545249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.545496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.545808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.545962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.546090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.546361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.546588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.237 qpair failed and we were unable to recover it. 00:27:59.237 [2024-11-19 02:03:47.546823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.237 [2024-11-19 02:03:47.546939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.547028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.547273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.547532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.547796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.547944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.548065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.548357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.548554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.548778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.548935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.549078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.549312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.549557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.549828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.549963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.550066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.550157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.550184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.550337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.550471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.550495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.550614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.550774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.550815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.550907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.551397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.551614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.551853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.551977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.552145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.552373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.552621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.552841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.552955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.553037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.553176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.553203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.553374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.553486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.553510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.238 qpair failed and we were unable to recover it. 00:27:59.238 [2024-11-19 02:03:47.553629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.238 [2024-11-19 02:03:47.553724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.553748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.553876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.553965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.553992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.554154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.554268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.554292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.554403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.554510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.554534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.554676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.554807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.554832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.554915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.555266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.555502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.555778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.555893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.556055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.556319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.556521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.556786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.556960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.557069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.557344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.557599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.557789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.557923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.558020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.558277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.558528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.558766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.558916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.559042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.559296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.559540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.559808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.559969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.560139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.560292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.560335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.560470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.560576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.560603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.560757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.560882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.560908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.239 [2024-11-19 02:03:47.560998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.561128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.239 [2024-11-19 02:03:47.561170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.239 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.561256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.561399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.561424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.561511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.561603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.561628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.561753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.561863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.561888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.562003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.562254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.562479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.562768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.562875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.562990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.563234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.563451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.563722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.563840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.563947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.564160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.564346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.564536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.564760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.564950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.565055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.565317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.565558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.565835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.565947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.566048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.566172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.566200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.566331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.566479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.566506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.566607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.566763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.566788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.566910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.567158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.567407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.567651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.567779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.567864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.568026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.568053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.240 qpair failed and we were unable to recover it. 00:27:59.240 [2024-11-19 02:03:47.568149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.240 [2024-11-19 02:03:47.568277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.568304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.568429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.568552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.568578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.568698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.568808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.568833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.568956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.569172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.569434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.569692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.569801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.569945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.570222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.570481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.570795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.570900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.571034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.571184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.571211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.571313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.571439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.571466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.571554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.571722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.571747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.571889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.571982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.572009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.572137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.572274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.572298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.572426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.572518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.572545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.572668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.572795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.572824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.572902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.573212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.573419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.573701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.573868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.574037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.574300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.574546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.574848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.574956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.575097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.575195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.575222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.575354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.575433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.575462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.241 qpair failed and we were unable to recover it. 00:27:59.241 [2024-11-19 02:03:47.575540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.241 [2024-11-19 02:03:47.575645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.575673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.575783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.575891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.575931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.576041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.576273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.576570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.576828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.576948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.577070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.577333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.577585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.577769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.577947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.578074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.578163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.578191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.578352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.578470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.578494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.578604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.578742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.578769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.578862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.578981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.579008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.579149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.579262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.579286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.579412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.579530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.579557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.579687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.579816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.579844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.579945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.580209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.580487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.580780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.580888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.581017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.581327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.581591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.581809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.581966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.582084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.582236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.242 [2024-11-19 02:03:47.582263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.242 qpair failed and we were unable to recover it. 00:27:59.242 [2024-11-19 02:03:47.582396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.582510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.582551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.582688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.582777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.582801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.582891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.583223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.583420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.583753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.583919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.584041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.584266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.584522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.584801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.584941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.585078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.585188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.585212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.585343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.585481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.585506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.585620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.585774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.585799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.585931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.586203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.586469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.586798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.586902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.587036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.587167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.587192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.587311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.587420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.587444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.587571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.587705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.587734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.587861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.587990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.588018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.588134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.588221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.588245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.588370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.588493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.588521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.588604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.588763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.588791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.588895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.589192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.589497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.589780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.589921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.243 qpair failed and we were unable to recover it. 00:27:59.243 [2024-11-19 02:03:47.590038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.243 [2024-11-19 02:03:47.590117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.590141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.590259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.590339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.590363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.590503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.590586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.590613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.590754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.590896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.590920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.590996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.591129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.591156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.591286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.591398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.591424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.591568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.591719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.591747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.591902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.592221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.592466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.592749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.592913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.593057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.593295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.593536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.593771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.593888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.593968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.594260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.594534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.594807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.594966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.595119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.595240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.595268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.595373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.595492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.595516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.595631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.595714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.595739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.595885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.596163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.596462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.596788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.596924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.597044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.597133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.597158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.597247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.597359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.597400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.244 [2024-11-19 02:03:47.597530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.597663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.244 [2024-11-19 02:03:47.597692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.244 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.597804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.597896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.597921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.598055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.598140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.598167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.598293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.598415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.598443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.598575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.598694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.598719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.598862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.598982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.599009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.599097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.599182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.599209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.599342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.599457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.599482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.599610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.599773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.599803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.599943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.600181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.600409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.600743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.600879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.600997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.601242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.601522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.601812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.601920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.602054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.602159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.602188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.602321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.602416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.602444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.602601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.602713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.602739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.602836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.602993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.603021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.603120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.603245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.603274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.603426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.603550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.603578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.603716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.603835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.603862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.604004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.604132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.604160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.604294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.604424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.604452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.604575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.604740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.604766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.604889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.604974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.605000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.605116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.605238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.605264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.245 qpair failed and we were unable to recover it. 00:27:59.245 [2024-11-19 02:03:47.605400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.245 [2024-11-19 02:03:47.605539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.605564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.605680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.605837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.605866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.605993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.606219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.606506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.606767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.606901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.607057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.607184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.607212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.607338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.607455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.607483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.607621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.607717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.607742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.607875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.608152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.608433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.608666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.608810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.608935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.609250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.609500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.609783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.609895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.610032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.610265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.610472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.610809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.610949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.611051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.611285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.611514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.611795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.611940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.612062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.612185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.612213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.612356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.612469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.612494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.612625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.612766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.612792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.246 [2024-11-19 02:03:47.612926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.613023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.246 [2024-11-19 02:03:47.613051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.246 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.613214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.613364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.613406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.613491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.613622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.613658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.613751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.613879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.613906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.614074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.614156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.614180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.614308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.614472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.614499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.614620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.614759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.614787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.614918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.615197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.615451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.615722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.615894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.616029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.616261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.616546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.616737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.616936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.617049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.617212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.617240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.617381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.617508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.617534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.617642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.617769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.617796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.617894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.618185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.618444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.618628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.618802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.618946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.619201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.619434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.619665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.247 [2024-11-19 02:03:47.619802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.247 qpair failed and we were unable to recover it. 00:27:59.247 [2024-11-19 02:03:47.619888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.619989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.620016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.620174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.620268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.620294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.620452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.620596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.620621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.620765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.620864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.620892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.621062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.621142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.621167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.621263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.621340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.621368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.621496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.621614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.621661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.621804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.621971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.622012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.622127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.622262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.622287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.622444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.622545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.622574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.622664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.622756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.622784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.622895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.623169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.623444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.623667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.623804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.623957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.624203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.624468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.624653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.624879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.624992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.625135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.625356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.625573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.625840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.625981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.626113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.626246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.626271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.248 qpair failed and we were unable to recover it. 00:27:59.248 [2024-11-19 02:03:47.626402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.248 [2024-11-19 02:03:47.626553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.626580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.626694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.626836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.626860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.626967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.627209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.627470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.627766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.627881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.628007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.628156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.628182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.628319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.628440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.628465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.628662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.628804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.628828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.628920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.629193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.629448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.629711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.629826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.629957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.630208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.630434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.630687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.630832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.630950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.631075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.631102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.631229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.631383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.631410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.631543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.631686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.631711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.631853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.631981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.632008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.632136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.632289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.632316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.632471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.632553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.632577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.632713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.632808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.632835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.632925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.633189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.633474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.633737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.633885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.249 [2024-11-19 02:03:47.633991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.634102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.249 [2024-11-19 02:03:47.634126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.249 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.634214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.634351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.634378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.634478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.634624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.634667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.634781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.634860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.634883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.634991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.635150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.635177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.635383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.635505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.635533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.635645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.635782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.635806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.636025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.636269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.636514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.636822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.636995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.637134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.637225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.637251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.637367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.637446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.637470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.637606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.637765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.637792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.637918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.638207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.638424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.638627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.638911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.638996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.639022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.639128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.639289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.639314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.639396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.639554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.639581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.639724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.639837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.639861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.639982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.640242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.640432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.640747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.640904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.640992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.641112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.641138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.641303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.641392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.641418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.641561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.641658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.641685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.250 qpair failed and we were unable to recover it. 00:27:59.250 [2024-11-19 02:03:47.641836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.250 [2024-11-19 02:03:47.641981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.642004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.642120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.642205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.642230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.642420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.642534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.642558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.642713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.642794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.642818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.642933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.643274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.643495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.643759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.643897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.644027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.644180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.644206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.644359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.644500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.644525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.644641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.644737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.644761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.644876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.645169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.645422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.645653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.645806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.645927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.646210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.646494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.646810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.646985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.647087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.647328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.647569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.647800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.647938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.648075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.648220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.648247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.648347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.648479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.648505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.648653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.648759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.648783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.648926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.649011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.649038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.649189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.649328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.251 [2024-11-19 02:03:47.649352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.251 qpair failed and we were unable to recover it. 00:27:59.251 [2024-11-19 02:03:47.649487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.649655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.649700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.649790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.649900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.649924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.650086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.650332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.650557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.650792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.650905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.651005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.651266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.651575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.651806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.651919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.651999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.652104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.652132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.652271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.652382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.652407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.652597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.652733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.652760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.652980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.653127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.653184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.653334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.653499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.653524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.653642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.653783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.653808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.653976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.654224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.654524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.654769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.654920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.655081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.655208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.655235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.655373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.655460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.655485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.655624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.655726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.655754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.655894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.655985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.656010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.656102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.656207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.656230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.656400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.656535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.656561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.656702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.656785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.656810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.656921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.657002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.657026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.252 qpair failed and we were unable to recover it. 00:27:59.252 [2024-11-19 02:03:47.657181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.252 [2024-11-19 02:03:47.657304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.657332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.657454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.657576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.657604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.657716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.657833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.657858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.657946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.658176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.658486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.658795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.658984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.659097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.659175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.659199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.659344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.659429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.659459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.659579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.659703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.659730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.659891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.660173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.660434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.660740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.660928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.661068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.661306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.661570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.661769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.661911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.662070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.662166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.662198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.662349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.662463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.662502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.662620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.662741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.662766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.662886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.663160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.663407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.663765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.663924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.253 [2024-11-19 02:03:47.664076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.664198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.253 [2024-11-19 02:03:47.664224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.253 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.664364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.664446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.664470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.664563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.664669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.664698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.664825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.664983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.665124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.665307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.665560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.665823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.665934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.666067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.666215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.666241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.666381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.666522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.666547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.666646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.666788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.666812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.666913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.667217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.667431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.667696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.667848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.667943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.668221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.668497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.668763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.668940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.669045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.669274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.669501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.669804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.669945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.670082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.670214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.670238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.670404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.670538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.670561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.670683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.670775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.670799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.670887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.671018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.671044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.671169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.671259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.671285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.671440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.671566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.671589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.254 qpair failed and we were unable to recover it. 00:27:59.254 [2024-11-19 02:03:47.671674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.254 [2024-11-19 02:03:47.671766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.671807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.671925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.672209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.672474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.672715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.672890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.672984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.673299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.673513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.673838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.673980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.674087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.674204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.674231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.674331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.674450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.674477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.674604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.674751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.674777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.674889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.675230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.675448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.675685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.675863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.675998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.676255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.676496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.676743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.676862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.676972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.677257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.677478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.677775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.677912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.678048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.678282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.678535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.678763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.678929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.255 qpair failed and we were unable to recover it. 00:27:59.255 [2024-11-19 02:03:47.679085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.679202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.255 [2024-11-19 02:03:47.679230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.679362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.679444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.679469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.679598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.679751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.679778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.679875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.679962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.679991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.680126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.680234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.680258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.680360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.680453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.680480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.680649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.680729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.680752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.680839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.680990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.681152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.681420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.681667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.681892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.681984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.682154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.682349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.682580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.682798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.682917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.683059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.683312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.683581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.683838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.683972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.684079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.684213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.684239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.684433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.684528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.684557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.684720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.684863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.684886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.685032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.685302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.685599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.685829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.685984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.686140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.686295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.686322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.686453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.686535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.256 [2024-11-19 02:03:47.686560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.256 qpair failed and we were unable to recover it. 00:27:59.256 [2024-11-19 02:03:47.686699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.686824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.686850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.686997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.687146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.687172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.687281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.687398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.687422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.687565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.687696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.687724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.687850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.687981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.688005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.688120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.688203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.688227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.688388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.688627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.688663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.688787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.688915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.688941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.689057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.689284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.689552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.689806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.689925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.690015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.690304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.690589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.690811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.690994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.691088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.691314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.691502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.691763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.691917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.692034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.692175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.692200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.692282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.692418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.692445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.692577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.692782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.692810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.692921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.693056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.693081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.257 [2024-11-19 02:03:47.693209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.693342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.257 [2024-11-19 02:03:47.693369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.257 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.693498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.693617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.693653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.693760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.693851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.693875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.693967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.694074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.694115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.694239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.694364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.694391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.694555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.694671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.694697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.694835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.694962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.695003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.695088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.695195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.695235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.695396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.695506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.695530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.695625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.695748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.695776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.695896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.696206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.696442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.696666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.696818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.696976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.697283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.697557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.697824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.697958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.698098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.698250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.698278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.698377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.698504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.698533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.698666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.698777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.698802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.698916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.699151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.699414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.699625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.699764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.699890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.700204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.700440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.700687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.258 qpair failed and we were unable to recover it. 00:27:59.258 [2024-11-19 02:03:47.700882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.258 [2024-11-19 02:03:47.700992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.701017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.701118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.701242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.701268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.701409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.701493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.701518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.701656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.701770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.701793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.701892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.702213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.702472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.702815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.702974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.703106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.703261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.703288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.703416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.703540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.703567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.703702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.703792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.703817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.703979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.704288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.704535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.704752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.704891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.705018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.705330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.705582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.705844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.705975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.706090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.706176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.706219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.706323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.706451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.706478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.706621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.706745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.706770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.706868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.706995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.707034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.707122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.707257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.707299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.707406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.707483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.707507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.707597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.707724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.707753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.707925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.708010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.708036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.708174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.708287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.708310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.259 [2024-11-19 02:03:47.708420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.708535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.259 [2024-11-19 02:03:47.708562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.259 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.708686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.708782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.708810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.708953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.709272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.709541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.709830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.709938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.710044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.710142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.710168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.710295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.710410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.710436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.710582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.710722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.710747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.710875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.710975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.711001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.711103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.711265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.711292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.711424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.711532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.711556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.711662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.711778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.711805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.711958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.712223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.712491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.712779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.712953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.713052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.713162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.713185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.713271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.713410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.713436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.713538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.713699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.713727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.713886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.713998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.714022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.714162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.714294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.714318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.714459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.714582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.714608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.714852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.714937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.714978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.715111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.715200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.715227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.715352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.715479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.715506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.715605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.715689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.715714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.715825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.716011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.716038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.260 [2024-11-19 02:03:47.716192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.716322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.260 [2024-11-19 02:03:47.716350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.260 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.716464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.716575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.716599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.716690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.716808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.716836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.716963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.717268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.717508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.717783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.717900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.718011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.718226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.718545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.718783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.718922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.719038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.719365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.719646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.719842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.719997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.720124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.720224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.720251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.720383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.720495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.720519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.720684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.720811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.720837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.720964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.721248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.721495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.721798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.721931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.722018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.722233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.722484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.722758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.722873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.722989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.723104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.723144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.723265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.723360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.723386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.261 [2024-11-19 02:03:47.723500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.723575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.261 [2024-11-19 02:03:47.723598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.261 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.723696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.723827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.723853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.723974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.724255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.724453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.724748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.724890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.724994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.725217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.725470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.725762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.725898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.725974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.726222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.726494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.726786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.726913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.727050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.727163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.727190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.727327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.727437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.727460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.727586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.727713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.727741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.727898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.728192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.728409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.728660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.728808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.728940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.729177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.729419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.729696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.729830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.729920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.730000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.730023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.262 qpair failed and we were unable to recover it. 00:27:59.262 [2024-11-19 02:03:47.730164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.262 [2024-11-19 02:03:47.730286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.730312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.730469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.730593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.730621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.730766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.730906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.730930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.731051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.731139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.731167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.731305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.731450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.731475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.731626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.731747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.731771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.731907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.732235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.732429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.732731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.732875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.732963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.733067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.733091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.733252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.733366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.733392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.733541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3566304 Killed "${NVMF_APP[@]}" "$@" 00:27:59.263 [2024-11-19 02:03:47.733629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.733659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.733778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.733864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.733888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 02:03:47 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:59.263 [2024-11-19 02:03:47.733997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.734093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 02:03:47 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:59.263 [2024-11-19 02:03:47.734121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.734219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 02:03:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:59.263 [2024-11-19 02:03:47.734338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.734365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 02:03:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:59.263 [2024-11-19 02:03:47.734501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 02:03:47 -- common/autotest_common.sh@10 -- # set +x 00:27:59.263 [2024-11-19 02:03:47.734614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.734668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.734810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.734908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.734934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.735030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.735290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.735503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.735803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.735918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.736023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.736135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.736160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.736323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.736477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.736501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.736615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.736727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.736753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.736871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.736983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.737006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.737139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.737251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.737281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.263 qpair failed and we were unable to recover it. 00:27:59.263 [2024-11-19 02:03:47.737376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.737507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.263 [2024-11-19 02:03:47.737536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.737664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.737759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.737783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 02:03:47 -- nvmf/common.sh@469 -- # nvmfpid=3566886 00:27:59.264 [2024-11-19 02:03:47.737907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 02:03:47 -- nvmf/common.sh@470 -- # waitforlisten 3566886 00:27:59.264 [2024-11-19 02:03:47.738023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.738050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 02:03:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:59.264 [2024-11-19 02:03:47.738179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 02:03:47 -- common/autotest_common.sh@829 -- # '[' -z 3566886 ']' 00:27:59.264 [2024-11-19 02:03:47.738275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.738302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 02:03:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:59.264 02:03:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:59.264 [2024-11-19 02:03:47.738509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 02:03:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:59.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:59.264 [2024-11-19 02:03:47.738650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.738677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 02:03:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:59.264 [2024-11-19 02:03:47.738807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 02:03:47 -- common/autotest_common.sh@10 -- # set +x 00:27:59.264 [2024-11-19 02:03:47.738933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.738959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.739091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.739221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.739250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.739367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.739486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.739513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.739665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.739800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.739827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.739933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.740198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.740438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.740664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.740814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.740908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.741157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.741371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.741606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.264 [2024-11-19 02:03:47.741743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.264 qpair failed and we were unable to recover it. 00:27:59.264 [2024-11-19 02:03:47.741842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.741935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.741959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.548 qpair failed and we were unable to recover it. 00:27:59.548 [2024-11-19 02:03:47.742046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.548 qpair failed and we were unable to recover it. 00:27:59.548 [2024-11-19 02:03:47.742274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.548 qpair failed and we were unable to recover it. 00:27:59.548 [2024-11-19 02:03:47.742501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.548 qpair failed and we were unable to recover it. 00:27:59.548 [2024-11-19 02:03:47.742778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.742943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.548 qpair failed and we were unable to recover it. 00:27:59.548 [2024-11-19 02:03:47.743058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.743190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.743223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.548 qpair failed and we were unable to recover it. 00:27:59.548 [2024-11-19 02:03:47.743338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.743441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.548 [2024-11-19 02:03:47.743477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.548 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.743594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.743735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.743768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.743880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.743979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.744014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.744125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.744276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.744310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.744446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.744545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.744577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.744718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.744825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.744858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.744967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.745262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.745514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.745716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.745822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.745913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.746168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.746362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.746547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.746777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.746914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.747022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.747277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.747488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.747704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.747896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.747979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.748087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.748316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.748560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.748785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.748892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.749010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.749255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.749484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.749676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.749789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.549 qpair failed and we were unable to recover it. 00:27:59.549 [2024-11-19 02:03:47.749963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.549 [2024-11-19 02:03:47.750073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.750218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.750441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.750663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.750899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.750994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.751131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.751360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.751560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.751757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.751901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.751986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.752197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.752445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.752706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.752809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.752906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.753161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.753415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.753611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.753869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.753980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.754089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.754312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.754570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.754788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.754924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.755018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.755248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.755489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.755746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.755857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.756007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.756122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.756146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.756228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.756340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.756365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.550 [2024-11-19 02:03:47.756448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.756567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.550 [2024-11-19 02:03:47.756591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.550 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.756690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.756806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.756831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.756946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.757175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.757446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.757670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.757866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.757985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.758127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.758431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.758681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.758862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.758967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.759049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.759283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.759608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.759858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.759997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.760118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.760307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.760332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.760471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.760554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.760580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.760774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.760915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.760939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.761063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.761342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.761650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.761880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.761992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.762085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.762373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.762553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.762866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.762976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.763117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.763198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.763224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.763311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.763419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.763444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.763529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.763657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.551 [2024-11-19 02:03:47.763682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.551 qpair failed and we were unable to recover it. 00:27:59.551 [2024-11-19 02:03:47.763773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.763865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.763889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.763974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.764198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.764424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.764681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.764793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.764906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.765130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.765384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.765576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.765852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.765983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.766098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.766300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.766520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.766765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.766874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.766987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.767248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.767479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.767772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.767904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.768051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.768330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.768586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.768814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.768923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.769008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.769317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.769529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.769793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.769896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.770015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.770114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.770139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.770251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.770394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.770418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.552 qpair failed and we were unable to recover it. 00:27:59.552 [2024-11-19 02:03:47.770527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.552 [2024-11-19 02:03:47.770616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.770651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.770736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.770826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.770850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.770935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.771214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.771393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.771666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.771804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.771922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.772143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.772341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.772588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.772811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.772953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.773044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.773315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.773523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.773748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.773887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.774007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.774196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.774443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.774732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.774901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.775026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.775277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.775509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.775726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.775831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.775920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.776034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.776059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.553 qpair failed and we were unable to recover it. 00:27:59.553 [2024-11-19 02:03:47.776138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.553 [2024-11-19 02:03:47.776223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.776247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.776358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.776503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.776528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.776607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.776753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.776778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.776899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.776985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.777094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.777342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.777561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.777772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.777882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.777998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.778248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.778476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.778719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.778825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.778939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.779129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.779413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.779601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.779808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.779971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.780110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.780371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:59.554 [2024-11-19 02:03:47.780453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780474] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:59.554 [2024-11-19 02:03:47.780479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.780559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.780777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.780880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.780998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.781277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.781471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.781724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.781834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.781961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.782103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.782128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.782255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.782339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.782367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.554 [2024-11-19 02:03:47.782513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.782594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.554 [2024-11-19 02:03:47.782618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.554 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.782709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.782833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.782857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.782971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.783200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.783393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.783677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.783901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.783985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.784127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.784333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.784582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.784820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.784952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.785043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.785284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.785506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.785698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.785818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.785923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.786217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.786497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.786809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.786912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.787031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.787250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.787486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.787686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.787788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.787929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.788207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.788436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.788684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.788815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.788897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.789009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.789033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.789146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.789263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.789286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.555 qpair failed and we were unable to recover it. 00:27:59.555 [2024-11-19 02:03:47.789394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.555 [2024-11-19 02:03:47.789471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.789499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.789587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.789684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.789710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.789801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.789883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.789907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.790032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.790226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.790435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.790661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.790855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.790996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.791095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.791313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.791581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.791785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.791892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.792008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.792227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.792473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.792729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.792835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.792950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.793178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.793407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.793618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.793884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.793999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.794090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.794308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.794520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.794806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.794970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.795079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.795164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.795190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.795278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.795389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.795415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.795528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.795645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.795670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.556 qpair failed and we were unable to recover it. 00:27:59.556 [2024-11-19 02:03:47.795762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.556 [2024-11-19 02:03:47.795853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.795878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.795995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.796224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.796482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.796676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.796787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.796932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.797186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.797411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.797665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.797810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.797921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.798202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.798422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.798647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.798792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.798914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.799167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.799390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.799651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.799860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.799966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.800048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.800272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.800521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.800781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.800923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.801006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.801219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.801466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.801725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.801831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.557 [2024-11-19 02:03:47.801945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.802056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.557 [2024-11-19 02:03:47.802081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.557 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.802161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.802384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.802585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.802800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.802913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.803010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.803230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.803457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.803780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.803894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.803977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.804196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.804438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.804660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.804819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.804903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.805117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.805369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.805624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.805776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.805922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.806233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.806470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.806708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.806856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.806973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.807231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.807493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.807753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.807869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.807951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.808065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.808090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.808207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.808293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.808319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.558 qpair failed and we were unable to recover it. 00:27:59.558 [2024-11-19 02:03:47.808408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.558 [2024-11-19 02:03:47.808537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.808562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.808679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.808766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.808791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.808933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.809155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.809358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.809625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.809868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.809982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.810105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.810246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.810271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.810365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.810502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.810528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.810652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.810766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.810791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.810877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.811172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.811396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.811593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.811880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.811996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.812103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.812335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.812527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.812804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.812952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.813075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.813277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.813491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.813726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.813825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.813935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.814144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.814393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.814612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.814883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.814993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.559 [2024-11-19 02:03:47.815078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.815163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.559 [2024-11-19 02:03:47.815187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.559 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.815279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.815389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.815414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.815523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.815646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.815671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.815765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.815852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.815877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.815992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.816249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.816453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.816665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.816858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.816961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.817077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.817162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.817186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.817297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.817382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.817406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.817550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.817678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.817705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.817835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.817916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 EAL: No free 2048 kB hugepages reported on node 1 00:27:59.560 [2024-11-19 02:03:47.817945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.818061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.818352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.818555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.818792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.818901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.819015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.819257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.819527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.819768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.819866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.819960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.820175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.820408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.820593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.820771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.820895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.821004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.821028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.821151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.821265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.821290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.821426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.821546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.821571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.560 qpair failed and we were unable to recover it. 00:27:59.560 [2024-11-19 02:03:47.821667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.560 [2024-11-19 02:03:47.821762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.821787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.821875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.821992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.822138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.822413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.822603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.822867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.822968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.823081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.823302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.823544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.823753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.823866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.823980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.824224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.824498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.824719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.824856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.824972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.825190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.825449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.825708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.825876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.825961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.826190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.826408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.826669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.826895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.826989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.827015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.827131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.827270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.827295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.827409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.827531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.827560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.827667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.827795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.827820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.827940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.828052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.828077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.828176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.828314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.828338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.828456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.828570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.561 [2024-11-19 02:03:47.828594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.561 qpair failed and we were unable to recover it. 00:27:59.561 [2024-11-19 02:03:47.828694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.828776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.828800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.828909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.828988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.829125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.829354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.829551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.829782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.829894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.830006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.830218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.830458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.830702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.830821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.830968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.831178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.831433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.831667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.831888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.831997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.832103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.832335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.832573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.832832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.832944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.833040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.833294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.833602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.833837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.833981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.834119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.834201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.834225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.834367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.834451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.562 [2024-11-19 02:03:47.834476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.562 qpair failed and we were unable to recover it. 00:27:59.562 [2024-11-19 02:03:47.834576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.834672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.834698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.834814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.834927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.834952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.835038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.835260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.835484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.835692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.835859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.835943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.836166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.836412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.836654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.836877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.836992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.837106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.837325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.837543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.837777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.837915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.837997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.838254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.838460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.838667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.838805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.838889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.839150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.839340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.839631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.839878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.839975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.840144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.840406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.840647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.840835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.840970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.563 qpair failed and we were unable to recover it. 00:27:59.563 [2024-11-19 02:03:47.841058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.563 [2024-11-19 02:03:47.841195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.841220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.841310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.841454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.841479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.841590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.841712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.841738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.841860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.841935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.841959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.842043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.842264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.842510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.842737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.842881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.842970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.843203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.843408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.843589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.843868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.843998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.844022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.844138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.844251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.844276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.844418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.844510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.844536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.844687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.844773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.844797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.844880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.845124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.845387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.845580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.845732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.845809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.846361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.846390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.846534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.846661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.846687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.846806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.846884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.846909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.847074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.847270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.847521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.847748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.847851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.847928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.848001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.848026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.564 [2024-11-19 02:03:47.848112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.848201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.564 [2024-11-19 02:03:47.848226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.564 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.848321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.848405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.848429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.848510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.848597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.848622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.848727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.848809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.848833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.848925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.848998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.849157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.849389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.849628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.849839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.849952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.850037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.850325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.850541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.850795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.850907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.850984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.851276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851363] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:59.565 [2024-11-19 02:03:47.851379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.851496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.851767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.851898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.851984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.852231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.852496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.852758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.852867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.852986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.853181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.853438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.853680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.853802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.853885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.854166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.854393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.565 [2024-11-19 02:03:47.854664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.565 [2024-11-19 02:03:47.854797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.565 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.854920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.855131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.855359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.855579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.855810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.855945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.856045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.856272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.856504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.856803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.856914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.857004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.857247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.857474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.857724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.857841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.857954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.858198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.858379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.858629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.858771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.859460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.859605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.859633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.859742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.860550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.860581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.860720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.860817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.860842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.860937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.861186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.861449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.861718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.861857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.861941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.862153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.862385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.862650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.566 qpair failed and we were unable to recover it. 00:27:59.566 [2024-11-19 02:03:47.862891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.566 [2024-11-19 02:03:47.862992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.863110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.863325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.863535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.863762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.863879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.863978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.864233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.864448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.864694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.864835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.864959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.865082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.865106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.865188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.865946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.865977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.866104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.866778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.866808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.866925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.867173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.867437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.867712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.867820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.867912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.868173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.868434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.868689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.868802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.868975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.869302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.869539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.869781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.869889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.869984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.870102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.870127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.567 qpair failed and we were unable to recover it. 00:27:59.567 [2024-11-19 02:03:47.870218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.567 [2024-11-19 02:03:47.870327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.870351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.870468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.870583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.870608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.870715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.870812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.870837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.871745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.871856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.871887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.872017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.872275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.872504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.872734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.872842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.872935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.873188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.873388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.873590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.873836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.873945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.874037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.874181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.874206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.874308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.874410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.874435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.875297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.875421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.875447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.875543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.875644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.875681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.875779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.875864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.875888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.875983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.876179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.876385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.876608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.876812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.876968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.877101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.877342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.877572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.877821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.877938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.878039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.878187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.878212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.878305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.878392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.568 [2024-11-19 02:03:47.878417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.568 qpair failed and we were unable to recover it. 00:27:59.568 [2024-11-19 02:03:47.878532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.878626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.878669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.878762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.878842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.878867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.878965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.879053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.879078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.879773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.879860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.879886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.880033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.880272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.880531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.880779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.880891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.880983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.881204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.881427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.881667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.881860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.881982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.882090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.882360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.882614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.882847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.882997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.883122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.883337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.883593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.883837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.883951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.884041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.884234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.884444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.884677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.884793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.884881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.885006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.885035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.885129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.885208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.885233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.885321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.885403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.885428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-19 02:03:47.885512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.569 [2024-11-19 02:03:47.885660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.885687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.885780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.885859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.885884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.885975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.886221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.886433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.886619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.886827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.886941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.887067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.887340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.887538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.887755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.887857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.887951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.888642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.888673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.888765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.888865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.888890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.888983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.889200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.889428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.889706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.889819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.889906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.890128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.890372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.890598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.890812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.890926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.891037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.891285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.891487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.891755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.891864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.891982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.892057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.892081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.892226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.892317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.892343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.892442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.892525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.570 [2024-11-19 02:03:47.892550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-19 02:03:47.892635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.892734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.892758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.892847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.892927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.892952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.893095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.893295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.893510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.893765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.893870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.893948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.894213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.894434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.894669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.894786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.894878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.895135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.895326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.895516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.895768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.895879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.895961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.896178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.896391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.896616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.896814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.896975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.897061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.897286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.897503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.897745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.897864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.897987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.898074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.898099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-19 02:03:47.898186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.898311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.571 [2024-11-19 02:03:47.898337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.898459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.898545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.898573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.898701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.898785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.898810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.898887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.898980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.899125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.899312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.899534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.899801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.899913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.900019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.900237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.900470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.900687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.900886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.900995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.901076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.901325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.901522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.901755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.901863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.902012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.902231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.902450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.902671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.902779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.902888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.903143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.903379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.903604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.903823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.903940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.904033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.904155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.904181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.904297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.904394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.904422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.572 qpair failed and we were unable to recover it. 00:27:59.572 [2024-11-19 02:03:47.904510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.904586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.572 [2024-11-19 02:03:47.904611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.904736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.904834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.904859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.904986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.905172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.905399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.905596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.905822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.905928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.906058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.906363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.906586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.906826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.906945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.907033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.907318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.907568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.907808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.907950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.908075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.908165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.908192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.908305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.908393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.908417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.908551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.908696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.908725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.908863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.908991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.909102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.909338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.909550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.909776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.909879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.910012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.910219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.910465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.910723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.910865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.910968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.911057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.911089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.573 [2024-11-19 02:03:47.911182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.911283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.573 [2024-11-19 02:03:47.911310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.573 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.911433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.911525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.911550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.911658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.911768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.911793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.911879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.911980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.912094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.912293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.912496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.912705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.912833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.913821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.913961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.913989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.914125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.914273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.914299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.914420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.914533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.914558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.914679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.914770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.914796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.914892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.915156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.915393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.915648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.915856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.915977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.916105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.916318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.916531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.916753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.916861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.916965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.917161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.917380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.917575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.917789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.917905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.918027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.918141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.918166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.918250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.918338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.918364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.918446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.918525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.918558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.574 qpair failed and we were unable to recover it. 00:27:59.574 [2024-11-19 02:03:47.918658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.574 [2024-11-19 02:03:47.918749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.918774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.918886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.918998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.919155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.919360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.919620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.919847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.919999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.920099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.920334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.920533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.920786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.920902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.921011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.921129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.921157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.921274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.922239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.922494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.922720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.922870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.922968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.923680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.923710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.923842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.923942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.923967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.924070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.924326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.924565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.924829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.924965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.925129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.925221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.925247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.925374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.925454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.925479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.925573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.925700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.925727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.926430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.926578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.926605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.926711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.926796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.926822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.926926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.927043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.927074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.927189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.927276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.927303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.575 qpair failed and we were unable to recover it. 00:27:59.575 [2024-11-19 02:03:47.927441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.927530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.575 [2024-11-19 02:03:47.927556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.927686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.927772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.927797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.927891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.927986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.928146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.928412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.928678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.928890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.928988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.929099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.929366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.929622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.929863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.929982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.930064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.930301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.930512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.930753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.930865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.930961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.931238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.931472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.931792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.931907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.932018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.932254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.932446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.932661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.932795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.932915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.933012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.933037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.933121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.933210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.933235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.576 qpair failed and we were unable to recover it. 00:27:59.576 [2024-11-19 02:03:47.933377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.933487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.576 [2024-11-19 02:03:47.933512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.933642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.933731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.933756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.933836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.933940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.933966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.934054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.934738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.934769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.934871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.935130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.935409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.935676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.935816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.935935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.936131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.936357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.936611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.936831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.936960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.937046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.937308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.937508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.937742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.937890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.938007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.938227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.938496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.938725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.938849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.938941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.939182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.939412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.939671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.939858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.939961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.940045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.940160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.940185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.940262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.940350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.940375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.940480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.940606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.577 [2024-11-19 02:03:47.940644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.577 qpair failed and we were unable to recover it. 00:27:59.577 [2024-11-19 02:03:47.940730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.940821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.940846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.940968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.941055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.941082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.941176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.941286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.941311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.942014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.942319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.942607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.942847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.942997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.943112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.943252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.943277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.943385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.943477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.943502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.943626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.943781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.943807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.943899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.944158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.944397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.944645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.944799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.944913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.945147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.945381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.945583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.945831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.945961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.946054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.946253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.946483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.946680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.946910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.946989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.947014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.947735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.947859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.947886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.948011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.948148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.948174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.948333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.948443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.948469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.948599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.948696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.948723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.578 qpair failed and we were unable to recover it. 00:27:59.578 [2024-11-19 02:03:47.948840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.578 [2024-11-19 02:03:47.948973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.948999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.949097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.949324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.949531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.949773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.949885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.950024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.950254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.950518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.950765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.950896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.951019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.951251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.951445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.951697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.951842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.951930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.952221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.952453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.952708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.952910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.952995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.953123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.953351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.953552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.953757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.953872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.953974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.954222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.954423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.954648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.954860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.954982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.955007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.955150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.955234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.955259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.579 qpair failed and we were unable to recover it. 00:27:59.579 [2024-11-19 02:03:47.955345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.955460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.579 [2024-11-19 02:03:47.955485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.955579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.955723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.955749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.955836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.955952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.955977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.956093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.956363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.956592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.956801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.956910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.957034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.957222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.957476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.957714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.957821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.957933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.958188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.958446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.958690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.958803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.958897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.959155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.959386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.959610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.959877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.959994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.960143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.960397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.960650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.960846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.960990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.961104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.961332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.961526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.961757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.961866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.580 qpair failed and we were unable to recover it. 00:27:59.580 [2024-11-19 02:03:47.961951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.962041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.580 [2024-11-19 02:03:47.962067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.962211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.962304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.962329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.962449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.962533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.962558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.962635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.962718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.962743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.962861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.962981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.963124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.963384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.963600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.963858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.963972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.964083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.964285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.964478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.964780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.964897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.964979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.965227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.965446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.965664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.965782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.965877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.966195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.966430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.966665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.966778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.966896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.967112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.967368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.967622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.967831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.581 [2024-11-19 02:03:47.967951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.581 qpair failed and we were unable to recover it. 00:27:59.581 [2024-11-19 02:03:47.968067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.968323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.968525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.968821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.968936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.969060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.969310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.969587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.969788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.969908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.970032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.970272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.970502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.970705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.970821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.970910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.971166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.971400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.971617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.971822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.971960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.972048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.972246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.972374] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:59.582 [2024-11-19 02:03:47.972429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972492] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:59.582 [2024-11-19 02:03:47.972510] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:59.582 [2024-11-19 02:03:47.972510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972523] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:59.582 [2024-11-19 02:03:47.972534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.972623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:59.582 [2024-11-19 02:03:47.972710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:59.582 [2024-11-19 02:03:47.972734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.972666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:59.582 [2024-11-19 02:03:47.972670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:59.582 [2024-11-19 02:03:47.972825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.972963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.973103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.973302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.973493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.973696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.973815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.582 qpair failed and we were unable to recover it. 00:27:59.582 [2024-11-19 02:03:47.973902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.582 [2024-11-19 02:03:47.974013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.974132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.974371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.974564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.974818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.974927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.975066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.975348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.975550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.975799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.975910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.976014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.976202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.976407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.976641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.976881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.976982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.977095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.977386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.977573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.977769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.977904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.978019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.978277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.978495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.978706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.978845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.978935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.979203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.979393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.979614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.979843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.979957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.980073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.980153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.980177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.583 qpair failed and we were unable to recover it. 00:27:59.583 [2024-11-19 02:03:47.980255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.980339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.583 [2024-11-19 02:03:47.980365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.980446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.980530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.980555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.980669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.980787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.980811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.980895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.981167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.981372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.981589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.981819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.981959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.982076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.982290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.982520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.982746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.982863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.982960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.983201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.983401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.983593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.983821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.983925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.984055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.984283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.984483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.984726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.984830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.984940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.985195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.985431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.985703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.985901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.985982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.986006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.986087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.986171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.986197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.986282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.986356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.986380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.584 [2024-11-19 02:03:47.986463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.986575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.584 [2024-11-19 02:03:47.986600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.584 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.986704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.986803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.986827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.986923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.987194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.987416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.987613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.987873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.987994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.988089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.988306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.988518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.988734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.988850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.988973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.989160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.989377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.989579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.989813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.989920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.990018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.990264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.990491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.990712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.990818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.990926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.991133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.991322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.991608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.991814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.991963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.585 [2024-11-19 02:03:47.992079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.992164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.585 [2024-11-19 02:03:47.992190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.585 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.992312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.992456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.992483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.992602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.992718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.992743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.992854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.992944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.992970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.993056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.993291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.993520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.993751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.993882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.993971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.994190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.994415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.994609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.994861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.994966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.995044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.995232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.995447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.995649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.995879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.995986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.996073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.996270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.996493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.996719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.996830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.996946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.997138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.997331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.997529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.997778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.997883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.997982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.998068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.998093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.998210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.998292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.586 [2024-11-19 02:03:47.998317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.586 qpair failed and we were unable to recover it. 00:27:59.586 [2024-11-19 02:03:47.998428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.998506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.998532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:47.998620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.998712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.998737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:47.998847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.998945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.998971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:47.999092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:47.999306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:47.999519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:47.999772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:47.999880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.000000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.000231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.000429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.000657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.000847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.000986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.001092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.001285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.001529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.001726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.001849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.001952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.002167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.002438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.002706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.002819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.002919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.003228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.003418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.003611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.003852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.003978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.004113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.004362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.004568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.587 qpair failed and we were unable to recover it. 00:27:59.587 [2024-11-19 02:03:48.004796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.587 [2024-11-19 02:03:48.004909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.004935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.005053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.005237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.005467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.005692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.005838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.005944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.006176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.006399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.006599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.006810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.006914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.007043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.007260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.007512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.007791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.007903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.007997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.008223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.008449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.008681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.008821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.008906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.009121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.009306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.009493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.009700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.009807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.009893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.010120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.010319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.010544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.010773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.010881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.588 qpair failed and we were unable to recover it. 00:27:59.588 [2024-11-19 02:03:48.010968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.011054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.588 [2024-11-19 02:03:48.011082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.011201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.011388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.011619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.011821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.011928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.012008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.012232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.012460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.012655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.012840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.012948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.013036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.013245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.013436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.013662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.013851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.013984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.014069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.014290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.014525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.014727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.014836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.014962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.015165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.015414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.015606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.015830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.015937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.016035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.016222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.016476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.016669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.589 [2024-11-19 02:03:48.016892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.589 [2024-11-19 02:03:48.016999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.589 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.017143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.017364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.017553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.017740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.017845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.017937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.018135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.018350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.018576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.018817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.018926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.019007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.019251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.019466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.019671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.019842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.019931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.020151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.020367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.020552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.020780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.020919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.021023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.021234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.021484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.021665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.021873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.021987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.022092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.022280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.022553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.590 qpair failed and we were unable to recover it. 00:27:59.590 [2024-11-19 02:03:48.022756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.590 [2024-11-19 02:03:48.022841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.022865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.022957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.023208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.023420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.023655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.023852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.023952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.024066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.024283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.024476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.024660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.024876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.024989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.025074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.025271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.025480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.025728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.025866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.025950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.026145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.026361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.026577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.026807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.026908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.027021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.027216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.027463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.027672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.027816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.027926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.028146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.028374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.028598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.028842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.028955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.029047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.029136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.029162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.591 qpair failed and we were unable to recover it. 00:27:59.591 [2024-11-19 02:03:48.029244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.029350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.591 [2024-11-19 02:03:48.029374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.029459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.029546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.029570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.029651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.029734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.029758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.029878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.029992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.030099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.030345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.030570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.030793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.030930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.031020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.031211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.031434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.031628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.031905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.031993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.032109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.032331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.032514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.032712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.032818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.032915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.033164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.033376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.033611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.033814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.033917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.034005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.034200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.034419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.034652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.034861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.034981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.035099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.035292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.035484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.035711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.035816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.592 qpair failed and we were unable to recover it. 00:27:59.592 [2024-11-19 02:03:48.035929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.592 [2024-11-19 02:03:48.036066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.036188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.036377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.036597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.036797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.036903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.036983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.037265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.037454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.037664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.037801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.037912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.038119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.038369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.038612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.038809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.038922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.039014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.039295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.039516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.039786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.039893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.039974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.040169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.040363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.040606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.040830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.040971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.041053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.041248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.041499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.041727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.041831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.041945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.042224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.042423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.042658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.593 [2024-11-19 02:03:48.042769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.593 qpair failed and we were unable to recover it. 00:27:59.593 [2024-11-19 02:03:48.042853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.042966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.042996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.043105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.043344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.043563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.043778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.043879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.043987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.044189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.044436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.044634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.044853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.044960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.045043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.045270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.045488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.045711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.045852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.045954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.046177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.046394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.046586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.046823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.046957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.047069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.047290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.047489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.047776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.047888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.047972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.048217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.048401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.048651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.594 qpair failed and we were unable to recover it. 00:27:59.594 [2024-11-19 02:03:48.048842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.594 [2024-11-19 02:03:48.048918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.048943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.049025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.049216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.049430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.049727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.049838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.049937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.050162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.050382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.050598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.050828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.050967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.051047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.051248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.051467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.051654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.051895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.051999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.052092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.052284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.052518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.052736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.052848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.052958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.053042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.053068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.595 qpair failed and we were unable to recover it. 00:27:59.595 [2024-11-19 02:03:48.053189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.595 [2024-11-19 02:03:48.053282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.053309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.053391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.053498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.053522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.053608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.053700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.053725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.053838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.053917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.053941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.054025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.054245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.054494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.054749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.054915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.055030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.055216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.055427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.055669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.055882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.055983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.056103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.056329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.056563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.056787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.056924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.057035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.057244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.057441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.057666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.057833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.057920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.058110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.058324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.058544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.058766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.058900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.058994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.059067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.059092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.059178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.059264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.059290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.596 [2024-11-19 02:03:48.059368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.059482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.596 [2024-11-19 02:03:48.059507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.596 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.059628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.060282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.060332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.060512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.060647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.060677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.060805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.060895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.060920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.061006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.061203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.061424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.061677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.061812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.061896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.062113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.062295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.062510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.062725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.062863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.062956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.063192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.063416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.063652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.063816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.063924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.064176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.064380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.064604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.064809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.064929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.065027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.065308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.065572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.065777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.065918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.066037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.066135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.066159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.066243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.066355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.066380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.597 qpair failed and we were unable to recover it. 00:27:59.597 [2024-11-19 02:03:48.066531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.597 [2024-11-19 02:03:48.066654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.066679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.066794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.066885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.066909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.067040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.067285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.067523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.067785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.067899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.067991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.068246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.068462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.068719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.068848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.068940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.069028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.069054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.069143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.069258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.069283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.069399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.069508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.598 [2024-11-19 02:03:48.069533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.598 qpair failed and we were unable to recover it. 00:27:59.598 [2024-11-19 02:03:48.069617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.881 [2024-11-19 02:03:48.069714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.881 [2024-11-19 02:03:48.069740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.881 qpair failed and we were unable to recover it. 00:27:59.881 [2024-11-19 02:03:48.069850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.881 [2024-11-19 02:03:48.069945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.069973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.070069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.070256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.070451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.070646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.070857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.070958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.071080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.071280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.071502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.071742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.071855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.071941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.072145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.072371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.072588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.072791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.072900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.073021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.073259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.073445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.073672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.073782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.882 qpair failed and we were unable to recover it. 00:27:59.882 [2024-11-19 02:03:48.073896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.074006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.882 [2024-11-19 02:03:48.074031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.074143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.074398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.074588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.074820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.074926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.075038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.075234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.075459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.075701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.075838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.075929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.076178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.076396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.076619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.076852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.076959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.077039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.077232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.077448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.077645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.077878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.077973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.078000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.078118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.078229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.078256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.883 [2024-11-19 02:03:48.078336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.078447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.883 [2024-11-19 02:03:48.078472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.883 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.078585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.078666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.078692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.078804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.078888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.078913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.079004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.079257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.079471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.079740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.079876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.079962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.080187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.080374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.080591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.080784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.080949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.081033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.081212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.081437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.081628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.081864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.081999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.082086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.082330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.082527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.082773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.082943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.083033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.083496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.083758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.083863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.083959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.084048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.084074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.084186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.084264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.084289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.084369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.084478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.084502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.884 qpair failed and we were unable to recover it. 00:27:59.884 [2024-11-19 02:03:48.084590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.884 [2024-11-19 02:03:48.084701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.084727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.084815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.084931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.084956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.085043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.085233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.085434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.085672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.085786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.085930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.086120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.086309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.086537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.086749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.086885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.087003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.087216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.087446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.087632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.087844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.087959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.088051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.088252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.088457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.088673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.088810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.088895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.089116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.089337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.089562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.089777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.089882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.090003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.090114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.090138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.090218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.090299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.090323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.090407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.090495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.090520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.885 qpair failed and we were unable to recover it. 00:27:59.885 [2024-11-19 02:03:48.090606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.885 [2024-11-19 02:03:48.090737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.090763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.090907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.091165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.091422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.091680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.091819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.091905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.092126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.092321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.092603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.092843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.092988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.093102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.093310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.093490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.093704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.093814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.093928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.094122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.094372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.094591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.094856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.094979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.095082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.095307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.095528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.095750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.095852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.095966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.096159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.096406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.096639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.096861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.096983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.097009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.886 qpair failed and we were unable to recover it. 00:27:59.886 [2024-11-19 02:03:48.097106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.886 [2024-11-19 02:03:48.097222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.097247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.097332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.097448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.097473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.097596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.097738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.097767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.097855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.097946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.097972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.098056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.098294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.098487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.098719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.098914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.098993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.099130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.099321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.099533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.099789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.099901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.099989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.100177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.100359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.100540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.100788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.100890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.100976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.101170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.101403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.101583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.101799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.101910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.102029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.102136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.102161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.887 qpair failed and we were unable to recover it. 00:27:59.887 [2024-11-19 02:03:48.102242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.887 [2024-11-19 02:03:48.102327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.102352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.102433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.102515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.102540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.102648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.102786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.102815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.102903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.102986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.103129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.103346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.103595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.103832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.103943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.104023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.104276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.104471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.104703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.104816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.104936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.105133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.105328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.105534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.105768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.105875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.105969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.106185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.106416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.106641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.106874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.106995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.107099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.107294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.107473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.107693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.107878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.107987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.108012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.108098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.108203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.108228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.108309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.108414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.888 [2024-11-19 02:03:48.108438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.888 qpair failed and we were unable to recover it. 00:27:59.888 [2024-11-19 02:03:48.108527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.108607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.108632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.108752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.108842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.108867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.108984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.109231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.109440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.109671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.109862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.109997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.110077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.110271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.110446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.110665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.110913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.110990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.111095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.111293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.111484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.111700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.111888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.111991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.112077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.112259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.112443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.112655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.112849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.112958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.113039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.113256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.113476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.113736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.113844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.113965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.114045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.114069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.114161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.114246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.114271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.889 [2024-11-19 02:03:48.114355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.114453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.889 [2024-11-19 02:03:48.114477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.889 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.114562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.114641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.114666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.114753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.114833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.114862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.114955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.115172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.115379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.115623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.115845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.115948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.116033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.116237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.116432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.116620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.116770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.116922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.117112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.117374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.117560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.117750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.117855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.117976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.118184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.118385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.118625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.118854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.118951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.119070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.119254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.119461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.119702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.119847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.119930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.120011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.120035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.120146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.120243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.120268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.120347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.120422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.120446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.890 qpair failed and we were unable to recover it. 00:27:59.890 [2024-11-19 02:03:48.120569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.890 [2024-11-19 02:03:48.120670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.120701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.120792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.120913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.120939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.121031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.121257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.121493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.121695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.121807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.121921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.122192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.122412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.122617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.122863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.122973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.123058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.123318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.123517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.123750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.123890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.123992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.124269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.124498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.124708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.124903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.124998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.125023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.125147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.125262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.125294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.125402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.125489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.125515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.891 qpair failed and we were unable to recover it. 00:27:59.891 [2024-11-19 02:03:48.125594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.891 [2024-11-19 02:03:48.125690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.125716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.125830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.125960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.125985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.126065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.126258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.126443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.126707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.126823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.126938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.127139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.127369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.127560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.127782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.127893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.128050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.128292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.128481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.128660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.128889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.128994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.129068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.129250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.129455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.129650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.129864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.129970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.130086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.130342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.130547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.130773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.130911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.130992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.131234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.131415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.892 [2024-11-19 02:03:48.131601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.892 [2024-11-19 02:03:48.131722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.892 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.131830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.131907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.131931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.132009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.132194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.132445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.132703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.132890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.132999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.133082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.133294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.133488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.133715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.133904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.133982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.134121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.134318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.134536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.134738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.134842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.134961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.135190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.135381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.135593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.135839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.135939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.136023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.136200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.136409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.136602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.136810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.136945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.137024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.137288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.137472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.893 qpair failed and we were unable to recover it. 00:27:59.893 [2024-11-19 02:03:48.137653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.893 [2024-11-19 02:03:48.137762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.137852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.137933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.137958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.138079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.138293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.138515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.138742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.138843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.138920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.139161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.139373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.139559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.139767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.139871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.139988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.140170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.140389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.140600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.140827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.140927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.141069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.141321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.141502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.141729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.141834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.141919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.142134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.142389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.142624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.142830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.142940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.143053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.143301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.143503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.143751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.894 [2024-11-19 02:03:48.143891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.894 qpair failed and we were unable to recover it. 00:27:59.894 [2024-11-19 02:03:48.143980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.144187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.144399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.144608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.144846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.144984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.145066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.145253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.145435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.145657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.145856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.145990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.146075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.146271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.146499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.146744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.146850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.146974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.147175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.147370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.147578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.147811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.147925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.148037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.148280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.148497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.148694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.148886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.148994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.149098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.149290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.149531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.149737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.149850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.895 [2024-11-19 02:03:48.149973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.150071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.895 [2024-11-19 02:03:48.150100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.895 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.150222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.150350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.150378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.150468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.150552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.150577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.150688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.150771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.150796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.150885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.150993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.151100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.151322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.151519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.151744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.151905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.152032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.152228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.152462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.152694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.152833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.152921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.153143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.153370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.153558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.153777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.153889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.154036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.154238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.154455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.154689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.154910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.154997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.155022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.155107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.155215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.155240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.155322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.155432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.155458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.155583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.155706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.896 [2024-11-19 02:03:48.155735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.896 qpair failed and we were unable to recover it. 00:27:59.896 [2024-11-19 02:03:48.155860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.155948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.155973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.156059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.156302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.156515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.156724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.156838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.156958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.157175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.157422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.157616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.157829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.157962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.158046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.158270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.158486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.158733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.158872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.158956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.159173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.159364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.159598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.159833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.159939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.160052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.160273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.160489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.160689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.160883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.160996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.161109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.161302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.161555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.161777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.161886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.897 qpair failed and we were unable to recover it. 00:27:59.897 [2024-11-19 02:03:48.161979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.897 [2024-11-19 02:03:48.162062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.162173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.162396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.162588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.162772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.162876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.162956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.163145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.163370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.163592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.163793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.163897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.163981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.164231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.164420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.164693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.164887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.164991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.165077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.165274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.165528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.165726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.165836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.165915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.166124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.166344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.166557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.166782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.166893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.166983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.167205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.167430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.167666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.898 [2024-11-19 02:03:48.167894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.167981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.898 [2024-11-19 02:03:48.168007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.898 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.168096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.168277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.168489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.168677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.168782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.168921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.169141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.169326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.169537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.169762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.169895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.170010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.170205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.170445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.170700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.170805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.170950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.171128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.171381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.171607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.171886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.171995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.172118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.172369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.172552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.172776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.172908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.173004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.173202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.173423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.173645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.173853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.173994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.174074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.174188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.174213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.899 qpair failed and we were unable to recover it. 00:27:59.899 [2024-11-19 02:03:48.174305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.899 [2024-11-19 02:03:48.174390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.174415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.174524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.174599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.174624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.174720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.174804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.174830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.174949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.175141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.175351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.175565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.175782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.175921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.176038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.176237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.176461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.176666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.176803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.176915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.177119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.177341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.177594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.177798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.177903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.178018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.178241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.178432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.178641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.178864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.178980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.179087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.179312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.179532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.179782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.179889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.180008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.180084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.180108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.180189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.180270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.180296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.900 qpair failed and we were unable to recover it. 00:27:59.900 [2024-11-19 02:03:48.180409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.180519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.900 [2024-11-19 02:03:48.180545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.180630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.180730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.180756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.180846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.180919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.180944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.181026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.181262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.181545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.181736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.181870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.181958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.182180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.182403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.182598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.182864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.182966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.183084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.183272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.183462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.183699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.183809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.183959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.184141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.184323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.184539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.184740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.184844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.184959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.185145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.185377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.185572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.901 qpair failed and we were unable to recover it. 00:27:59.901 [2024-11-19 02:03:48.185784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.901 [2024-11-19 02:03:48.185872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.185897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.185984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.186197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.186422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.186603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.186823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.186929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.187073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.187254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.187513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5990000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.187765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.187903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.188001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.188192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.188435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.188675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.188862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.188990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.189079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.189304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.189496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.189741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.189848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.189940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.190178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.190382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.190570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.190761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.190877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.190967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.191182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.191420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.191644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.902 qpair failed and we were unable to recover it. 00:27:59.902 [2024-11-19 02:03:48.191876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.902 [2024-11-19 02:03:48.191985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.192073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.192268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.192458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.192665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.192811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.192901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.193121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.193327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.193548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.193775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.193921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.194010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.194228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.194420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.194621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.194819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.194960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.195074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.195299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.195537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.195769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.195886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.195974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.196194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.196416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.196632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.196840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.196972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.197051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.197268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.197494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.197711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.197835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.197963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.198070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.903 [2024-11-19 02:03:48.198095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.903 qpair failed and we were unable to recover it. 00:27:59.903 [2024-11-19 02:03:48.198169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.198398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.198581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.198768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.198867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.198985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.199164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.199360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.199580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.199799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.199906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.199995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.200225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.200445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.200631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.200865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.200978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.201086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.201272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.201461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.201686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.201905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.201990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.202108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.202323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.202517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.202718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.202851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.203007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.203227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.203435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.203623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.203915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.203998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.204023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.904 qpair failed and we were unable to recover it. 00:27:59.904 [2024-11-19 02:03:48.204107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.204225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.904 [2024-11-19 02:03:48.204250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.204336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.204415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.204440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.204518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.204598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.204622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.204726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.204817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.204842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.204963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.205175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.205370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.205595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.205793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.205907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.206001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.206200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.206420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5994000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.206652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502cb0 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.206863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.206987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.207075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.207323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.207512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.207710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.207814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.207905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.208127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.208315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.208493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.208729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.208832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.208913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.209028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.209054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.209171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.209283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.209307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.905 [2024-11-19 02:03:48.209387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.209465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.905 [2024-11-19 02:03:48.209489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.905 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.209573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.209658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.209684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.209800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.209911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.209936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.210024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.210216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.210494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.210695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.210877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.210982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.211061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.211262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.211446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.211678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.211789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.211903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.212127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.212319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.212518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.212773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.212876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.212966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.213153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.213339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.213553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.213755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.213857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.213940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.214131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.214374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.214569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.214765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.214901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.214983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.215062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.215086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.215194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.215307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.215332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.906 qpair failed and we were unable to recover it. 00:27:59.906 [2024-11-19 02:03:48.215430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.906 [2024-11-19 02:03:48.215504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.215529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.215611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.215701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.215727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.215810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.215884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.215909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.216031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.216253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.216441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.216708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.216889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.216982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.217120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.217305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.217538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.217764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.217900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.217989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.218175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.218428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.218612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.218820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.218929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.219016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.219189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.219433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.219623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.219836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.219938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.220024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.220246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.220459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.220648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.220875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.220982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.221065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.221141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.221166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.907 qpair failed and we were unable to recover it. 00:27:59.907 [2024-11-19 02:03:48.221243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.907 [2024-11-19 02:03:48.221318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.221342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.221434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.221543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.221573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.221656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.221738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.221762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.221873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.221959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.221985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.222076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.222302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.222488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.222726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.222859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.222940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.223126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.223346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.223555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.223772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.223878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.223966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.224152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.224370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.224544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.224777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.224892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.224979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.225160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.225393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.225606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.225877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.225981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.226062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.226306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.226506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.226746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.226847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.226956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.227042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.227066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.908 qpair failed and we were unable to recover it. 00:27:59.908 [2024-11-19 02:03:48.227181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.908 [2024-11-19 02:03:48.227254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.227279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.227358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.227473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.227497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.227606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.227699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.227723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.227801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.227914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.227939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.228018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.228245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.228465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.228696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.228885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.228995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.229081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.229279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.229466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.229723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.229858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.229979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.230170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.230389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.230582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.230786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.230891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.230988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.231203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.231418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.231595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.231786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.231923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.232039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.232270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.232461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.232654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.232894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.232985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.233010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.909 qpair failed and we were unable to recover it. 00:27:59.909 [2024-11-19 02:03:48.233087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.233198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.909 [2024-11-19 02:03:48.233223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.233302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.233375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.233399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.233486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.233569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.233595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.233689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.233836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.233860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.233971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.234159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.234351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.234566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.234800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.234935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.235018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.235205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.235415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.235601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.235804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.235915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.235997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.236239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.236493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.236683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.236816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.236894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.237132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.237346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.237563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.237841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.237955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.238065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.238141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.238165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.238255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.238361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.238385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.910 qpair failed and we were unable to recover it. 00:27:59.910 [2024-11-19 02:03:48.238466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.910 [2024-11-19 02:03:48.238543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.238567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.238675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.238818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.238842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.238925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.239146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.239359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.239580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.239791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.239928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.240009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.240213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.240489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.240718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.240854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.240935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.241122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.241307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.241492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.241721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.241834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.241947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.242140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.242331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.242513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.242733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.242839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.242930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.243150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.243343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.243559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.243800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.243907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.243986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.244105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.244128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.244236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.244312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.244337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.911 qpair failed and we were unable to recover it. 00:27:59.911 [2024-11-19 02:03:48.244420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.244494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.911 [2024-11-19 02:03:48.244517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.244641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.244723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.244747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.244828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.244938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.244962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.245050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.245230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.245418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.245602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.245809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.245906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.245987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.246173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.246360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.246566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.246792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.246903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.246983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.247247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.247438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.247617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.247826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.247967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.248049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.248293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.248481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.248701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.248840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.248951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.249133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.249327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.249534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.249745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.249853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.249932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.250041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.250066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.250179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.250267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.912 [2024-11-19 02:03:48.250291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.912 qpair failed and we were unable to recover it. 00:27:59.912 [2024-11-19 02:03:48.250368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.250440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.250465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.250574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.250652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.250676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.250784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.250866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.250890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.250979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.251182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.251432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.251656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.251841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.251979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.252080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.252257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.252445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.252642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.252843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.252958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.253040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.253233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.253479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.253758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.253857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.253941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.254154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.254338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.254571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.254757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.254858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.254939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.255137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.255358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.255543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.255731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.255860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.255944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.256062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.256086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.913 qpair failed and we were unable to recover it. 00:27:59.913 [2024-11-19 02:03:48.256168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.913 [2024-11-19 02:03:48.256275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.256299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.256381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.256490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.256515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.256595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.256676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.256701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.256787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.256862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.256886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.256969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.257153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.257364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.257584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.257772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.257923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.258009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.258267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.258486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.258689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.258907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.258989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.259123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.259302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.259530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.259728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.259828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.259916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.260120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.260307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.260535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.260751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.260882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.261023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.261104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.261128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.261209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.261317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.261343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.914 qpair failed and we were unable to recover it. 00:27:59.914 [2024-11-19 02:03:48.261418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.261524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.914 [2024-11-19 02:03:48.261549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.261631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.261759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.261783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.261880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.261960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.261984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.262065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.262246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.262466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.262714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.262908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.262987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.263124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.263372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.263557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.263743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.263882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.263969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.264161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.264366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.264550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.264775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.264872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.264989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.265182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.265372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.265579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.265806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.265944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.266061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.266256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.266477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.266666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.266878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.266994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.267020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.267135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.267219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.267243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.267360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.267465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.915 [2024-11-19 02:03:48.267490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.915 qpair failed and we were unable to recover it. 00:27:59.915 [2024-11-19 02:03:48.267602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.267692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.267716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.267797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.267884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.267911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.268020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.268246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.268459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.268667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.268849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.268952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.269042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.269258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.269467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.269685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.269867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.269969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.270051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.270241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.270462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.270660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.270890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.270976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.271083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.271277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.271487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.271717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.271904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.271982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.272086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.272314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.272499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.272695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.272829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.272976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.273093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.273117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.273200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.273273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.916 [2024-11-19 02:03:48.273296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.916 qpair failed and we were unable to recover it. 00:27:59.916 [2024-11-19 02:03:48.273408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.273486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.273510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.273619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.273720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.273745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.273825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.273915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.273939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.274016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.274228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.274475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.274699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.274831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.274918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.275142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.275320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.275543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.275738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.275886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.276001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.276195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.276423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.276608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.276806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.276909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.277017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.277208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.277417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.277634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.277817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.277918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.278000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.278179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.278398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.278612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.278813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.278923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.279002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.279116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.279140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.917 qpair failed and we were unable to recover it. 00:27:59.917 [2024-11-19 02:03:48.279253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.917 [2024-11-19 02:03:48.279329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.279352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.279463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.279544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.279568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.279655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.279731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.279755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.279831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.279912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.279936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.280042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.280229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.280402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.280614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.280841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.280949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.281026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.281224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.281469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.281722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.281863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.281945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.282132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.282421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.282641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.282856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.282965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.283081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.283265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.283481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.283712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.283815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.283924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.284165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.284349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.284536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.284747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.284852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.284933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.285043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.285072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.918 [2024-11-19 02:03:48.285157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.285265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.918 [2024-11-19 02:03:48.285290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.918 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.285376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.285453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.285476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.285572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.285680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.285705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.285783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.285869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.285893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.285972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.286212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.286386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.286613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.286820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.286954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.287063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.287257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.287539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.287736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.287839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.287920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.288133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.288314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.288512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.288699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.288912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.288998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.289131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.289352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.289572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.289764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.289871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.289946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.290027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.290051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.290166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.290250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.290274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.919 qpair failed and we were unable to recover it. 00:27:59.919 [2024-11-19 02:03:48.290356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.290434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.919 [2024-11-19 02:03:48.290459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.290568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.290673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.290699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.290774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.290856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.290880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.290959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.291135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.291360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.291542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.291740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.291875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.291952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.292170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.292385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.292575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.292775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.292911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.292997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.293220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.293407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.293599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.293889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.293997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.294081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.294300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.294487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.294691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.294883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.294992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.295100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.295273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.295458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.295667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.295885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.295999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.296023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.296108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.296191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.920 [2024-11-19 02:03:48.296215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.920 qpair failed and we were unable to recover it. 00:27:59.920 [2024-11-19 02:03:48.296331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.296440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.296465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.296581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.296698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.296724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.296805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.296891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.296915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.296997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.297203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.297430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.297640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.297854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.297953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.298066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.298255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.298477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.298698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.298886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.298989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.299068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.299264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.299451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.299675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.299868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.299966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.300077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.300260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.300460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.300718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.300853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.300935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.301120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.301307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.301569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.301788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.301885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.301968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.302050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.302075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.921 qpair failed and we were unable to recover it. 00:27:59.921 [2024-11-19 02:03:48.302172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.921 [2024-11-19 02:03:48.302275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.302300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.302380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.302488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.302513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.302624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.302710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.302734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.302811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.302890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.302914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.302994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.303184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.303425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.303647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.303836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.303948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.304029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.304243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.304430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.304624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.304817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.304928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.305020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.305233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.305438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.305655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.305885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.305989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.306077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.306286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.306493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.306713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.306825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.306934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.307116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.307334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.307557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.307777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.307908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.922 [2024-11-19 02:03:48.307990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.308078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.922 [2024-11-19 02:03:48.308102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.922 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.308183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.308412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.308596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.308803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.308907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.308987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.309185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.309408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.309667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.309857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.309992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.310071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.310328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.310555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.310755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.310859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.311003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.311202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.311424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.311661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.311874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.311970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.312082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.312300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.312553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.312753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.312852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.312930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.313117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.313340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.313525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.313755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.313890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.313999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.314077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.923 [2024-11-19 02:03:48.314100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.923 qpair failed and we were unable to recover it. 00:27:59.923 [2024-11-19 02:03:48.314214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.314406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.314590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.314810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.314913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.314995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.315172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.315357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.315589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.315811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.315909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.315992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.316239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.316462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.316690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.316910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.316993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.317100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.317338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.317527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.317776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.317883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.318000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.318193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.318408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.318642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.318829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.318935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.319013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.319149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.319173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.319253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.319340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.924 [2024-11-19 02:03:48.319364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.924 qpair failed and we were unable to recover it. 00:27:59.924 [2024-11-19 02:03:48.319473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.319547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.319572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.319653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.319765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.319790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.319898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.320118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.320305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.320555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.320772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.320910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.320998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.321186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.321391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.321608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.321843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.321945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.322031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.322208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.322394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.322577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.322773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.322904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.322988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.323171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.323351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.323576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.323765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.323864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.323977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.324168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.324391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.324579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.324802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.324914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.325003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.325125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.325148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.325232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.325310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.325334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.325416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.325522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.925 [2024-11-19 02:03:48.325546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.925 qpair failed and we were unable to recover it. 00:27:59.925 [2024-11-19 02:03:48.325630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.325739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.325764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.325873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.325947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.325971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.326048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.326270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.326479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.326745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.326844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.326939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.327129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.327324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.327518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.327730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.327917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.327998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.328111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.328355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.328603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.328806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.328923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.329010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.329204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.329394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.329632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.329836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.329948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.330037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.330236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.330475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.330666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.330889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.330991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.331076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.331325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.331521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.331755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.331855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.926 [2024-11-19 02:03:48.331935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.332013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.926 [2024-11-19 02:03:48.332037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.926 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.332119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.332303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.332549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.332767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.332861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.332971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.333187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.333406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.333598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.333837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.333948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.334028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.334279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.334461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.334663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.334888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.334993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.335071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.335293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.335519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.335719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.335915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.335992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.336132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.336321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.336537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.336753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.336888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.336976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.337193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.337414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.337605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.337801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.337938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.338053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.338163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.338189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.338267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.338355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.338379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.927 qpair failed and we were unable to recover it. 00:27:59.927 [2024-11-19 02:03:48.338468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.927 [2024-11-19 02:03:48.338541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.338566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.338662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.338744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.338769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.338855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.338937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.338962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.339041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.339230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.339443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.339693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.339901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.339979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.340080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.340400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.340594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.340809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.340918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.340996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.341173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.341346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.341536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.341767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.341874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.341954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.342180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.342358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.342560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.342750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.342848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.342938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.343132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.343337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.343527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.343742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.343859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.343972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.344098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.344123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.928 [2024-11-19 02:03:48.344242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.344350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.928 [2024-11-19 02:03:48.344375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.928 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.344463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.344540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.344564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.344649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.344757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.344781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.344861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.344943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.344966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.345049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.345290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.345507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.345737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.345848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.345933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.346126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.346381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.346601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.346825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.346941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.347051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.347236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.347416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.347648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.347851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.347984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.348074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.348182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.348210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.348301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.348373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.348396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.348510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.348591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.929 [2024-11-19 02:03:48.348615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.929 qpair failed and we were unable to recover it. 00:27:59.929 [2024-11-19 02:03:48.348707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.348791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.348814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.348892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.349128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.349343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.349523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.349758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.349895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.349983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.350220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.350466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.350735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.350840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.350922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.351145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.351355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.351559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.351749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.351886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.351962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.352236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.352430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.352651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.352840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.352990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.353073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.353302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.353523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.353730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.353832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.353939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.354143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.354385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.354619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.930 [2024-11-19 02:03:48.354760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.930 qpair failed and we were unable to recover it. 00:27:59.930 [2024-11-19 02:03:48.354842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.354965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.354989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.355082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.355292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.355514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.355808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.355917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.356023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.356214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.356412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.356624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.356819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.356956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.357049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.357277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.357510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.357707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.357827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.357916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.358106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.358320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.358546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.358751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.358923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.358998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.359228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.359437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.359629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.359818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.359952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.360034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.360251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.360474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.360707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.360847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.931 qpair failed and we were unable to recover it. 00:27:59.931 [2024-11-19 02:03:48.360928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.931 [2024-11-19 02:03:48.361004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.361122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.361342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.361583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.361833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.361947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.362033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.362218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.362431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.362615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.362806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.362934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.363016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.363200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.363386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.363603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.363803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.363910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.364000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.364247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.364446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.364632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.364856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.364986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.365066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.365266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.365483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.365666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.365901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.365983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.366091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.366286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.366495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.932 [2024-11-19 02:03:48.366735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.932 [2024-11-19 02:03:48.366850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.932 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.366963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.367142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.367361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.367618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.367818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.367958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.368042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.368294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.368513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.368730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.368830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.368914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.369141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.369324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.369548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.369755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.369866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.369945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.370137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.370360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.370581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.370814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.370946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.371045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.371260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.371456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.371675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.933 [2024-11-19 02:03:48.371902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.371985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.933 [2024-11-19 02:03:48.372009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.933 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-19 02:03:48.372121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-19 02:03:48.372310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 [2024-11-19 02:03:48.372520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f599c000b90 with addr=10.0.0.2, port=4420 00:27:59.934 qpair failed and we were unable to recover it. 00:27:59.934 A controller has encountered a failure and is being reset. 00:27:59.934 [2024-11-19 02:03:48.372811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.934 [2024-11-19 02:03:48.372942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1510600 with addr=10.0.0.2, port=4420 00:27:59.934 [2024-11-19 02:03:48.372960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1510600 is same with the state(5) to be set 00:27:59.934 [2024-11-19 02:03:48.372990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1510600 (9): Bad file descriptor 00:27:59.934 [2024-11-19 02:03:48.373013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:59.934 [2024-11-19 02:03:48.373028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:59.934 [2024-11-19 02:03:48.373047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:59.934 Unable to reset the controller. 00:28:00.500 02:03:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:00.500 02:03:48 -- common/autotest_common.sh@862 -- # return 0 00:28:00.500 02:03:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:00.500 02:03:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:00.500 02:03:48 -- common/autotest_common.sh@10 -- # set +x 00:28:00.500 02:03:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:00.500 02:03:48 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:00.500 02:03:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.500 02:03:48 -- common/autotest_common.sh@10 -- # set +x 00:28:00.500 Malloc0 00:28:00.500 02:03:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.500 02:03:48 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:28:00.500 02:03:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.500 02:03:48 -- common/autotest_common.sh@10 -- # set +x 00:28:00.500 [2024-11-19 02:03:48.855408] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:00.500 02:03:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.500 02:03:48 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:00.500 02:03:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.500 02:03:48 -- common/autotest_common.sh@10 -- # set +x 00:28:00.500 02:03:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.500 02:03:48 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:00.500 02:03:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.500 02:03:48 -- common/autotest_common.sh@10 -- # set +x 00:28:00.500 02:03:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.500 02:03:48 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:00.500 02:03:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.500 02:03:48 -- common/autotest_common.sh@10 -- # set +x 00:28:00.500 [2024-11-19 02:03:48.883663] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:00.500 02:03:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.500 02:03:48 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:00.500 02:03:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.500 02:03:48 -- common/autotest_common.sh@10 -- # set +x 00:28:00.500 02:03:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.500 02:03:48 -- host/target_disconnect.sh@58 -- # wait 3566463 00:28:01.065 Controller properly reset. 00:28:06.323 Initializing NVMe Controllers 00:28:06.323 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:06.323 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:06.323 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:06.323 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:06.323 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:06.323 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:06.323 Initialization complete. Launching workers. 00:28:06.323 Starting thread on core 1 00:28:06.323 Starting thread on core 2 00:28:06.323 Starting thread on core 3 00:28:06.323 Starting thread on core 0 00:28:06.323 02:03:53 -- host/target_disconnect.sh@59 -- # sync 00:28:06.323 00:28:06.323 real 0m11.363s 00:28:06.323 user 0m35.643s 00:28:06.323 sys 0m7.064s 00:28:06.323 02:03:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:06.323 02:03:53 -- common/autotest_common.sh@10 -- # set +x 00:28:06.323 ************************************ 00:28:06.323 END TEST nvmf_target_disconnect_tc2 00:28:06.323 ************************************ 00:28:06.323 02:03:54 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:06.323 02:03:54 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:06.323 02:03:54 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:06.323 02:03:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:06.323 02:03:54 -- nvmf/common.sh@116 -- # sync 00:28:06.323 02:03:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:06.323 02:03:54 -- nvmf/common.sh@119 -- # set +e 00:28:06.323 02:03:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:06.323 02:03:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:06.323 rmmod nvme_tcp 00:28:06.323 rmmod nvme_fabrics 00:28:06.323 rmmod nvme_keyring 00:28:06.323 02:03:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:06.323 02:03:54 -- nvmf/common.sh@123 -- # set -e 00:28:06.323 02:03:54 -- nvmf/common.sh@124 -- # return 0 00:28:06.323 02:03:54 -- nvmf/common.sh@477 -- # '[' -n 3566886 ']' 00:28:06.323 02:03:54 -- nvmf/common.sh@478 -- # killprocess 3566886 00:28:06.323 02:03:54 -- common/autotest_common.sh@936 -- # '[' -z 3566886 ']' 00:28:06.323 02:03:54 -- common/autotest_common.sh@940 -- # kill -0 3566886 00:28:06.323 02:03:54 -- common/autotest_common.sh@941 -- # uname 00:28:06.323 02:03:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:06.323 02:03:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3566886 00:28:06.323 02:03:54 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:06.323 02:03:54 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:06.323 02:03:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3566886' 00:28:06.323 killing process with pid 3566886 00:28:06.323 02:03:54 -- common/autotest_common.sh@955 -- # kill 3566886 00:28:06.323 02:03:54 -- common/autotest_common.sh@960 -- # wait 3566886 00:28:06.323 02:03:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:06.323 02:03:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:06.323 02:03:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:06.323 02:03:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:06.323 02:03:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:06.323 02:03:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:06.323 02:03:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:06.323 02:03:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:08.221 02:03:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:08.221 00:28:08.221 real 0m16.314s 00:28:08.221 user 1m1.261s 00:28:08.221 sys 0m9.423s 00:28:08.221 02:03:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:08.221 02:03:56 -- common/autotest_common.sh@10 -- # set +x 00:28:08.221 ************************************ 00:28:08.221 END TEST nvmf_target_disconnect 00:28:08.221 ************************************ 00:28:08.221 02:03:56 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:08.221 02:03:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:08.221 02:03:56 -- common/autotest_common.sh@10 -- # set +x 00:28:08.221 02:03:56 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:08.221 00:28:08.221 real 21m26.092s 00:28:08.221 user 62m32.793s 00:28:08.221 sys 5m1.164s 00:28:08.221 02:03:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:08.221 02:03:56 -- common/autotest_common.sh@10 -- # set +x 00:28:08.221 ************************************ 00:28:08.221 END TEST nvmf_tcp 00:28:08.221 ************************************ 00:28:08.221 02:03:56 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:08.221 02:03:56 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:08.221 02:03:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:08.221 02:03:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:08.221 02:03:56 -- common/autotest_common.sh@10 -- # set +x 00:28:08.221 ************************************ 00:28:08.221 START TEST spdkcli_nvmf_tcp 00:28:08.221 ************************************ 00:28:08.221 02:03:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:08.221 * Looking for test storage... 00:28:08.221 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:08.221 02:03:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:08.221 02:03:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:08.221 02:03:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:08.221 02:03:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:08.221 02:03:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:08.221 02:03:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:08.221 02:03:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:08.221 02:03:56 -- scripts/common.sh@335 -- # IFS=.-: 00:28:08.221 02:03:56 -- scripts/common.sh@335 -- # read -ra ver1 00:28:08.221 02:03:56 -- scripts/common.sh@336 -- # IFS=.-: 00:28:08.221 02:03:56 -- scripts/common.sh@336 -- # read -ra ver2 00:28:08.221 02:03:56 -- scripts/common.sh@337 -- # local 'op=<' 00:28:08.221 02:03:56 -- scripts/common.sh@339 -- # ver1_l=2 00:28:08.221 02:03:56 -- scripts/common.sh@340 -- # ver2_l=1 00:28:08.221 02:03:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:08.221 02:03:56 -- scripts/common.sh@343 -- # case "$op" in 00:28:08.221 02:03:56 -- scripts/common.sh@344 -- # : 1 00:28:08.221 02:03:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:08.221 02:03:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:08.221 02:03:56 -- scripts/common.sh@364 -- # decimal 1 00:28:08.221 02:03:56 -- scripts/common.sh@352 -- # local d=1 00:28:08.221 02:03:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:08.221 02:03:56 -- scripts/common.sh@354 -- # echo 1 00:28:08.221 02:03:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:08.221 02:03:56 -- scripts/common.sh@365 -- # decimal 2 00:28:08.221 02:03:56 -- scripts/common.sh@352 -- # local d=2 00:28:08.221 02:03:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:08.221 02:03:56 -- scripts/common.sh@354 -- # echo 2 00:28:08.221 02:03:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:08.221 02:03:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:08.221 02:03:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:08.221 02:03:56 -- scripts/common.sh@367 -- # return 0 00:28:08.221 02:03:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:08.221 02:03:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:08.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:08.221 --rc genhtml_branch_coverage=1 00:28:08.221 --rc genhtml_function_coverage=1 00:28:08.221 --rc genhtml_legend=1 00:28:08.221 --rc geninfo_all_blocks=1 00:28:08.221 --rc geninfo_unexecuted_blocks=1 00:28:08.221 00:28:08.221 ' 00:28:08.221 02:03:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:08.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:08.221 --rc genhtml_branch_coverage=1 00:28:08.221 --rc genhtml_function_coverage=1 00:28:08.221 --rc genhtml_legend=1 00:28:08.221 --rc geninfo_all_blocks=1 00:28:08.221 --rc geninfo_unexecuted_blocks=1 00:28:08.221 00:28:08.221 ' 00:28:08.221 02:03:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:08.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:08.221 --rc genhtml_branch_coverage=1 00:28:08.221 --rc genhtml_function_coverage=1 00:28:08.221 --rc genhtml_legend=1 00:28:08.221 --rc geninfo_all_blocks=1 00:28:08.221 --rc geninfo_unexecuted_blocks=1 00:28:08.221 00:28:08.221 ' 00:28:08.221 02:03:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:08.222 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:08.222 --rc genhtml_branch_coverage=1 00:28:08.222 --rc genhtml_function_coverage=1 00:28:08.222 --rc genhtml_legend=1 00:28:08.222 --rc geninfo_all_blocks=1 00:28:08.222 --rc geninfo_unexecuted_blocks=1 00:28:08.222 00:28:08.222 ' 00:28:08.222 02:03:56 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:08.222 02:03:56 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:08.222 02:03:56 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:08.222 02:03:56 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:08.222 02:03:56 -- nvmf/common.sh@7 -- # uname -s 00:28:08.222 02:03:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:08.222 02:03:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:08.222 02:03:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:08.222 02:03:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:08.222 02:03:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:08.222 02:03:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:08.222 02:03:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:08.222 02:03:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:08.222 02:03:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:08.222 02:03:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:08.222 02:03:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:08.222 02:03:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:08.222 02:03:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:08.222 02:03:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:08.222 02:03:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:08.222 02:03:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:08.222 02:03:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:08.222 02:03:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:08.222 02:03:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:08.222 02:03:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:08.222 02:03:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:08.222 02:03:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:08.222 02:03:56 -- paths/export.sh@5 -- # export PATH 00:28:08.222 02:03:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:08.222 02:03:56 -- nvmf/common.sh@46 -- # : 0 00:28:08.222 02:03:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:08.222 02:03:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:08.222 02:03:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:08.222 02:03:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:08.222 02:03:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:08.222 02:03:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:08.222 02:03:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:08.222 02:03:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:08.222 02:03:56 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:08.222 02:03:56 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:08.222 02:03:56 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:08.222 02:03:56 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:08.222 02:03:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:08.222 02:03:56 -- common/autotest_common.sh@10 -- # set +x 00:28:08.222 02:03:56 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:08.222 02:03:56 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3568118 00:28:08.222 02:03:56 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:08.222 02:03:56 -- spdkcli/common.sh@34 -- # waitforlisten 3568118 00:28:08.222 02:03:56 -- common/autotest_common.sh@829 -- # '[' -z 3568118 ']' 00:28:08.222 02:03:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:08.222 02:03:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:08.222 02:03:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:08.222 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:08.222 02:03:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:08.222 02:03:56 -- common/autotest_common.sh@10 -- # set +x 00:28:08.222 [2024-11-19 02:03:56.710858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:08.222 [2024-11-19 02:03:56.710950] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3568118 ] 00:28:08.222 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.480 [2024-11-19 02:03:56.767770] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:08.480 [2024-11-19 02:03:56.877988] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:08.480 [2024-11-19 02:03:56.878189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:08.480 [2024-11-19 02:03:56.878195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:09.413 02:03:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:09.413 02:03:57 -- common/autotest_common.sh@862 -- # return 0 00:28:09.413 02:03:57 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:09.413 02:03:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:09.413 02:03:57 -- common/autotest_common.sh@10 -- # set +x 00:28:09.413 02:03:57 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:09.413 02:03:57 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:09.413 02:03:57 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:09.413 02:03:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:09.413 02:03:57 -- common/autotest_common.sh@10 -- # set +x 00:28:09.413 02:03:57 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:09.413 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:09.413 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:09.413 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:09.413 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:09.413 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:09.413 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:09.413 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:09.413 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:09.413 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:09.413 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:09.413 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:09.413 ' 00:28:09.671 [2024-11-19 02:03:58.195000] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:12.200 [2024-11-19 02:04:00.378618] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:13.133 [2024-11-19 02:04:01.619184] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:15.720 [2024-11-19 02:04:03.938695] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:17.618 [2024-11-19 02:04:05.941048] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:18.990 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:18.990 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:18.990 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:18.990 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:18.990 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:18.990 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:18.990 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:18.990 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:18.990 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:18.990 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:18.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:18.990 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:19.247 02:04:07 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:19.247 02:04:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:19.247 02:04:07 -- common/autotest_common.sh@10 -- # set +x 00:28:19.247 02:04:07 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:19.247 02:04:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:19.247 02:04:07 -- common/autotest_common.sh@10 -- # set +x 00:28:19.247 02:04:07 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:19.247 02:04:07 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:19.505 02:04:08 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:19.762 02:04:08 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:19.762 02:04:08 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:19.762 02:04:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:19.762 02:04:08 -- common/autotest_common.sh@10 -- # set +x 00:28:19.762 02:04:08 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:19.762 02:04:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:19.762 02:04:08 -- common/autotest_common.sh@10 -- # set +x 00:28:19.762 02:04:08 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:19.762 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:19.762 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:19.762 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:19.762 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:19.762 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:19.762 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:19.762 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:19.762 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:19.762 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:19.762 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:19.762 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:19.762 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:19.762 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:19.762 ' 00:28:25.024 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:25.024 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:25.024 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:25.024 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:25.024 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:25.024 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:25.024 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:25.024 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:25.024 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:25.024 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:25.024 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:25.024 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:25.024 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:25.024 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:25.024 02:04:13 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:25.024 02:04:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:25.024 02:04:13 -- common/autotest_common.sh@10 -- # set +x 00:28:25.024 02:04:13 -- spdkcli/nvmf.sh@90 -- # killprocess 3568118 00:28:25.024 02:04:13 -- common/autotest_common.sh@936 -- # '[' -z 3568118 ']' 00:28:25.024 02:04:13 -- common/autotest_common.sh@940 -- # kill -0 3568118 00:28:25.024 02:04:13 -- common/autotest_common.sh@941 -- # uname 00:28:25.024 02:04:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:25.024 02:04:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3568118 00:28:25.024 02:04:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:25.024 02:04:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:25.024 02:04:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3568118' 00:28:25.024 killing process with pid 3568118 00:28:25.024 02:04:13 -- common/autotest_common.sh@955 -- # kill 3568118 00:28:25.024 [2024-11-19 02:04:13.424193] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:25.024 02:04:13 -- common/autotest_common.sh@960 -- # wait 3568118 00:28:25.282 02:04:13 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:25.282 02:04:13 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:25.282 02:04:13 -- spdkcli/common.sh@13 -- # '[' -n 3568118 ']' 00:28:25.283 02:04:13 -- spdkcli/common.sh@14 -- # killprocess 3568118 00:28:25.283 02:04:13 -- common/autotest_common.sh@936 -- # '[' -z 3568118 ']' 00:28:25.283 02:04:13 -- common/autotest_common.sh@940 -- # kill -0 3568118 00:28:25.283 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3568118) - No such process 00:28:25.283 02:04:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3568118 is not found' 00:28:25.283 Process with pid 3568118 is not found 00:28:25.283 02:04:13 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:25.283 02:04:13 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:25.283 02:04:13 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:25.283 00:28:25.283 real 0m17.159s 00:28:25.283 user 0m36.660s 00:28:25.283 sys 0m0.827s 00:28:25.283 02:04:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:25.283 02:04:13 -- common/autotest_common.sh@10 -- # set +x 00:28:25.283 ************************************ 00:28:25.283 END TEST spdkcli_nvmf_tcp 00:28:25.283 ************************************ 00:28:25.283 02:04:13 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:25.283 02:04:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:25.283 02:04:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:25.283 02:04:13 -- common/autotest_common.sh@10 -- # set +x 00:28:25.283 ************************************ 00:28:25.283 START TEST nvmf_identify_passthru 00:28:25.283 ************************************ 00:28:25.283 02:04:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:25.283 * Looking for test storage... 00:28:25.283 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:25.283 02:04:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:25.283 02:04:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:25.283 02:04:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:25.541 02:04:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:25.541 02:04:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:25.541 02:04:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:25.541 02:04:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:25.541 02:04:13 -- scripts/common.sh@335 -- # IFS=.-: 00:28:25.541 02:04:13 -- scripts/common.sh@335 -- # read -ra ver1 00:28:25.541 02:04:13 -- scripts/common.sh@336 -- # IFS=.-: 00:28:25.541 02:04:13 -- scripts/common.sh@336 -- # read -ra ver2 00:28:25.541 02:04:13 -- scripts/common.sh@337 -- # local 'op=<' 00:28:25.541 02:04:13 -- scripts/common.sh@339 -- # ver1_l=2 00:28:25.541 02:04:13 -- scripts/common.sh@340 -- # ver2_l=1 00:28:25.541 02:04:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:25.541 02:04:13 -- scripts/common.sh@343 -- # case "$op" in 00:28:25.541 02:04:13 -- scripts/common.sh@344 -- # : 1 00:28:25.541 02:04:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:25.541 02:04:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:25.541 02:04:13 -- scripts/common.sh@364 -- # decimal 1 00:28:25.541 02:04:13 -- scripts/common.sh@352 -- # local d=1 00:28:25.541 02:04:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:25.541 02:04:13 -- scripts/common.sh@354 -- # echo 1 00:28:25.541 02:04:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:25.541 02:04:13 -- scripts/common.sh@365 -- # decimal 2 00:28:25.541 02:04:13 -- scripts/common.sh@352 -- # local d=2 00:28:25.541 02:04:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:25.541 02:04:13 -- scripts/common.sh@354 -- # echo 2 00:28:25.541 02:04:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:25.541 02:04:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:25.541 02:04:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:25.541 02:04:13 -- scripts/common.sh@367 -- # return 0 00:28:25.541 02:04:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:25.541 02:04:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:25.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.541 --rc genhtml_branch_coverage=1 00:28:25.541 --rc genhtml_function_coverage=1 00:28:25.541 --rc genhtml_legend=1 00:28:25.541 --rc geninfo_all_blocks=1 00:28:25.541 --rc geninfo_unexecuted_blocks=1 00:28:25.541 00:28:25.541 ' 00:28:25.541 02:04:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:25.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.541 --rc genhtml_branch_coverage=1 00:28:25.541 --rc genhtml_function_coverage=1 00:28:25.541 --rc genhtml_legend=1 00:28:25.541 --rc geninfo_all_blocks=1 00:28:25.541 --rc geninfo_unexecuted_blocks=1 00:28:25.541 00:28:25.541 ' 00:28:25.541 02:04:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:25.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.541 --rc genhtml_branch_coverage=1 00:28:25.541 --rc genhtml_function_coverage=1 00:28:25.542 --rc genhtml_legend=1 00:28:25.542 --rc geninfo_all_blocks=1 00:28:25.542 --rc geninfo_unexecuted_blocks=1 00:28:25.542 00:28:25.542 ' 00:28:25.542 02:04:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:25.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.542 --rc genhtml_branch_coverage=1 00:28:25.542 --rc genhtml_function_coverage=1 00:28:25.542 --rc genhtml_legend=1 00:28:25.542 --rc geninfo_all_blocks=1 00:28:25.542 --rc geninfo_unexecuted_blocks=1 00:28:25.542 00:28:25.542 ' 00:28:25.542 02:04:13 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:25.542 02:04:13 -- nvmf/common.sh@7 -- # uname -s 00:28:25.542 02:04:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:25.542 02:04:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:25.542 02:04:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:25.542 02:04:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:25.542 02:04:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:25.542 02:04:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:25.542 02:04:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:25.542 02:04:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:25.542 02:04:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:25.542 02:04:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:25.542 02:04:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:25.542 02:04:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:25.542 02:04:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:25.542 02:04:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:25.542 02:04:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:25.542 02:04:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:25.542 02:04:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:25.542 02:04:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:25.542 02:04:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:25.542 02:04:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- paths/export.sh@5 -- # export PATH 00:28:25.542 02:04:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- nvmf/common.sh@46 -- # : 0 00:28:25.542 02:04:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:25.542 02:04:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:25.542 02:04:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:25.542 02:04:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:25.542 02:04:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:25.542 02:04:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:25.542 02:04:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:25.542 02:04:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:25.542 02:04:13 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:25.542 02:04:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:25.542 02:04:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:25.542 02:04:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:25.542 02:04:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- paths/export.sh@5 -- # export PATH 00:28:25.542 02:04:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.542 02:04:13 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:25.542 02:04:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:25.542 02:04:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:25.542 02:04:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:25.542 02:04:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:25.542 02:04:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:25.542 02:04:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:25.542 02:04:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:25.542 02:04:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:25.542 02:04:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:25.542 02:04:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:25.542 02:04:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:25.542 02:04:13 -- common/autotest_common.sh@10 -- # set +x 00:28:27.443 02:04:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:27.443 02:04:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:27.443 02:04:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:27.443 02:04:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:27.443 02:04:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:27.443 02:04:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:27.443 02:04:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:27.443 02:04:15 -- nvmf/common.sh@294 -- # net_devs=() 00:28:27.443 02:04:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:27.443 02:04:15 -- nvmf/common.sh@295 -- # e810=() 00:28:27.443 02:04:15 -- nvmf/common.sh@295 -- # local -ga e810 00:28:27.443 02:04:15 -- nvmf/common.sh@296 -- # x722=() 00:28:27.443 02:04:15 -- nvmf/common.sh@296 -- # local -ga x722 00:28:27.443 02:04:15 -- nvmf/common.sh@297 -- # mlx=() 00:28:27.443 02:04:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:27.443 02:04:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:27.443 02:04:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:27.443 02:04:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:27.443 02:04:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:27.443 02:04:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:27.443 02:04:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:27.443 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:27.443 02:04:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:27.443 02:04:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:27.443 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:27.443 02:04:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:27.443 02:04:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:27.443 02:04:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:27.443 02:04:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:27.443 02:04:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:27.443 02:04:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:27.443 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:27.443 02:04:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:27.443 02:04:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:27.443 02:04:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:27.443 02:04:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:27.443 02:04:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:27.443 02:04:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:27.443 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:27.443 02:04:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:27.443 02:04:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:27.443 02:04:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:27.443 02:04:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:27.443 02:04:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:27.443 02:04:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:27.443 02:04:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:27.443 02:04:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:27.443 02:04:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:27.443 02:04:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:27.443 02:04:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:27.443 02:04:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:27.443 02:04:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:27.443 02:04:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:27.443 02:04:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:27.443 02:04:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:27.443 02:04:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:27.443 02:04:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:27.443 02:04:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:27.443 02:04:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:27.443 02:04:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:27.443 02:04:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:27.443 02:04:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:27.443 02:04:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:27.702 02:04:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:27.702 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:27.702 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:28:27.702 00:28:27.702 --- 10.0.0.2 ping statistics --- 00:28:27.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:27.702 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:28:27.702 02:04:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:27.702 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:27.702 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:28:27.702 00:28:27.702 --- 10.0.0.1 ping statistics --- 00:28:27.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:27.702 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:28:27.702 02:04:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:27.702 02:04:15 -- nvmf/common.sh@410 -- # return 0 00:28:27.702 02:04:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:27.702 02:04:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:27.702 02:04:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:27.702 02:04:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:27.702 02:04:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:27.702 02:04:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:27.702 02:04:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:27.703 02:04:16 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:27.703 02:04:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:27.703 02:04:16 -- common/autotest_common.sh@10 -- # set +x 00:28:27.703 02:04:16 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:27.703 02:04:16 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:27.703 02:04:16 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:27.703 02:04:16 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:27.703 02:04:16 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:27.703 02:04:16 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:27.703 02:04:16 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:27.703 02:04:16 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:27.703 02:04:16 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:27.703 02:04:16 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:27.703 02:04:16 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:27.703 02:04:16 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:27.703 02:04:16 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:27.703 02:04:16 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:27.703 02:04:16 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:27.703 02:04:16 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:27.703 02:04:16 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:27.703 02:04:16 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:27.703 EAL: No free 2048 kB hugepages reported on node 1 00:28:31.895 02:04:20 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:31.895 02:04:20 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:31.895 02:04:20 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:31.895 02:04:20 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:31.895 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.075 02:04:24 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:36.075 02:04:24 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:36.075 02:04:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:36.075 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.075 02:04:24 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:36.075 02:04:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:36.075 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.075 02:04:24 -- target/identify_passthru.sh@31 -- # nvmfpid=3572971 00:28:36.075 02:04:24 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:36.075 02:04:24 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:36.075 02:04:24 -- target/identify_passthru.sh@35 -- # waitforlisten 3572971 00:28:36.075 02:04:24 -- common/autotest_common.sh@829 -- # '[' -z 3572971 ']' 00:28:36.075 02:04:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:36.075 02:04:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:36.075 02:04:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:36.075 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:36.075 02:04:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:36.075 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.075 [2024-11-19 02:04:24.575313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:36.075 [2024-11-19 02:04:24.575401] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:36.075 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.333 [2024-11-19 02:04:24.639851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:36.333 [2024-11-19 02:04:24.747438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:36.333 [2024-11-19 02:04:24.747588] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:36.333 [2024-11-19 02:04:24.747605] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:36.333 [2024-11-19 02:04:24.747617] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:36.333 [2024-11-19 02:04:24.747678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:36.333 [2024-11-19 02:04:24.747740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:36.333 [2024-11-19 02:04:24.747805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:36.333 [2024-11-19 02:04:24.747808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:36.333 02:04:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:36.333 02:04:24 -- common/autotest_common.sh@862 -- # return 0 00:28:36.333 02:04:24 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:36.333 02:04:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.333 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.333 INFO: Log level set to 20 00:28:36.333 INFO: Requests: 00:28:36.333 { 00:28:36.333 "jsonrpc": "2.0", 00:28:36.333 "method": "nvmf_set_config", 00:28:36.333 "id": 1, 00:28:36.333 "params": { 00:28:36.333 "admin_cmd_passthru": { 00:28:36.333 "identify_ctrlr": true 00:28:36.333 } 00:28:36.333 } 00:28:36.333 } 00:28:36.333 00:28:36.333 INFO: response: 00:28:36.333 { 00:28:36.333 "jsonrpc": "2.0", 00:28:36.333 "id": 1, 00:28:36.333 "result": true 00:28:36.333 } 00:28:36.333 00:28:36.333 02:04:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.333 02:04:24 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:36.333 02:04:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.333 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.333 INFO: Setting log level to 20 00:28:36.333 INFO: Setting log level to 20 00:28:36.333 INFO: Log level set to 20 00:28:36.333 INFO: Log level set to 20 00:28:36.333 INFO: Requests: 00:28:36.333 { 00:28:36.333 "jsonrpc": "2.0", 00:28:36.333 "method": "framework_start_init", 00:28:36.333 "id": 1 00:28:36.333 } 00:28:36.333 00:28:36.333 INFO: Requests: 00:28:36.333 { 00:28:36.333 "jsonrpc": "2.0", 00:28:36.333 "method": "framework_start_init", 00:28:36.333 "id": 1 00:28:36.333 } 00:28:36.333 00:28:36.591 [2024-11-19 02:04:24.920841] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:36.591 INFO: response: 00:28:36.591 { 00:28:36.591 "jsonrpc": "2.0", 00:28:36.591 "id": 1, 00:28:36.591 "result": true 00:28:36.591 } 00:28:36.591 00:28:36.591 INFO: response: 00:28:36.591 { 00:28:36.591 "jsonrpc": "2.0", 00:28:36.591 "id": 1, 00:28:36.591 "result": true 00:28:36.591 } 00:28:36.591 00:28:36.591 02:04:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.591 02:04:24 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:36.591 02:04:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.591 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.591 INFO: Setting log level to 40 00:28:36.591 INFO: Setting log level to 40 00:28:36.591 INFO: Setting log level to 40 00:28:36.591 [2024-11-19 02:04:24.930770] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:36.591 02:04:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.591 02:04:24 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:36.591 02:04:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:36.591 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.591 02:04:24 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:36.591 02:04:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.591 02:04:24 -- common/autotest_common.sh@10 -- # set +x 00:28:39.866 Nvme0n1 00:28:39.866 02:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.866 02:04:27 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:39.866 02:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.866 02:04:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.867 02:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.867 02:04:27 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:39.867 02:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.867 02:04:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.867 02:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.867 02:04:27 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:39.867 02:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.867 02:04:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.867 [2024-11-19 02:04:27.819524] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:39.867 02:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.867 02:04:27 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:39.867 02:04:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.867 02:04:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.867 [2024-11-19 02:04:27.827270] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:39.867 [ 00:28:39.867 { 00:28:39.867 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:39.867 "subtype": "Discovery", 00:28:39.867 "listen_addresses": [], 00:28:39.867 "allow_any_host": true, 00:28:39.867 "hosts": [] 00:28:39.867 }, 00:28:39.867 { 00:28:39.867 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:39.867 "subtype": "NVMe", 00:28:39.867 "listen_addresses": [ 00:28:39.867 { 00:28:39.867 "transport": "TCP", 00:28:39.867 "trtype": "TCP", 00:28:39.867 "adrfam": "IPv4", 00:28:39.867 "traddr": "10.0.0.2", 00:28:39.867 "trsvcid": "4420" 00:28:39.867 } 00:28:39.867 ], 00:28:39.867 "allow_any_host": true, 00:28:39.867 "hosts": [], 00:28:39.867 "serial_number": "SPDK00000000000001", 00:28:39.867 "model_number": "SPDK bdev Controller", 00:28:39.867 "max_namespaces": 1, 00:28:39.867 "min_cntlid": 1, 00:28:39.867 "max_cntlid": 65519, 00:28:39.867 "namespaces": [ 00:28:39.867 { 00:28:39.867 "nsid": 1, 00:28:39.867 "bdev_name": "Nvme0n1", 00:28:39.867 "name": "Nvme0n1", 00:28:39.867 "nguid": "86488C534D734638B2AFD4A7699276BA", 00:28:39.867 "uuid": "86488c53-4d73-4638-b2af-d4a7699276ba" 00:28:39.867 } 00:28:39.867 ] 00:28:39.867 } 00:28:39.867 ] 00:28:39.867 02:04:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.867 02:04:27 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:39.867 02:04:27 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:39.867 02:04:27 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:39.867 EAL: No free 2048 kB hugepages reported on node 1 00:28:39.867 02:04:28 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:39.867 02:04:28 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:39.867 02:04:28 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:39.867 02:04:28 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:39.867 EAL: No free 2048 kB hugepages reported on node 1 00:28:39.867 02:04:28 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:39.867 02:04:28 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:39.867 02:04:28 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:39.867 02:04:28 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:39.867 02:04:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.867 02:04:28 -- common/autotest_common.sh@10 -- # set +x 00:28:39.867 02:04:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.867 02:04:28 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:39.867 02:04:28 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:39.867 02:04:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:39.867 02:04:28 -- nvmf/common.sh@116 -- # sync 00:28:39.867 02:04:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:39.867 02:04:28 -- nvmf/common.sh@119 -- # set +e 00:28:39.867 02:04:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:39.867 02:04:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:39.867 rmmod nvme_tcp 00:28:39.867 rmmod nvme_fabrics 00:28:39.867 rmmod nvme_keyring 00:28:39.867 02:04:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:39.867 02:04:28 -- nvmf/common.sh@123 -- # set -e 00:28:39.867 02:04:28 -- nvmf/common.sh@124 -- # return 0 00:28:39.867 02:04:28 -- nvmf/common.sh@477 -- # '[' -n 3572971 ']' 00:28:39.867 02:04:28 -- nvmf/common.sh@478 -- # killprocess 3572971 00:28:39.867 02:04:28 -- common/autotest_common.sh@936 -- # '[' -z 3572971 ']' 00:28:39.867 02:04:28 -- common/autotest_common.sh@940 -- # kill -0 3572971 00:28:39.867 02:04:28 -- common/autotest_common.sh@941 -- # uname 00:28:39.867 02:04:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:39.867 02:04:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3572971 00:28:39.867 02:04:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:39.867 02:04:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:39.867 02:04:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3572971' 00:28:39.867 killing process with pid 3572971 00:28:39.867 02:04:28 -- common/autotest_common.sh@955 -- # kill 3572971 00:28:39.867 [2024-11-19 02:04:28.344837] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:39.867 02:04:28 -- common/autotest_common.sh@960 -- # wait 3572971 00:28:41.762 02:04:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:41.762 02:04:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:41.762 02:04:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:41.762 02:04:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:41.762 02:04:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:41.762 02:04:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:41.762 02:04:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:41.762 02:04:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:43.665 02:04:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:43.665 00:28:43.665 real 0m18.297s 00:28:43.665 user 0m27.256s 00:28:43.665 sys 0m2.348s 00:28:43.665 02:04:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:43.665 02:04:32 -- common/autotest_common.sh@10 -- # set +x 00:28:43.665 ************************************ 00:28:43.665 END TEST nvmf_identify_passthru 00:28:43.665 ************************************ 00:28:43.665 02:04:32 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:43.665 02:04:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:43.665 02:04:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:43.665 02:04:32 -- common/autotest_common.sh@10 -- # set +x 00:28:43.665 ************************************ 00:28:43.665 START TEST nvmf_dif 00:28:43.665 ************************************ 00:28:43.665 02:04:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:43.665 * Looking for test storage... 00:28:43.665 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:43.665 02:04:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:43.665 02:04:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:43.665 02:04:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:43.665 02:04:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:43.665 02:04:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:43.665 02:04:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:43.665 02:04:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:43.665 02:04:32 -- scripts/common.sh@335 -- # IFS=.-: 00:28:43.665 02:04:32 -- scripts/common.sh@335 -- # read -ra ver1 00:28:43.665 02:04:32 -- scripts/common.sh@336 -- # IFS=.-: 00:28:43.665 02:04:32 -- scripts/common.sh@336 -- # read -ra ver2 00:28:43.665 02:04:32 -- scripts/common.sh@337 -- # local 'op=<' 00:28:43.665 02:04:32 -- scripts/common.sh@339 -- # ver1_l=2 00:28:43.665 02:04:32 -- scripts/common.sh@340 -- # ver2_l=1 00:28:43.665 02:04:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:43.665 02:04:32 -- scripts/common.sh@343 -- # case "$op" in 00:28:43.665 02:04:32 -- scripts/common.sh@344 -- # : 1 00:28:43.665 02:04:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:43.665 02:04:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:43.665 02:04:32 -- scripts/common.sh@364 -- # decimal 1 00:28:43.665 02:04:32 -- scripts/common.sh@352 -- # local d=1 00:28:43.665 02:04:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:43.665 02:04:32 -- scripts/common.sh@354 -- # echo 1 00:28:43.665 02:04:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:43.665 02:04:32 -- scripts/common.sh@365 -- # decimal 2 00:28:43.665 02:04:32 -- scripts/common.sh@352 -- # local d=2 00:28:43.665 02:04:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:43.665 02:04:32 -- scripts/common.sh@354 -- # echo 2 00:28:43.665 02:04:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:43.665 02:04:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:43.665 02:04:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:43.665 02:04:32 -- scripts/common.sh@367 -- # return 0 00:28:43.665 02:04:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:43.665 02:04:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:43.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.665 --rc genhtml_branch_coverage=1 00:28:43.665 --rc genhtml_function_coverage=1 00:28:43.665 --rc genhtml_legend=1 00:28:43.665 --rc geninfo_all_blocks=1 00:28:43.665 --rc geninfo_unexecuted_blocks=1 00:28:43.665 00:28:43.665 ' 00:28:43.665 02:04:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:43.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.665 --rc genhtml_branch_coverage=1 00:28:43.665 --rc genhtml_function_coverage=1 00:28:43.665 --rc genhtml_legend=1 00:28:43.665 --rc geninfo_all_blocks=1 00:28:43.665 --rc geninfo_unexecuted_blocks=1 00:28:43.665 00:28:43.665 ' 00:28:43.665 02:04:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:43.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.665 --rc genhtml_branch_coverage=1 00:28:43.665 --rc genhtml_function_coverage=1 00:28:43.665 --rc genhtml_legend=1 00:28:43.665 --rc geninfo_all_blocks=1 00:28:43.665 --rc geninfo_unexecuted_blocks=1 00:28:43.665 00:28:43.665 ' 00:28:43.665 02:04:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:43.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.665 --rc genhtml_branch_coverage=1 00:28:43.665 --rc genhtml_function_coverage=1 00:28:43.665 --rc genhtml_legend=1 00:28:43.665 --rc geninfo_all_blocks=1 00:28:43.665 --rc geninfo_unexecuted_blocks=1 00:28:43.665 00:28:43.665 ' 00:28:43.665 02:04:32 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:43.665 02:04:32 -- nvmf/common.sh@7 -- # uname -s 00:28:43.665 02:04:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:43.665 02:04:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:43.665 02:04:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:43.665 02:04:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:43.665 02:04:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:43.665 02:04:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:43.665 02:04:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:43.665 02:04:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:43.665 02:04:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:43.665 02:04:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:43.665 02:04:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:43.665 02:04:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:43.665 02:04:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:43.665 02:04:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:43.665 02:04:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:43.665 02:04:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:43.665 02:04:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:43.665 02:04:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:43.665 02:04:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:43.665 02:04:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.665 02:04:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.665 02:04:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.665 02:04:32 -- paths/export.sh@5 -- # export PATH 00:28:43.665 02:04:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.665 02:04:32 -- nvmf/common.sh@46 -- # : 0 00:28:43.665 02:04:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:43.665 02:04:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:43.665 02:04:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:43.665 02:04:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:43.665 02:04:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:43.665 02:04:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:43.665 02:04:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:43.665 02:04:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:43.665 02:04:32 -- target/dif.sh@15 -- # NULL_META=16 00:28:43.665 02:04:32 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:43.665 02:04:32 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:43.665 02:04:32 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:43.665 02:04:32 -- target/dif.sh@135 -- # nvmftestinit 00:28:43.665 02:04:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:43.665 02:04:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:43.665 02:04:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:43.665 02:04:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:43.665 02:04:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:43.665 02:04:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:43.665 02:04:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:43.665 02:04:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:43.665 02:04:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:43.665 02:04:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:43.665 02:04:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:43.665 02:04:32 -- common/autotest_common.sh@10 -- # set +x 00:28:45.567 02:04:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:45.567 02:04:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:45.567 02:04:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:45.567 02:04:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:45.567 02:04:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:45.567 02:04:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:45.567 02:04:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:45.567 02:04:34 -- nvmf/common.sh@294 -- # net_devs=() 00:28:45.567 02:04:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:45.567 02:04:34 -- nvmf/common.sh@295 -- # e810=() 00:28:45.567 02:04:34 -- nvmf/common.sh@295 -- # local -ga e810 00:28:45.567 02:04:34 -- nvmf/common.sh@296 -- # x722=() 00:28:45.567 02:04:34 -- nvmf/common.sh@296 -- # local -ga x722 00:28:45.567 02:04:34 -- nvmf/common.sh@297 -- # mlx=() 00:28:45.567 02:04:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:45.567 02:04:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:45.567 02:04:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:45.567 02:04:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:45.567 02:04:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:45.567 02:04:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:45.567 02:04:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:45.567 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:45.567 02:04:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:45.567 02:04:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:45.567 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:45.567 02:04:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:45.567 02:04:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:45.567 02:04:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:45.567 02:04:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:45.567 02:04:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:45.567 02:04:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:45.567 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:45.567 02:04:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:45.567 02:04:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:45.567 02:04:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:45.567 02:04:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:45.567 02:04:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:45.567 02:04:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:45.567 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:45.567 02:04:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:45.567 02:04:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:45.567 02:04:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:45.567 02:04:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:45.567 02:04:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:45.567 02:04:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:45.567 02:04:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:45.567 02:04:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:45.567 02:04:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:45.567 02:04:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:45.567 02:04:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:45.567 02:04:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:45.567 02:04:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:45.568 02:04:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:45.568 02:04:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:45.568 02:04:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:45.568 02:04:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:45.568 02:04:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:45.826 02:04:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:45.826 02:04:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:45.826 02:04:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:45.826 02:04:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:45.826 02:04:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:45.826 02:04:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:45.826 02:04:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:45.826 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:45.826 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:28:45.826 00:28:45.826 --- 10.0.0.2 ping statistics --- 00:28:45.826 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:45.826 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:28:45.826 02:04:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:45.826 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:45.826 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:28:45.826 00:28:45.826 --- 10.0.0.1 ping statistics --- 00:28:45.826 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:45.826 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:28:45.826 02:04:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:45.826 02:04:34 -- nvmf/common.sh@410 -- # return 0 00:28:45.826 02:04:34 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:45.826 02:04:34 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:47.199 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:47.199 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:47.199 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:47.199 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:47.199 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:47.199 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:47.199 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:47.199 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:47.199 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:47.199 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:47.199 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:47.199 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:47.199 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:47.199 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:47.199 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:47.199 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:47.199 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:47.199 02:04:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:47.199 02:04:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:47.199 02:04:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:47.199 02:04:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:47.199 02:04:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:47.199 02:04:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:47.199 02:04:35 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:47.199 02:04:35 -- target/dif.sh@137 -- # nvmfappstart 00:28:47.199 02:04:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:47.199 02:04:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:47.199 02:04:35 -- common/autotest_common.sh@10 -- # set +x 00:28:47.199 02:04:35 -- nvmf/common.sh@469 -- # nvmfpid=3576175 00:28:47.199 02:04:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:47.199 02:04:35 -- nvmf/common.sh@470 -- # waitforlisten 3576175 00:28:47.199 02:04:35 -- common/autotest_common.sh@829 -- # '[' -z 3576175 ']' 00:28:47.199 02:04:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:47.199 02:04:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:47.199 02:04:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:47.199 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:47.199 02:04:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:47.199 02:04:35 -- common/autotest_common.sh@10 -- # set +x 00:28:47.199 [2024-11-19 02:04:35.623951] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:47.199 [2024-11-19 02:04:35.624035] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:47.199 EAL: No free 2048 kB hugepages reported on node 1 00:28:47.199 [2024-11-19 02:04:35.693723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:47.457 [2024-11-19 02:04:35.809766] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:47.458 [2024-11-19 02:04:35.809932] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:47.458 [2024-11-19 02:04:35.809953] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:47.458 [2024-11-19 02:04:35.809978] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:47.458 [2024-11-19 02:04:35.810025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:48.392 02:04:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:48.392 02:04:36 -- common/autotest_common.sh@862 -- # return 0 00:28:48.392 02:04:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:48.392 02:04:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:48.392 02:04:36 -- common/autotest_common.sh@10 -- # set +x 00:28:48.392 02:04:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:48.392 02:04:36 -- target/dif.sh@139 -- # create_transport 00:28:48.392 02:04:36 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:48.392 02:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.392 02:04:36 -- common/autotest_common.sh@10 -- # set +x 00:28:48.392 [2024-11-19 02:04:36.614800] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:48.392 02:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.392 02:04:36 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:48.392 02:04:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:48.392 02:04:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:48.392 02:04:36 -- common/autotest_common.sh@10 -- # set +x 00:28:48.392 ************************************ 00:28:48.392 START TEST fio_dif_1_default 00:28:48.392 ************************************ 00:28:48.392 02:04:36 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:48.392 02:04:36 -- target/dif.sh@86 -- # create_subsystems 0 00:28:48.392 02:04:36 -- target/dif.sh@28 -- # local sub 00:28:48.392 02:04:36 -- target/dif.sh@30 -- # for sub in "$@" 00:28:48.392 02:04:36 -- target/dif.sh@31 -- # create_subsystem 0 00:28:48.392 02:04:36 -- target/dif.sh@18 -- # local sub_id=0 00:28:48.392 02:04:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:48.392 02:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.392 02:04:36 -- common/autotest_common.sh@10 -- # set +x 00:28:48.392 bdev_null0 00:28:48.392 02:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.392 02:04:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:48.392 02:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.392 02:04:36 -- common/autotest_common.sh@10 -- # set +x 00:28:48.392 02:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.392 02:04:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:48.392 02:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.392 02:04:36 -- common/autotest_common.sh@10 -- # set +x 00:28:48.392 02:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.392 02:04:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:48.392 02:04:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.392 02:04:36 -- common/autotest_common.sh@10 -- # set +x 00:28:48.392 [2024-11-19 02:04:36.651044] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:48.392 02:04:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.392 02:04:36 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:48.392 02:04:36 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:48.392 02:04:36 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:48.392 02:04:36 -- nvmf/common.sh@520 -- # config=() 00:28:48.392 02:04:36 -- nvmf/common.sh@520 -- # local subsystem config 00:28:48.392 02:04:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:48.392 02:04:36 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.392 02:04:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:48.392 { 00:28:48.392 "params": { 00:28:48.392 "name": "Nvme$subsystem", 00:28:48.392 "trtype": "$TEST_TRANSPORT", 00:28:48.392 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:48.392 "adrfam": "ipv4", 00:28:48.392 "trsvcid": "$NVMF_PORT", 00:28:48.392 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:48.392 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:48.392 "hdgst": ${hdgst:-false}, 00:28:48.392 "ddgst": ${ddgst:-false} 00:28:48.392 }, 00:28:48.392 "method": "bdev_nvme_attach_controller" 00:28:48.392 } 00:28:48.392 EOF 00:28:48.392 )") 00:28:48.392 02:04:36 -- target/dif.sh@82 -- # gen_fio_conf 00:28:48.392 02:04:36 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.392 02:04:36 -- target/dif.sh@54 -- # local file 00:28:48.392 02:04:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:48.392 02:04:36 -- target/dif.sh@56 -- # cat 00:28:48.392 02:04:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:48.392 02:04:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:48.392 02:04:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.392 02:04:36 -- common/autotest_common.sh@1330 -- # shift 00:28:48.392 02:04:36 -- nvmf/common.sh@542 -- # cat 00:28:48.392 02:04:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:48.392 02:04:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.392 02:04:36 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:48.392 02:04:36 -- target/dif.sh@72 -- # (( file <= files )) 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:48.392 02:04:36 -- nvmf/common.sh@544 -- # jq . 00:28:48.392 02:04:36 -- nvmf/common.sh@545 -- # IFS=, 00:28:48.392 02:04:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:48.392 "params": { 00:28:48.392 "name": "Nvme0", 00:28:48.392 "trtype": "tcp", 00:28:48.392 "traddr": "10.0.0.2", 00:28:48.392 "adrfam": "ipv4", 00:28:48.392 "trsvcid": "4420", 00:28:48.392 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:48.392 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:48.392 "hdgst": false, 00:28:48.392 "ddgst": false 00:28:48.392 }, 00:28:48.392 "method": "bdev_nvme_attach_controller" 00:28:48.392 }' 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:48.392 02:04:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:48.392 02:04:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:48.392 02:04:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:48.392 02:04:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:48.392 02:04:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:48.392 02:04:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.392 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:48.392 fio-3.35 00:28:48.392 Starting 1 thread 00:28:48.650 EAL: No free 2048 kB hugepages reported on node 1 00:28:48.907 [2024-11-19 02:04:37.386703] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:48.907 [2024-11-19 02:04:37.386789] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:01.104 00:29:01.104 filename0: (groupid=0, jobs=1): err= 0: pid=3576536: Tue Nov 19 02:04:47 2024 00:29:01.104 read: IOPS=190, BW=762KiB/s (781kB/s)(7648KiB/10034msec) 00:29:01.104 slat (nsec): min=6588, max=38203, avg=8351.68, stdev=2932.98 00:29:01.104 clat (usec): min=524, max=42873, avg=20965.11, stdev=20459.70 00:29:01.104 lat (usec): min=531, max=42912, avg=20973.46, stdev=20459.46 00:29:01.104 clat percentiles (usec): 00:29:01.104 | 1.00th=[ 553], 5.00th=[ 570], 10.00th=[ 578], 20.00th=[ 586], 00:29:01.104 | 30.00th=[ 594], 40.00th=[ 611], 50.00th=[ 758], 60.00th=[41157], 00:29:01.104 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:29:01.104 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:29:01.104 | 99.99th=[42730] 00:29:01.104 bw ( KiB/s): min= 704, max= 800, per=100.00%, avg=763.20, stdev=21.47, samples=20 00:29:01.104 iops : min= 176, max= 200, avg=190.80, stdev= 5.37, samples=20 00:29:01.104 lat (usec) : 750=49.90%, 1000=0.31% 00:29:01.104 lat (msec) : 50=49.79% 00:29:01.104 cpu : usr=91.54%, sys=8.17%, ctx=20, majf=0, minf=262 00:29:01.104 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:01.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.104 issued rwts: total=1912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:01.104 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:01.104 00:29:01.104 Run status group 0 (all jobs): 00:29:01.104 READ: bw=762KiB/s (781kB/s), 762KiB/s-762KiB/s (781kB/s-781kB/s), io=7648KiB (7832kB), run=10034-10034msec 00:29:01.104 02:04:47 -- target/dif.sh@88 -- # destroy_subsystems 0 00:29:01.104 02:04:47 -- target/dif.sh@43 -- # local sub 00:29:01.104 02:04:47 -- target/dif.sh@45 -- # for sub in "$@" 00:29:01.104 02:04:47 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:01.104 02:04:47 -- target/dif.sh@36 -- # local sub_id=0 00:29:01.104 02:04:47 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 00:29:01.104 real 0m11.159s 00:29:01.104 user 0m10.316s 00:29:01.104 sys 0m1.108s 00:29:01.104 02:04:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 ************************************ 00:29:01.104 END TEST fio_dif_1_default 00:29:01.104 ************************************ 00:29:01.104 02:04:47 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:29:01.104 02:04:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:01.104 02:04:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 ************************************ 00:29:01.104 START TEST fio_dif_1_multi_subsystems 00:29:01.104 ************************************ 00:29:01.104 02:04:47 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:29:01.104 02:04:47 -- target/dif.sh@92 -- # local files=1 00:29:01.104 02:04:47 -- target/dif.sh@94 -- # create_subsystems 0 1 00:29:01.104 02:04:47 -- target/dif.sh@28 -- # local sub 00:29:01.104 02:04:47 -- target/dif.sh@30 -- # for sub in "$@" 00:29:01.104 02:04:47 -- target/dif.sh@31 -- # create_subsystem 0 00:29:01.104 02:04:47 -- target/dif.sh@18 -- # local sub_id=0 00:29:01.104 02:04:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 bdev_null0 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 [2024-11-19 02:04:47.837460] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@30 -- # for sub in "$@" 00:29:01.104 02:04:47 -- target/dif.sh@31 -- # create_subsystem 1 00:29:01.104 02:04:47 -- target/dif.sh@18 -- # local sub_id=1 00:29:01.104 02:04:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 bdev_null1 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:01.104 02:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.104 02:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:01.104 02:04:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.104 02:04:47 -- target/dif.sh@95 -- # fio /dev/fd/62 00:29:01.104 02:04:47 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:29:01.104 02:04:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.104 02:04:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:01.104 02:04:47 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.104 02:04:47 -- nvmf/common.sh@520 -- # config=() 00:29:01.104 02:04:47 -- target/dif.sh@82 -- # gen_fio_conf 00:29:01.104 02:04:47 -- nvmf/common.sh@520 -- # local subsystem config 00:29:01.104 02:04:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:01.104 02:04:47 -- target/dif.sh@54 -- # local file 00:29:01.104 02:04:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:01.104 02:04:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:01.104 02:04:47 -- target/dif.sh@56 -- # cat 00:29:01.104 02:04:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:01.104 { 00:29:01.104 "params": { 00:29:01.104 "name": "Nvme$subsystem", 00:29:01.104 "trtype": "$TEST_TRANSPORT", 00:29:01.104 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:01.104 "adrfam": "ipv4", 00:29:01.104 "trsvcid": "$NVMF_PORT", 00:29:01.104 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:01.104 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:01.104 "hdgst": ${hdgst:-false}, 00:29:01.104 "ddgst": ${ddgst:-false} 00:29:01.104 }, 00:29:01.104 "method": "bdev_nvme_attach_controller" 00:29:01.104 } 00:29:01.104 EOF 00:29:01.104 )") 00:29:01.104 02:04:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:01.104 02:04:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.104 02:04:47 -- common/autotest_common.sh@1330 -- # shift 00:29:01.104 02:04:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:01.104 02:04:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:01.104 02:04:47 -- nvmf/common.sh@542 -- # cat 00:29:01.104 02:04:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:01.104 02:04:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.104 02:04:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:01.104 02:04:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:01.104 02:04:47 -- target/dif.sh@73 -- # cat 00:29:01.104 02:04:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:01.104 02:04:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:01.104 02:04:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:01.104 { 00:29:01.104 "params": { 00:29:01.104 "name": "Nvme$subsystem", 00:29:01.104 "trtype": "$TEST_TRANSPORT", 00:29:01.104 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:01.105 "adrfam": "ipv4", 00:29:01.105 "trsvcid": "$NVMF_PORT", 00:29:01.105 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:01.105 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:01.105 "hdgst": ${hdgst:-false}, 00:29:01.105 "ddgst": ${ddgst:-false} 00:29:01.105 }, 00:29:01.105 "method": "bdev_nvme_attach_controller" 00:29:01.105 } 00:29:01.105 EOF 00:29:01.105 )") 00:29:01.105 02:04:47 -- target/dif.sh@72 -- # (( file++ )) 00:29:01.105 02:04:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:01.105 02:04:47 -- nvmf/common.sh@542 -- # cat 00:29:01.105 02:04:47 -- nvmf/common.sh@544 -- # jq . 00:29:01.105 02:04:47 -- nvmf/common.sh@545 -- # IFS=, 00:29:01.105 02:04:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:01.105 "params": { 00:29:01.105 "name": "Nvme0", 00:29:01.105 "trtype": "tcp", 00:29:01.105 "traddr": "10.0.0.2", 00:29:01.105 "adrfam": "ipv4", 00:29:01.105 "trsvcid": "4420", 00:29:01.105 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:01.105 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:01.105 "hdgst": false, 00:29:01.105 "ddgst": false 00:29:01.105 }, 00:29:01.105 "method": "bdev_nvme_attach_controller" 00:29:01.105 },{ 00:29:01.105 "params": { 00:29:01.105 "name": "Nvme1", 00:29:01.105 "trtype": "tcp", 00:29:01.105 "traddr": "10.0.0.2", 00:29:01.105 "adrfam": "ipv4", 00:29:01.105 "trsvcid": "4420", 00:29:01.105 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:01.105 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:01.105 "hdgst": false, 00:29:01.105 "ddgst": false 00:29:01.105 }, 00:29:01.105 "method": "bdev_nvme_attach_controller" 00:29:01.105 }' 00:29:01.105 02:04:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:01.105 02:04:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:01.105 02:04:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:01.105 02:04:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.105 02:04:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:01.105 02:04:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:01.105 02:04:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:01.105 02:04:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:01.105 02:04:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:01.105 02:04:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.105 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:01.105 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:01.105 fio-3.35 00:29:01.105 Starting 2 threads 00:29:01.105 EAL: No free 2048 kB hugepages reported on node 1 00:29:01.105 [2024-11-19 02:04:48.635063] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:01.105 [2024-11-19 02:04:48.635148] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:11.072 00:29:11.072 filename0: (groupid=0, jobs=1): err= 0: pid=3577977: Tue Nov 19 02:04:58 2024 00:29:11.072 read: IOPS=97, BW=391KiB/s (400kB/s)(3920KiB/10032msec) 00:29:11.072 slat (nsec): min=6893, max=38409, avg=9400.44, stdev=3582.21 00:29:11.072 clat (usec): min=625, max=45726, avg=40916.14, stdev=2616.38 00:29:11.072 lat (usec): min=633, max=45748, avg=40925.54, stdev=2616.60 00:29:11.072 clat percentiles (usec): 00:29:11.072 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:11.072 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:11.072 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:29:11.072 | 99.00th=[43254], 99.50th=[43254], 99.90th=[45876], 99.95th=[45876], 00:29:11.072 | 99.99th=[45876] 00:29:11.072 bw ( KiB/s): min= 384, max= 416, per=34.20%, avg=390.40, stdev=13.13, samples=20 00:29:11.072 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:29:11.072 lat (usec) : 750=0.41% 00:29:11.072 lat (msec) : 50=99.59% 00:29:11.072 cpu : usr=96.05%, sys=3.64%, ctx=17, majf=0, minf=145 00:29:11.072 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:11.072 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:11.072 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:11.072 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:11.072 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:11.072 filename1: (groupid=0, jobs=1): err= 0: pid=3577978: Tue Nov 19 02:04:58 2024 00:29:11.072 read: IOPS=187, BW=750KiB/s (769kB/s)(7520KiB/10020msec) 00:29:11.072 slat (nsec): min=6777, max=60722, avg=8771.62, stdev=3294.70 00:29:11.072 clat (usec): min=526, max=45743, avg=21291.23, stdev=20501.82 00:29:11.072 lat (usec): min=533, max=45779, avg=21300.00, stdev=20501.41 00:29:11.072 clat percentiles (usec): 00:29:11.072 | 1.00th=[ 562], 5.00th=[ 570], 10.00th=[ 578], 20.00th=[ 586], 00:29:11.072 | 30.00th=[ 594], 40.00th=[ 619], 50.00th=[40633], 60.00th=[41157], 00:29:11.072 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:29:11.072 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45876], 99.95th=[45876], 00:29:11.072 | 99.99th=[45876] 00:29:11.072 bw ( KiB/s): min= 672, max= 768, per=65.77%, avg=750.40, stdev=31.96, samples=20 00:29:11.072 iops : min= 168, max= 192, avg=187.60, stdev= 7.99, samples=20 00:29:11.072 lat (usec) : 750=44.73%, 1000=4.57% 00:29:11.072 lat (msec) : 2=0.27%, 50=50.43% 00:29:11.073 cpu : usr=95.73%, sys=3.97%, ctx=14, majf=0, minf=218 00:29:11.073 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:11.073 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:11.073 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:11.073 issued rwts: total=1880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:11.073 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:11.073 00:29:11.073 Run status group 0 (all jobs): 00:29:11.073 READ: bw=1140KiB/s (1168kB/s), 391KiB/s-750KiB/s (400kB/s-769kB/s), io=11.2MiB (11.7MB), run=10020-10032msec 00:29:11.073 02:04:59 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:11.073 02:04:59 -- target/dif.sh@43 -- # local sub 00:29:11.073 02:04:59 -- target/dif.sh@45 -- # for sub in "$@" 00:29:11.073 02:04:59 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:11.073 02:04:59 -- target/dif.sh@36 -- # local sub_id=0 00:29:11.073 02:04:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 02:04:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 02:04:59 -- target/dif.sh@45 -- # for sub in "$@" 00:29:11.073 02:04:59 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:11.073 02:04:59 -- target/dif.sh@36 -- # local sub_id=1 00:29:11.073 02:04:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 02:04:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 00:29:11.073 real 0m11.290s 00:29:11.073 user 0m20.469s 00:29:11.073 sys 0m1.052s 00:29:11.073 02:04:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 ************************************ 00:29:11.073 END TEST fio_dif_1_multi_subsystems 00:29:11.073 ************************************ 00:29:11.073 02:04:59 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:11.073 02:04:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:11.073 02:04:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 ************************************ 00:29:11.073 START TEST fio_dif_rand_params 00:29:11.073 ************************************ 00:29:11.073 02:04:59 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:11.073 02:04:59 -- target/dif.sh@100 -- # local NULL_DIF 00:29:11.073 02:04:59 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:11.073 02:04:59 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:11.073 02:04:59 -- target/dif.sh@103 -- # bs=128k 00:29:11.073 02:04:59 -- target/dif.sh@103 -- # numjobs=3 00:29:11.073 02:04:59 -- target/dif.sh@103 -- # iodepth=3 00:29:11.073 02:04:59 -- target/dif.sh@103 -- # runtime=5 00:29:11.073 02:04:59 -- target/dif.sh@105 -- # create_subsystems 0 00:29:11.073 02:04:59 -- target/dif.sh@28 -- # local sub 00:29:11.073 02:04:59 -- target/dif.sh@30 -- # for sub in "$@" 00:29:11.073 02:04:59 -- target/dif.sh@31 -- # create_subsystem 0 00:29:11.073 02:04:59 -- target/dif.sh@18 -- # local sub_id=0 00:29:11.073 02:04:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 bdev_null0 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 02:04:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 02:04:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 02:04:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:11.073 02:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.073 02:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:11.073 [2024-11-19 02:04:59.150347] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:11.073 02:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.073 02:04:59 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:11.073 02:04:59 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:11.073 02:04:59 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:11.073 02:04:59 -- nvmf/common.sh@520 -- # config=() 00:29:11.073 02:04:59 -- nvmf/common.sh@520 -- # local subsystem config 00:29:11.073 02:04:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:11.073 02:04:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:11.073 { 00:29:11.073 "params": { 00:29:11.073 "name": "Nvme$subsystem", 00:29:11.073 "trtype": "$TEST_TRANSPORT", 00:29:11.073 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:11.073 "adrfam": "ipv4", 00:29:11.073 "trsvcid": "$NVMF_PORT", 00:29:11.073 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:11.073 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:11.073 "hdgst": ${hdgst:-false}, 00:29:11.073 "ddgst": ${ddgst:-false} 00:29:11.073 }, 00:29:11.073 "method": "bdev_nvme_attach_controller" 00:29:11.073 } 00:29:11.073 EOF 00:29:11.073 )") 00:29:11.073 02:04:59 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:11.073 02:04:59 -- target/dif.sh@82 -- # gen_fio_conf 00:29:11.073 02:04:59 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:11.073 02:04:59 -- target/dif.sh@54 -- # local file 00:29:11.073 02:04:59 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:11.073 02:04:59 -- target/dif.sh@56 -- # cat 00:29:11.073 02:04:59 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:11.073 02:04:59 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:11.073 02:04:59 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:11.073 02:04:59 -- nvmf/common.sh@542 -- # cat 00:29:11.073 02:04:59 -- common/autotest_common.sh@1330 -- # shift 00:29:11.073 02:04:59 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:11.073 02:04:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:11.073 02:04:59 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:11.073 02:04:59 -- target/dif.sh@72 -- # (( file <= files )) 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:11.073 02:04:59 -- nvmf/common.sh@544 -- # jq . 00:29:11.073 02:04:59 -- nvmf/common.sh@545 -- # IFS=, 00:29:11.073 02:04:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:11.073 "params": { 00:29:11.073 "name": "Nvme0", 00:29:11.073 "trtype": "tcp", 00:29:11.073 "traddr": "10.0.0.2", 00:29:11.073 "adrfam": "ipv4", 00:29:11.073 "trsvcid": "4420", 00:29:11.073 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:11.073 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:11.073 "hdgst": false, 00:29:11.073 "ddgst": false 00:29:11.073 }, 00:29:11.073 "method": "bdev_nvme_attach_controller" 00:29:11.073 }' 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:11.073 02:04:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:11.073 02:04:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:11.073 02:04:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:11.073 02:04:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:11.073 02:04:59 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:11.073 02:04:59 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:11.073 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:11.073 ... 00:29:11.073 fio-3.35 00:29:11.073 Starting 3 threads 00:29:11.073 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.666 [2024-11-19 02:04:59.968416] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:11.666 [2024-11-19 02:04:59.968495] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:16.945 00:29:16.945 filename0: (groupid=0, jobs=1): err= 0: pid=3579416: Tue Nov 19 02:05:05 2024 00:29:16.945 read: IOPS=215, BW=26.9MiB/s (28.2MB/s)(135MiB/5006msec) 00:29:16.945 slat (nsec): min=7355, max=41542, avg=13891.93, stdev=3543.04 00:29:16.945 clat (usec): min=5939, max=92152, avg=13912.26, stdev=5280.18 00:29:16.945 lat (usec): min=5952, max=92165, avg=13926.15, stdev=5280.53 00:29:16.945 clat percentiles (usec): 00:29:16.945 | 1.00th=[ 7898], 5.00th=[ 8979], 10.00th=[10552], 20.00th=[11469], 00:29:16.945 | 30.00th=[12256], 40.00th=[12911], 50.00th=[13566], 60.00th=[14222], 00:29:16.945 | 70.00th=[14877], 80.00th=[15401], 90.00th=[16057], 95.00th=[16712], 00:29:16.945 | 99.00th=[50070], 99.50th=[52691], 99.90th=[56361], 99.95th=[91751], 00:29:16.945 | 99.99th=[91751] 00:29:16.945 bw ( KiB/s): min=24832, max=30208, per=30.98%, avg=27526.00, stdev=2013.94, samples=10 00:29:16.945 iops : min= 194, max= 236, avg=215.00, stdev=15.67, samples=10 00:29:16.945 lat (msec) : 10=7.33%, 20=91.09%, 50=0.65%, 100=0.93% 00:29:16.945 cpu : usr=93.83%, sys=5.69%, ctx=10, majf=0, minf=111 00:29:16.945 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:16.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:16.945 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:16.945 issued rwts: total=1078,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:16.945 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:16.945 filename0: (groupid=0, jobs=1): err= 0: pid=3579417: Tue Nov 19 02:05:05 2024 00:29:16.945 read: IOPS=249, BW=31.2MiB/s (32.7MB/s)(157MiB/5047msec) 00:29:16.945 slat (nsec): min=7207, max=70338, avg=14042.36, stdev=4307.01 00:29:16.945 clat (usec): min=4828, max=53626, avg=11971.55, stdev=5142.55 00:29:16.945 lat (usec): min=4839, max=53637, avg=11985.59, stdev=5142.57 00:29:16.945 clat percentiles (usec): 00:29:16.945 | 1.00th=[ 6783], 5.00th=[ 8848], 10.00th=[ 9765], 20.00th=[10290], 00:29:16.945 | 30.00th=[10683], 40.00th=[11076], 50.00th=[11338], 60.00th=[11731], 00:29:16.945 | 70.00th=[12125], 80.00th=[12518], 90.00th=[13173], 95.00th=[14222], 00:29:16.945 | 99.00th=[50594], 99.50th=[52167], 99.90th=[52691], 99.95th=[53740], 00:29:16.945 | 99.99th=[53740] 00:29:16.945 bw ( KiB/s): min=19968, max=35840, per=36.22%, avg=32179.20, stdev=4494.48, samples=10 00:29:16.945 iops : min= 156, max= 280, avg=251.40, stdev=35.11, samples=10 00:29:16.945 lat (msec) : 10=14.14%, 20=84.27%, 50=0.40%, 100=1.19% 00:29:16.945 cpu : usr=93.66%, sys=5.85%, ctx=7, majf=0, minf=157 00:29:16.945 IO depths : 1=1.2%, 2=98.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:16.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:16.945 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:16.945 issued rwts: total=1259,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:16.945 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:16.945 filename0: (groupid=0, jobs=1): err= 0: pid=3579418: Tue Nov 19 02:05:05 2024 00:29:16.945 read: IOPS=232, BW=29.1MiB/s (30.5MB/s)(146MiB/5006msec) 00:29:16.945 slat (nsec): min=7320, max=40714, avg=16690.65, stdev=4546.93 00:29:16.945 clat (usec): min=4951, max=52120, avg=12856.45, stdev=3895.67 00:29:16.945 lat (usec): min=4963, max=52151, avg=12873.14, stdev=3896.33 00:29:16.945 clat percentiles (usec): 00:29:16.945 | 1.00th=[ 6783], 5.00th=[ 8848], 10.00th=[10159], 20.00th=[11076], 00:29:16.945 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12518], 60.00th=[13042], 00:29:16.945 | 70.00th=[13698], 80.00th=[14615], 90.00th=[15270], 95.00th=[16057], 00:29:16.945 | 99.00th=[17171], 99.50th=[50594], 99.90th=[51643], 99.95th=[52167], 00:29:16.945 | 99.99th=[52167] 00:29:16.945 bw ( KiB/s): min=26880, max=32064, per=33.52%, avg=29779.20, stdev=1418.96, samples=10 00:29:16.945 iops : min= 210, max= 250, avg=232.60, stdev=11.00, samples=10 00:29:16.945 lat (msec) : 10=9.09%, 20=90.14%, 50=0.26%, 100=0.51% 00:29:16.945 cpu : usr=94.41%, sys=5.05%, ctx=16, majf=0, minf=126 00:29:16.946 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:16.946 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:16.946 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:16.946 issued rwts: total=1166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:16.946 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:16.946 00:29:16.946 Run status group 0 (all jobs): 00:29:16.946 READ: bw=86.8MiB/s (91.0MB/s), 26.9MiB/s-31.2MiB/s (28.2MB/s-32.7MB/s), io=438MiB (459MB), run=5006-5047msec 00:29:16.946 02:05:05 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:16.946 02:05:05 -- target/dif.sh@43 -- # local sub 00:29:16.946 02:05:05 -- target/dif.sh@45 -- # for sub in "$@" 00:29:16.946 02:05:05 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:16.946 02:05:05 -- target/dif.sh@36 -- # local sub_id=0 00:29:16.946 02:05:05 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:16.946 02:05:05 -- target/dif.sh@109 -- # bs=4k 00:29:16.946 02:05:05 -- target/dif.sh@109 -- # numjobs=8 00:29:16.946 02:05:05 -- target/dif.sh@109 -- # iodepth=16 00:29:16.946 02:05:05 -- target/dif.sh@109 -- # runtime= 00:29:16.946 02:05:05 -- target/dif.sh@109 -- # files=2 00:29:16.946 02:05:05 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:16.946 02:05:05 -- target/dif.sh@28 -- # local sub 00:29:16.946 02:05:05 -- target/dif.sh@30 -- # for sub in "$@" 00:29:16.946 02:05:05 -- target/dif.sh@31 -- # create_subsystem 0 00:29:16.946 02:05:05 -- target/dif.sh@18 -- # local sub_id=0 00:29:16.946 02:05:05 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 bdev_null0 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 [2024-11-19 02:05:05.406345] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@30 -- # for sub in "$@" 00:29:16.946 02:05:05 -- target/dif.sh@31 -- # create_subsystem 1 00:29:16.946 02:05:05 -- target/dif.sh@18 -- # local sub_id=1 00:29:16.946 02:05:05 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 bdev_null1 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@30 -- # for sub in "$@" 00:29:16.946 02:05:05 -- target/dif.sh@31 -- # create_subsystem 2 00:29:16.946 02:05:05 -- target/dif.sh@18 -- # local sub_id=2 00:29:16.946 02:05:05 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 bdev_null2 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:16.946 02:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.946 02:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:16.946 02:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.946 02:05:05 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:16.946 02:05:05 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:16.946 02:05:05 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:16.946 02:05:05 -- nvmf/common.sh@520 -- # config=() 00:29:16.946 02:05:05 -- nvmf/common.sh@520 -- # local subsystem config 00:29:16.946 02:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:16.946 02:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:16.946 { 00:29:16.946 "params": { 00:29:16.946 "name": "Nvme$subsystem", 00:29:16.946 "trtype": "$TEST_TRANSPORT", 00:29:16.946 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:16.946 "adrfam": "ipv4", 00:29:16.946 "trsvcid": "$NVMF_PORT", 00:29:16.946 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:16.946 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:16.946 "hdgst": ${hdgst:-false}, 00:29:16.946 "ddgst": ${ddgst:-false} 00:29:16.946 }, 00:29:16.946 "method": "bdev_nvme_attach_controller" 00:29:16.946 } 00:29:16.946 EOF 00:29:16.946 )") 00:29:16.946 02:05:05 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:16.946 02:05:05 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:16.946 02:05:05 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:16.946 02:05:05 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:16.946 02:05:05 -- target/dif.sh@82 -- # gen_fio_conf 00:29:16.946 02:05:05 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:16.946 02:05:05 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:16.946 02:05:05 -- target/dif.sh@54 -- # local file 00:29:16.946 02:05:05 -- common/autotest_common.sh@1330 -- # shift 00:29:16.946 02:05:05 -- target/dif.sh@56 -- # cat 00:29:16.946 02:05:05 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:16.946 02:05:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:16.946 02:05:05 -- nvmf/common.sh@542 -- # cat 00:29:16.946 02:05:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:16.946 02:05:05 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:16.946 02:05:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:16.946 02:05:05 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:16.946 02:05:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:16.946 02:05:05 -- target/dif.sh@73 -- # cat 00:29:16.946 02:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:16.946 02:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:16.946 { 00:29:16.946 "params": { 00:29:16.946 "name": "Nvme$subsystem", 00:29:16.946 "trtype": "$TEST_TRANSPORT", 00:29:16.946 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:16.946 "adrfam": "ipv4", 00:29:16.946 "trsvcid": "$NVMF_PORT", 00:29:16.946 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:16.946 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:16.946 "hdgst": ${hdgst:-false}, 00:29:16.946 "ddgst": ${ddgst:-false} 00:29:16.946 }, 00:29:16.946 "method": "bdev_nvme_attach_controller" 00:29:16.946 } 00:29:16.946 EOF 00:29:16.946 )") 00:29:16.946 02:05:05 -- nvmf/common.sh@542 -- # cat 00:29:16.946 02:05:05 -- target/dif.sh@72 -- # (( file++ )) 00:29:16.946 02:05:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:16.946 02:05:05 -- target/dif.sh@73 -- # cat 00:29:16.946 02:05:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:16.946 02:05:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:16.946 { 00:29:16.946 "params": { 00:29:16.946 "name": "Nvme$subsystem", 00:29:16.946 "trtype": "$TEST_TRANSPORT", 00:29:16.946 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:16.946 "adrfam": "ipv4", 00:29:16.946 "trsvcid": "$NVMF_PORT", 00:29:16.946 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:16.946 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:16.946 "hdgst": ${hdgst:-false}, 00:29:16.947 "ddgst": ${ddgst:-false} 00:29:16.947 }, 00:29:16.947 "method": "bdev_nvme_attach_controller" 00:29:16.947 } 00:29:16.947 EOF 00:29:16.947 )") 00:29:16.947 02:05:05 -- target/dif.sh@72 -- # (( file++ )) 00:29:16.947 02:05:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:16.947 02:05:05 -- nvmf/common.sh@542 -- # cat 00:29:16.947 02:05:05 -- nvmf/common.sh@544 -- # jq . 00:29:16.947 02:05:05 -- nvmf/common.sh@545 -- # IFS=, 00:29:16.947 02:05:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:16.947 "params": { 00:29:16.947 "name": "Nvme0", 00:29:16.947 "trtype": "tcp", 00:29:16.947 "traddr": "10.0.0.2", 00:29:16.947 "adrfam": "ipv4", 00:29:16.947 "trsvcid": "4420", 00:29:16.947 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:16.947 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:16.947 "hdgst": false, 00:29:16.947 "ddgst": false 00:29:16.947 }, 00:29:16.947 "method": "bdev_nvme_attach_controller" 00:29:16.947 },{ 00:29:16.947 "params": { 00:29:16.947 "name": "Nvme1", 00:29:16.947 "trtype": "tcp", 00:29:16.947 "traddr": "10.0.0.2", 00:29:16.947 "adrfam": "ipv4", 00:29:16.947 "trsvcid": "4420", 00:29:16.947 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:16.947 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:16.947 "hdgst": false, 00:29:16.947 "ddgst": false 00:29:16.947 }, 00:29:16.947 "method": "bdev_nvme_attach_controller" 00:29:16.947 },{ 00:29:16.947 "params": { 00:29:16.947 "name": "Nvme2", 00:29:16.947 "trtype": "tcp", 00:29:16.947 "traddr": "10.0.0.2", 00:29:16.947 "adrfam": "ipv4", 00:29:16.947 "trsvcid": "4420", 00:29:16.947 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:16.947 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:16.947 "hdgst": false, 00:29:16.947 "ddgst": false 00:29:16.947 }, 00:29:16.947 "method": "bdev_nvme_attach_controller" 00:29:16.947 }' 00:29:17.205 02:05:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:17.205 02:05:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:17.205 02:05:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:17.205 02:05:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:17.205 02:05:05 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:17.205 02:05:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:17.205 02:05:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:17.205 02:05:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:17.205 02:05:05 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:17.205 02:05:05 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:17.205 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:17.205 ... 00:29:17.205 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:17.205 ... 00:29:17.205 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:17.205 ... 00:29:17.205 fio-3.35 00:29:17.205 Starting 24 threads 00:29:17.463 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.397 [2024-11-19 02:05:06.637745] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:18.397 [2024-11-19 02:05:06.637811] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:28.373 00:29:28.373 filename0: (groupid=0, jobs=1): err= 0: pid=3580328: Tue Nov 19 02:05:16 2024 00:29:28.373 read: IOPS=501, BW=2008KiB/s (2056kB/s)(19.6MiB/10009msec) 00:29:28.373 slat (usec): min=4, max=190, avg=24.78, stdev=15.91 00:29:28.373 clat (usec): min=24626, max=40947, avg=31652.84, stdev=1123.75 00:29:28.373 lat (usec): min=24631, max=40966, avg=31677.62, stdev=1126.38 00:29:28.373 clat percentiles (usec): 00:29:28.373 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:28.373 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:28.373 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32375], 95.00th=[32900], 00:29:28.373 | 99.00th=[36963], 99.50th=[38536], 99.90th=[40633], 99.95th=[41157], 00:29:28.373 | 99.99th=[41157] 00:29:28.373 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2003.20, stdev=62.64, samples=20 00:29:28.373 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:28.373 lat (msec) : 50=100.00% 00:29:28.373 cpu : usr=98.55%, sys=1.05%, ctx=15, majf=0, minf=98 00:29:28.373 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.373 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.373 filename0: (groupid=0, jobs=1): err= 0: pid=3580329: Tue Nov 19 02:05:16 2024 00:29:28.373 read: IOPS=508, BW=2032KiB/s (2081kB/s)(19.9MiB/10015msec) 00:29:28.373 slat (nsec): min=4064, max=89506, avg=21555.71, stdev=13068.62 00:29:28.373 clat (usec): min=4217, max=41028, avg=31315.97, stdev=3257.32 00:29:28.373 lat (usec): min=4227, max=41046, avg=31337.53, stdev=3257.96 00:29:28.373 clat percentiles (usec): 00:29:28.373 | 1.00th=[ 6259], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:28.373 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:28.373 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32900], 00:29:28.373 | 99.00th=[36963], 99.50th=[39584], 99.90th=[41157], 99.95th=[41157], 00:29:28.373 | 99.99th=[41157] 00:29:28.373 bw ( KiB/s): min= 1920, max= 2432, per=4.21%, avg=2028.80, stdev=112.01, samples=20 00:29:28.373 iops : min= 480, max= 608, avg=507.20, stdev=28.00, samples=20 00:29:28.373 lat (msec) : 10=1.22%, 20=0.35%, 50=98.43% 00:29:28.373 cpu : usr=97.36%, sys=1.65%, ctx=126, majf=0, minf=111 00:29:28.373 IO depths : 1=5.1%, 2=11.3%, 4=24.6%, 8=51.5%, 16=7.4%, 32=0.0%, >=64=0.0% 00:29:28.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.373 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.373 filename0: (groupid=0, jobs=1): err= 0: pid=3580330: Tue Nov 19 02:05:16 2024 00:29:28.373 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10015msec) 00:29:28.373 slat (usec): min=6, max=127, avg=49.11, stdev=18.09 00:29:28.373 clat (usec): min=22056, max=47780, avg=31479.75, stdev=1481.65 00:29:28.373 lat (usec): min=22102, max=47792, avg=31528.85, stdev=1480.49 00:29:28.373 clat percentiles (usec): 00:29:28.373 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:28.373 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:29:28.373 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:29:28.373 | 99.00th=[37487], 99.50th=[40633], 99.90th=[47973], 99.95th=[47973], 00:29:28.373 | 99.99th=[47973] 00:29:28.373 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2003.20, stdev=75.15, samples=20 00:29:28.373 iops : min= 448, max= 512, avg=500.80, stdev=18.79, samples=20 00:29:28.373 lat (msec) : 50=100.00% 00:29:28.373 cpu : usr=95.83%, sys=2.60%, ctx=541, majf=0, minf=61 00:29:28.373 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.373 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.373 filename0: (groupid=0, jobs=1): err= 0: pid=3580331: Tue Nov 19 02:05:16 2024 00:29:28.373 read: IOPS=499, BW=1996KiB/s (2044kB/s)(19.5MiB/10011msec) 00:29:28.373 slat (usec): min=5, max=173, avg=45.27, stdev=22.78 00:29:28.373 clat (usec): min=20934, max=78633, avg=31665.80, stdev=3142.69 00:29:28.373 lat (usec): min=20943, max=78649, avg=31711.07, stdev=3140.61 00:29:28.373 clat percentiles (usec): 00:29:28.373 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:29:28.373 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:29:28.373 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33162], 00:29:28.373 | 99.00th=[39584], 99.50th=[56886], 99.90th=[78119], 99.95th=[78119], 00:29:28.373 | 99.99th=[78119] 00:29:28.373 bw ( KiB/s): min= 1664, max= 2048, per=4.13%, avg=1989.05, stdev=96.60, samples=19 00:29:28.373 iops : min= 416, max= 512, avg=497.26, stdev=24.15, samples=19 00:29:28.373 lat (msec) : 50=99.44%, 100=0.56% 00:29:28.373 cpu : usr=98.15%, sys=1.27%, ctx=74, majf=0, minf=76 00:29:28.373 IO depths : 1=5.1%, 2=11.2%, 4=24.7%, 8=51.6%, 16=7.4%, 32=0.0%, >=64=0.0% 00:29:28.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 issued rwts: total=4996,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.373 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.373 filename0: (groupid=0, jobs=1): err= 0: pid=3580332: Tue Nov 19 02:05:16 2024 00:29:28.373 read: IOPS=501, BW=2006KiB/s (2055kB/s)(19.6MiB/10016msec) 00:29:28.373 slat (usec): min=6, max=157, avg=53.89, stdev=21.38 00:29:28.373 clat (usec): min=22125, max=47735, avg=31407.66, stdev=1496.59 00:29:28.373 lat (usec): min=22151, max=47748, avg=31461.55, stdev=1496.17 00:29:28.373 clat percentiles (usec): 00:29:28.373 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:28.373 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.373 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32900], 00:29:28.373 | 99.00th=[37487], 99.50th=[40633], 99.90th=[47449], 99.95th=[47973], 00:29:28.373 | 99.99th=[47973] 00:29:28.373 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2003.20, stdev=75.15, samples=20 00:29:28.373 iops : min= 448, max= 512, avg=500.80, stdev=18.79, samples=20 00:29:28.373 lat (msec) : 50=100.00% 00:29:28.373 cpu : usr=97.11%, sys=1.73%, ctx=445, majf=0, minf=83 00:29:28.373 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.373 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.373 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.373 filename0: (groupid=0, jobs=1): err= 0: pid=3580333: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10004msec) 00:29:28.374 slat (usec): min=6, max=225, avg=58.96, stdev=36.72 00:29:28.374 clat (usec): min=20971, max=40997, avg=31346.71, stdev=1296.01 00:29:28.374 lat (usec): min=20987, max=41089, avg=31405.67, stdev=1299.17 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.374 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.374 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:29:28.374 | 99.00th=[37487], 99.50th=[39584], 99.90th=[40633], 99.95th=[40633], 00:29:28.374 | 99.99th=[41157] 00:29:28.374 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2007.58, stdev=59.48, samples=19 00:29:28.374 iops : min= 480, max= 512, avg=501.89, stdev=14.87, samples=19 00:29:28.374 lat (msec) : 50=100.00% 00:29:28.374 cpu : usr=97.92%, sys=1.30%, ctx=83, majf=0, minf=75 00:29:28.374 IO depths : 1=3.5%, 2=9.8%, 4=25.0%, 8=52.7%, 16=9.0%, 32=0.0%, >=64=0.0% 00:29:28.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.374 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.374 filename0: (groupid=0, jobs=1): err= 0: pid=3580334: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=500, BW=2003KiB/s (2051kB/s)(19.6MiB/10001msec) 00:29:28.374 slat (usec): min=14, max=192, avg=52.05, stdev=21.43 00:29:28.374 clat (usec): min=22181, max=68378, avg=31462.89, stdev=2375.39 00:29:28.374 lat (usec): min=22210, max=68411, avg=31514.94, stdev=2375.26 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[30540], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:28.374 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.374 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.374 | 99.00th=[37487], 99.50th=[40633], 99.90th=[68682], 99.95th=[68682], 00:29:28.374 | 99.99th=[68682] 00:29:28.374 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:28.374 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:28.374 lat (msec) : 50=99.68%, 100=0.32% 00:29:28.374 cpu : usr=96.99%, sys=1.67%, ctx=428, majf=0, minf=76 00:29:28.374 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.374 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.374 filename0: (groupid=0, jobs=1): err= 0: pid=3580335: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10005msec) 00:29:28.374 slat (usec): min=9, max=176, avg=56.27, stdev=27.80 00:29:28.374 clat (usec): min=7281, max=65290, avg=31281.48, stdev=2598.29 00:29:28.374 lat (usec): min=7294, max=65322, avg=31337.75, stdev=2600.13 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.374 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.374 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.374 | 99.00th=[37487], 99.50th=[40633], 99.90th=[65274], 99.95th=[65274], 00:29:28.374 | 99.99th=[65274] 00:29:28.374 bw ( KiB/s): min= 1788, max= 2048, per=4.15%, avg=2000.63, stdev=77.06, samples=19 00:29:28.374 iops : min= 447, max= 512, avg=500.16, stdev=19.27, samples=19 00:29:28.374 lat (msec) : 10=0.32%, 50=99.36%, 100=0.32% 00:29:28.374 cpu : usr=98.70%, sys=0.89%, ctx=32, majf=0, minf=81 00:29:28.374 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.374 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.374 filename1: (groupid=0, jobs=1): err= 0: pid=3580336: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=502, BW=2009KiB/s (2058kB/s)(19.7MiB/10015msec) 00:29:28.374 slat (usec): min=9, max=214, avg=57.26, stdev=32.95 00:29:28.374 clat (usec): min=18915, max=47415, avg=31310.33, stdev=1581.67 00:29:28.374 lat (usec): min=18969, max=47430, avg=31367.59, stdev=1582.25 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.374 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.374 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.374 | 99.00th=[36963], 99.50th=[40633], 99.90th=[47449], 99.95th=[47449], 00:29:28.374 | 99.99th=[47449] 00:29:28.374 bw ( KiB/s): min= 1848, max= 2048, per=4.16%, avg=2006.00, stdev=67.53, samples=20 00:29:28.374 iops : min= 462, max= 512, avg=501.50, stdev=16.88, samples=20 00:29:28.374 lat (msec) : 20=0.26%, 50=99.74% 00:29:28.374 cpu : usr=98.60%, sys=0.98%, ctx=16, majf=0, minf=66 00:29:28.374 IO depths : 1=6.2%, 2=12.4%, 4=24.8%, 8=50.3%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 issued rwts: total=5031,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.374 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.374 filename1: (groupid=0, jobs=1): err= 0: pid=3580337: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10005msec) 00:29:28.374 slat (usec): min=6, max=179, avg=40.58, stdev=25.96 00:29:28.374 clat (usec): min=20322, max=41023, avg=31505.20, stdev=1267.29 00:29:28.374 lat (usec): min=20330, max=41042, avg=31545.78, stdev=1268.16 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:28.374 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:29:28.374 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32900], 00:29:28.374 | 99.00th=[38011], 99.50th=[38536], 99.90th=[41157], 99.95th=[41157], 00:29:28.374 | 99.99th=[41157] 00:29:28.374 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2007.74, stdev=60.89, samples=19 00:29:28.374 iops : min= 480, max= 512, avg=501.89, stdev=15.28, samples=19 00:29:28.374 lat (msec) : 50=100.00% 00:29:28.374 cpu : usr=97.01%, sys=1.84%, ctx=435, majf=0, minf=88 00:29:28.374 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.374 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.374 filename1: (groupid=0, jobs=1): err= 0: pid=3580338: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10005msec) 00:29:28.374 slat (usec): min=10, max=181, avg=49.06, stdev=19.29 00:29:28.374 clat (usec): min=22115, max=71593, avg=31514.67, stdev=2528.58 00:29:28.374 lat (usec): min=22147, max=71630, avg=31563.73, stdev=2528.47 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:28.374 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:29:28.374 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.374 | 99.00th=[37487], 99.50th=[40633], 99.90th=[71828], 99.95th=[71828], 00:29:28.374 | 99.99th=[71828] 00:29:28.374 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=1994.11, stdev=77.69, samples=19 00:29:28.374 iops : min= 448, max= 512, avg=498.53, stdev=19.42, samples=19 00:29:28.374 lat (msec) : 50=99.68%, 100=0.32% 00:29:28.374 cpu : usr=98.36%, sys=1.06%, ctx=21, majf=0, minf=75 00:29:28.374 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.374 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.374 filename1: (groupid=0, jobs=1): err= 0: pid=3580339: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10006msec) 00:29:28.374 slat (usec): min=11, max=226, avg=52.49, stdev=31.53 00:29:28.374 clat (usec): min=22258, max=73613, avg=31448.17, stdev=2639.79 00:29:28.374 lat (usec): min=22296, max=73631, avg=31500.66, stdev=2639.47 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.374 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.374 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.374 | 99.00th=[36963], 99.50th=[40633], 99.90th=[73925], 99.95th=[73925], 00:29:28.374 | 99.99th=[73925] 00:29:28.374 bw ( KiB/s): min= 1664, max= 2048, per=4.14%, avg=1994.11, stdev=98.37, samples=19 00:29:28.374 iops : min= 416, max= 512, avg=498.53, stdev=24.59, samples=19 00:29:28.374 lat (msec) : 50=99.68%, 100=0.32% 00:29:28.374 cpu : usr=96.99%, sys=1.86%, ctx=189, majf=0, minf=75 00:29:28.374 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.374 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.374 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.374 filename1: (groupid=0, jobs=1): err= 0: pid=3580340: Tue Nov 19 02:05:16 2024 00:29:28.374 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10003msec) 00:29:28.374 slat (usec): min=5, max=116, avg=17.66, stdev=11.41 00:29:28.374 clat (usec): min=25782, max=40979, avg=31693.22, stdev=1145.82 00:29:28.374 lat (usec): min=25788, max=41001, avg=31710.88, stdev=1147.89 00:29:28.374 clat percentiles (usec): 00:29:28.374 | 1.00th=[28967], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:28.374 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:28.374 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32900], 00:29:28.374 | 99.00th=[36963], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:29:28.374 | 99.99th=[41157] 00:29:28.375 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2007.58, stdev=61.13, samples=19 00:29:28.375 iops : min= 480, max= 512, avg=501.89, stdev=15.28, samples=19 00:29:28.375 lat (msec) : 50=100.00% 00:29:28.375 cpu : usr=97.59%, sys=1.59%, ctx=121, majf=0, minf=109 00:29:28.375 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename1: (groupid=0, jobs=1): err= 0: pid=3580341: Tue Nov 19 02:05:16 2024 00:29:28.375 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10004msec) 00:29:28.375 slat (usec): min=12, max=134, avg=56.32, stdev=20.96 00:29:28.375 clat (usec): min=7338, max=68380, avg=31335.64, stdev=2576.94 00:29:28.375 lat (usec): min=7376, max=68425, avg=31391.96, stdev=2577.12 00:29:28.375 clat percentiles (usec): 00:29:28.375 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.375 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.375 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.375 | 99.00th=[37487], 99.50th=[40633], 99.90th=[64226], 99.95th=[64226], 00:29:28.375 | 99.99th=[68682] 00:29:28.375 bw ( KiB/s): min= 1795, max= 2048, per=4.15%, avg=2001.00, stdev=76.00, samples=19 00:29:28.375 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:28.375 lat (msec) : 10=0.32%, 50=99.36%, 100=0.32% 00:29:28.375 cpu : usr=98.67%, sys=0.92%, ctx=16, majf=0, minf=67 00:29:28.375 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename1: (groupid=0, jobs=1): err= 0: pid=3580342: Tue Nov 19 02:05:16 2024 00:29:28.375 read: IOPS=505, BW=2020KiB/s (2069kB/s)(19.8MiB/10010msec) 00:29:28.375 slat (usec): min=6, max=169, avg=44.66, stdev=26.77 00:29:28.375 clat (usec): min=4445, max=40953, avg=31315.39, stdev=2418.52 00:29:28.375 lat (usec): min=4453, max=40975, avg=31360.05, stdev=2420.22 00:29:28.375 clat percentiles (usec): 00:29:28.375 | 1.00th=[28967], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:29:28.375 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:29:28.375 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33162], 00:29:28.375 | 99.00th=[36439], 99.50th=[39584], 99.90th=[40633], 99.95th=[41157], 00:29:28.375 | 99.99th=[41157] 00:29:28.375 bw ( KiB/s): min= 1920, max= 2176, per=4.19%, avg=2016.00, stdev=70.42, samples=20 00:29:28.375 iops : min= 480, max= 544, avg=504.00, stdev=17.60, samples=20 00:29:28.375 lat (msec) : 10=0.63%, 20=0.32%, 50=99.05% 00:29:28.375 cpu : usr=98.25%, sys=1.28%, ctx=32, majf=0, minf=68 00:29:28.375 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename1: (groupid=0, jobs=1): err= 0: pid=3580343: Tue Nov 19 02:05:16 2024 00:29:28.375 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10004msec) 00:29:28.375 slat (usec): min=8, max=173, avg=53.37, stdev=20.25 00:29:28.375 clat (usec): min=7032, max=64578, avg=31354.46, stdev=2577.29 00:29:28.375 lat (usec): min=7066, max=64618, avg=31407.82, stdev=2578.28 00:29:28.375 clat percentiles (usec): 00:29:28.375 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.375 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:29:28.375 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.375 | 99.00th=[37487], 99.50th=[40633], 99.90th=[64226], 99.95th=[64750], 00:29:28.375 | 99.99th=[64750] 00:29:28.375 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:28.375 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:28.375 lat (msec) : 10=0.32%, 50=99.36%, 100=0.32% 00:29:28.375 cpu : usr=98.45%, sys=1.14%, ctx=32, majf=0, minf=64 00:29:28.375 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename2: (groupid=0, jobs=1): err= 0: pid=3580344: Tue Nov 19 02:05:16 2024 00:29:28.375 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10005msec) 00:29:28.375 slat (usec): min=8, max=232, avg=59.61, stdev=36.16 00:29:28.375 clat (usec): min=21198, max=72875, avg=31358.61, stdev=2551.50 00:29:28.375 lat (usec): min=21206, max=72912, avg=31418.22, stdev=2552.21 00:29:28.375 clat percentiles (usec): 00:29:28.375 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.375 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:29:28.375 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32637], 00:29:28.375 | 99.00th=[37487], 99.50th=[40633], 99.90th=[71828], 99.95th=[71828], 00:29:28.375 | 99.99th=[72877] 00:29:28.375 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=1994.11, stdev=77.69, samples=19 00:29:28.375 iops : min= 448, max= 512, avg=498.53, stdev=19.42, samples=19 00:29:28.375 lat (msec) : 50=99.68%, 100=0.32% 00:29:28.375 cpu : usr=98.65%, sys=0.90%, ctx=16, majf=0, minf=65 00:29:28.375 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename2: (groupid=0, jobs=1): err= 0: pid=3580345: Tue Nov 19 02:05:16 2024 00:29:28.375 read: IOPS=505, BW=2021KiB/s (2069kB/s)(19.8MiB/10009msec) 00:29:28.375 slat (usec): min=6, max=174, avg=47.02, stdev=28.55 00:29:28.375 clat (usec): min=6266, max=41019, avg=31255.98, stdev=2411.72 00:29:28.375 lat (usec): min=6275, max=41037, avg=31303.00, stdev=2414.31 00:29:28.375 clat percentiles (usec): 00:29:28.375 | 1.00th=[29230], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:29:28.375 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:29:28.375 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32900], 00:29:28.375 | 99.00th=[36439], 99.50th=[39584], 99.90th=[41157], 99.95th=[41157], 00:29:28.375 | 99.99th=[41157] 00:29:28.375 bw ( KiB/s): min= 1920, max= 2176, per=4.19%, avg=2016.00, stdev=70.42, samples=20 00:29:28.375 iops : min= 480, max= 544, avg=504.00, stdev=17.60, samples=20 00:29:28.375 lat (msec) : 10=0.63%, 20=0.32%, 50=99.05% 00:29:28.375 cpu : usr=97.26%, sys=1.67%, ctx=253, majf=0, minf=89 00:29:28.375 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename2: (groupid=0, jobs=1): err= 0: pid=3580346: Tue Nov 19 02:05:16 2024 00:29:28.375 read: IOPS=502, BW=2008KiB/s (2057kB/s)(19.6MiB/10006msec) 00:29:28.375 slat (usec): min=3, max=180, avg=41.36, stdev=22.02 00:29:28.375 clat (usec): min=23176, max=40999, avg=31534.81, stdev=1193.97 00:29:28.375 lat (usec): min=23180, max=41038, avg=31576.17, stdev=1193.82 00:29:28.375 clat percentiles (usec): 00:29:28.375 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:28.375 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:28.375 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32900], 00:29:28.375 | 99.00th=[37487], 99.50th=[39584], 99.90th=[40633], 99.95th=[41157], 00:29:28.375 | 99.99th=[41157] 00:29:28.375 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2007.74, stdev=60.89, samples=19 00:29:28.375 iops : min= 480, max= 512, avg=501.89, stdev=15.28, samples=19 00:29:28.375 lat (msec) : 50=100.00% 00:29:28.375 cpu : usr=97.90%, sys=1.59%, ctx=27, majf=0, minf=61 00:29:28.375 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename2: (groupid=0, jobs=1): err= 0: pid=3580347: Tue Nov 19 02:05:16 2024 00:29:28.375 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10004msec) 00:29:28.375 slat (usec): min=8, max=119, avg=46.30, stdev=21.80 00:29:28.375 clat (usec): min=7212, max=68502, avg=31430.51, stdev=2838.56 00:29:28.375 lat (usec): min=7232, max=68536, avg=31476.81, stdev=2839.12 00:29:28.375 clat percentiles (usec): 00:29:28.375 | 1.00th=[26608], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:29:28.375 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:29:28.375 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[33424], 00:29:28.375 | 99.00th=[39584], 99.50th=[48497], 99.90th=[64226], 99.95th=[64226], 00:29:28.375 | 99.99th=[68682] 00:29:28.375 bw ( KiB/s): min= 1760, max= 2048, per=4.15%, avg=1999.16, stdev=81.49, samples=19 00:29:28.375 iops : min= 440, max= 512, avg=499.79, stdev=20.37, samples=19 00:29:28.375 lat (msec) : 10=0.32%, 20=0.06%, 50=99.30%, 100=0.32% 00:29:28.375 cpu : usr=98.23%, sys=1.14%, ctx=99, majf=0, minf=81 00:29:28.375 IO depths : 1=5.5%, 2=11.1%, 4=24.1%, 8=52.2%, 16=7.2%, 32=0.0%, >=64=0.0% 00:29:28.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 complete : 0=0.0%, 4=93.9%, 8=0.4%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.375 issued rwts: total=5020,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.375 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.375 filename2: (groupid=0, jobs=1): err= 0: pid=3580348: Tue Nov 19 02:05:16 2024 00:29:28.376 read: IOPS=501, BW=2005KiB/s (2053kB/s)(19.6MiB/10005msec) 00:29:28.376 slat (usec): min=5, max=205, avg=30.75, stdev=21.84 00:29:28.376 clat (usec): min=8851, max=71781, avg=31639.90, stdev=2930.41 00:29:28.376 lat (usec): min=8863, max=71796, avg=31670.65, stdev=2929.18 00:29:28.376 clat percentiles (usec): 00:29:28.376 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:29:28.376 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:28.376 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32900], 00:29:28.376 | 99.00th=[39584], 99.50th=[41157], 99.90th=[71828], 99.95th=[71828], 00:29:28.376 | 99.99th=[71828] 00:29:28.376 bw ( KiB/s): min= 1795, max= 2048, per=4.14%, avg=1996.79, stdev=73.36, samples=19 00:29:28.376 iops : min= 448, max= 512, avg=499.16, stdev=18.45, samples=19 00:29:28.376 lat (msec) : 10=0.14%, 20=0.14%, 50=99.24%, 100=0.48% 00:29:28.376 cpu : usr=98.41%, sys=1.11%, ctx=71, majf=0, minf=74 00:29:28.376 IO depths : 1=3.4%, 2=9.6%, 4=24.6%, 8=53.3%, 16=9.1%, 32=0.0%, >=64=0.0% 00:29:28.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 issued rwts: total=5014,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.376 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.376 filename2: (groupid=0, jobs=1): err= 0: pid=3580349: Tue Nov 19 02:05:16 2024 00:29:28.376 read: IOPS=501, BW=2006KiB/s (2054kB/s)(19.6MiB/10015msec) 00:29:28.376 slat (usec): min=8, max=179, avg=41.03, stdev=26.04 00:29:28.376 clat (usec): min=9946, max=56381, avg=31537.07, stdev=1703.68 00:29:28.376 lat (usec): min=10080, max=56396, avg=31578.10, stdev=1704.14 00:29:28.376 clat percentiles (usec): 00:29:28.376 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:28.376 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:29:28.376 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32900], 00:29:28.376 | 99.00th=[38536], 99.50th=[40633], 99.90th=[48497], 99.95th=[54264], 00:29:28.376 | 99.99th=[56361] 00:29:28.376 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2002.40, stdev=74.74, samples=20 00:29:28.376 iops : min= 448, max= 512, avg=500.60, stdev=18.68, samples=20 00:29:28.376 lat (msec) : 10=0.02%, 20=0.02%, 50=99.88%, 100=0.08% 00:29:28.376 cpu : usr=98.21%, sys=1.23%, ctx=76, majf=0, minf=64 00:29:28.376 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:28.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 issued rwts: total=5022,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.376 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.376 filename2: (groupid=0, jobs=1): err= 0: pid=3580350: Tue Nov 19 02:05:16 2024 00:29:28.376 read: IOPS=501, BW=2007KiB/s (2056kB/s)(19.6MiB/10011msec) 00:29:28.376 slat (usec): min=7, max=129, avg=17.49, stdev=10.22 00:29:28.376 clat (usec): min=19038, max=47410, avg=31718.53, stdev=1484.74 00:29:28.376 lat (usec): min=19054, max=47440, avg=31736.02, stdev=1486.72 00:29:28.376 clat percentiles (usec): 00:29:28.376 | 1.00th=[28705], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:28.376 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:28.376 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32900], 00:29:28.376 | 99.00th=[36439], 99.50th=[40633], 99.90th=[47449], 99.95th=[47449], 00:29:28.376 | 99.99th=[47449] 00:29:28.376 bw ( KiB/s): min= 1792, max= 2176, per=4.16%, avg=2003.20, stdev=85.87, samples=20 00:29:28.376 iops : min= 448, max= 544, avg=500.80, stdev=21.47, samples=20 00:29:28.376 lat (msec) : 20=0.04%, 50=99.96% 00:29:28.376 cpu : usr=97.69%, sys=1.42%, ctx=284, majf=0, minf=78 00:29:28.376 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:28.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.376 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.376 filename2: (groupid=0, jobs=1): err= 0: pid=3580351: Tue Nov 19 02:05:16 2024 00:29:28.376 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10004msec) 00:29:28.376 slat (usec): min=15, max=131, avg=46.48, stdev=15.27 00:29:28.376 clat (usec): min=7402, max=64201, avg=31437.96, stdev=2543.81 00:29:28.376 lat (usec): min=7426, max=64255, avg=31484.44, stdev=2544.43 00:29:28.376 clat percentiles (usec): 00:29:28.376 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[30802], 00:29:28.376 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:29:28.376 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:29:28.376 | 99.00th=[37487], 99.50th=[40633], 99.90th=[64226], 99.95th=[64226], 00:29:28.376 | 99.99th=[64226] 00:29:28.376 bw ( KiB/s): min= 1795, max= 2048, per=4.15%, avg=2001.00, stdev=76.00, samples=19 00:29:28.376 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:28.376 lat (msec) : 10=0.32%, 50=99.36%, 100=0.32% 00:29:28.376 cpu : usr=97.95%, sys=1.30%, ctx=45, majf=0, minf=66 00:29:28.376 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:28.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.376 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.376 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.376 00:29:28.376 Run status group 0 (all jobs): 00:29:28.376 READ: bw=47.0MiB/s (49.3MB/s), 1996KiB/s-2032KiB/s (2044kB/s-2081kB/s), io=471MiB (494MB), run=10001-10016msec 00:29:28.634 02:05:17 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:28.634 02:05:17 -- target/dif.sh@43 -- # local sub 00:29:28.634 02:05:17 -- target/dif.sh@45 -- # for sub in "$@" 00:29:28.634 02:05:17 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:28.634 02:05:17 -- target/dif.sh@36 -- # local sub_id=0 00:29:28.634 02:05:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:28.635 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.635 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.635 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.635 02:05:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:28.635 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.635 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.635 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.635 02:05:17 -- target/dif.sh@45 -- # for sub in "$@" 00:29:28.635 02:05:17 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:28.635 02:05:17 -- target/dif.sh@36 -- # local sub_id=1 00:29:28.635 02:05:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:28.635 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.635 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.635 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.635 02:05:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:28.635 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.635 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.635 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.635 02:05:17 -- target/dif.sh@45 -- # for sub in "$@" 00:29:28.635 02:05:17 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:28.635 02:05:17 -- target/dif.sh@36 -- # local sub_id=2 00:29:28.635 02:05:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:28.635 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.635 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.635 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.635 02:05:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:28.635 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.635 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:28.894 02:05:17 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:28.894 02:05:17 -- target/dif.sh@115 -- # numjobs=2 00:29:28.894 02:05:17 -- target/dif.sh@115 -- # iodepth=8 00:29:28.894 02:05:17 -- target/dif.sh@115 -- # runtime=5 00:29:28.894 02:05:17 -- target/dif.sh@115 -- # files=1 00:29:28.894 02:05:17 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:28.894 02:05:17 -- target/dif.sh@28 -- # local sub 00:29:28.894 02:05:17 -- target/dif.sh@30 -- # for sub in "$@" 00:29:28.894 02:05:17 -- target/dif.sh@31 -- # create_subsystem 0 00:29:28.894 02:05:17 -- target/dif.sh@18 -- # local sub_id=0 00:29:28.894 02:05:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 bdev_null0 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 [2024-11-19 02:05:17.216645] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@30 -- # for sub in "$@" 00:29:28.894 02:05:17 -- target/dif.sh@31 -- # create_subsystem 1 00:29:28.894 02:05:17 -- target/dif.sh@18 -- # local sub_id=1 00:29:28.894 02:05:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 bdev_null1 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:28.894 02:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.894 02:05:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.894 02:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.894 02:05:17 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:28.894 02:05:17 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:28.894 02:05:17 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:28.894 02:05:17 -- nvmf/common.sh@520 -- # config=() 00:29:28.894 02:05:17 -- nvmf/common.sh@520 -- # local subsystem config 00:29:28.894 02:05:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:28.894 02:05:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:28.894 { 00:29:28.894 "params": { 00:29:28.894 "name": "Nvme$subsystem", 00:29:28.894 "trtype": "$TEST_TRANSPORT", 00:29:28.894 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:28.894 "adrfam": "ipv4", 00:29:28.894 "trsvcid": "$NVMF_PORT", 00:29:28.894 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:28.894 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:28.894 "hdgst": ${hdgst:-false}, 00:29:28.894 "ddgst": ${ddgst:-false} 00:29:28.894 }, 00:29:28.894 "method": "bdev_nvme_attach_controller" 00:29:28.894 } 00:29:28.894 EOF 00:29:28.894 )") 00:29:28.894 02:05:17 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:28.894 02:05:17 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:28.894 02:05:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:28.894 02:05:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:28.894 02:05:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:28.894 02:05:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:28.894 02:05:17 -- target/dif.sh@82 -- # gen_fio_conf 00:29:28.894 02:05:17 -- common/autotest_common.sh@1330 -- # shift 00:29:28.894 02:05:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:28.894 02:05:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:28.894 02:05:17 -- target/dif.sh@54 -- # local file 00:29:28.894 02:05:17 -- target/dif.sh@56 -- # cat 00:29:28.894 02:05:17 -- nvmf/common.sh@542 -- # cat 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:28.894 02:05:17 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:28.894 02:05:17 -- target/dif.sh@72 -- # (( file <= files )) 00:29:28.894 02:05:17 -- target/dif.sh@73 -- # cat 00:29:28.894 02:05:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:28.894 02:05:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:28.894 { 00:29:28.894 "params": { 00:29:28.894 "name": "Nvme$subsystem", 00:29:28.894 "trtype": "$TEST_TRANSPORT", 00:29:28.894 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:28.894 "adrfam": "ipv4", 00:29:28.894 "trsvcid": "$NVMF_PORT", 00:29:28.894 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:28.894 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:28.894 "hdgst": ${hdgst:-false}, 00:29:28.894 "ddgst": ${ddgst:-false} 00:29:28.894 }, 00:29:28.894 "method": "bdev_nvme_attach_controller" 00:29:28.894 } 00:29:28.894 EOF 00:29:28.894 )") 00:29:28.894 02:05:17 -- nvmf/common.sh@542 -- # cat 00:29:28.894 02:05:17 -- target/dif.sh@72 -- # (( file++ )) 00:29:28.894 02:05:17 -- target/dif.sh@72 -- # (( file <= files )) 00:29:28.894 02:05:17 -- nvmf/common.sh@544 -- # jq . 00:29:28.894 02:05:17 -- nvmf/common.sh@545 -- # IFS=, 00:29:28.894 02:05:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:28.894 "params": { 00:29:28.894 "name": "Nvme0", 00:29:28.894 "trtype": "tcp", 00:29:28.894 "traddr": "10.0.0.2", 00:29:28.894 "adrfam": "ipv4", 00:29:28.894 "trsvcid": "4420", 00:29:28.894 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:28.894 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:28.894 "hdgst": false, 00:29:28.894 "ddgst": false 00:29:28.894 }, 00:29:28.894 "method": "bdev_nvme_attach_controller" 00:29:28.894 },{ 00:29:28.894 "params": { 00:29:28.894 "name": "Nvme1", 00:29:28.894 "trtype": "tcp", 00:29:28.894 "traddr": "10.0.0.2", 00:29:28.894 "adrfam": "ipv4", 00:29:28.894 "trsvcid": "4420", 00:29:28.894 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:28.894 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:28.894 "hdgst": false, 00:29:28.894 "ddgst": false 00:29:28.894 }, 00:29:28.894 "method": "bdev_nvme_attach_controller" 00:29:28.894 }' 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:28.894 02:05:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:28.894 02:05:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:28.894 02:05:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:28.894 02:05:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:28.894 02:05:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:28.894 02:05:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:29.153 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:29.153 ... 00:29:29.153 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:29.153 ... 00:29:29.153 fio-3.35 00:29:29.153 Starting 4 threads 00:29:29.153 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.719 [2024-11-19 02:05:18.054354] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:29.719 [2024-11-19 02:05:18.054421] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:34.981 00:29:34.981 filename0: (groupid=0, jobs=1): err= 0: pid=3581651: Tue Nov 19 02:05:23 2024 00:29:34.981 read: IOPS=1841, BW=14.4MiB/s (15.1MB/s)(72.0MiB/5002msec) 00:29:34.981 slat (nsec): min=3992, max=73193, avg=18732.13, stdev=10869.12 00:29:34.981 clat (usec): min=622, max=7723, avg=4275.05, stdev=631.82 00:29:34.981 lat (usec): min=635, max=7737, avg=4293.78, stdev=631.07 00:29:34.981 clat percentiles (usec): 00:29:34.981 | 1.00th=[ 2212], 5.00th=[ 3654], 10.00th=[ 3851], 20.00th=[ 3982], 00:29:34.981 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4293], 00:29:34.981 | 70.00th=[ 4359], 80.00th=[ 4490], 90.00th=[ 4883], 95.00th=[ 5342], 00:29:34.981 | 99.00th=[ 6718], 99.50th=[ 7111], 99.90th=[ 7570], 99.95th=[ 7635], 00:29:34.981 | 99.99th=[ 7701] 00:29:34.981 bw ( KiB/s): min=14144, max=15520, per=24.57%, avg=14750.22, stdev=422.29, samples=9 00:29:34.981 iops : min= 1768, max= 1940, avg=1843.78, stdev=52.79, samples=9 00:29:34.981 lat (usec) : 750=0.02%, 1000=0.10% 00:29:34.981 lat (msec) : 2=0.69%, 4=21.16%, 10=78.03% 00:29:34.981 cpu : usr=95.28%, sys=4.20%, ctx=8, majf=0, minf=43 00:29:34.981 IO depths : 1=0.1%, 2=14.6%, 4=58.0%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:34.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.981 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.981 issued rwts: total=9212,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.981 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:34.981 filename0: (groupid=0, jobs=1): err= 0: pid=3581652: Tue Nov 19 02:05:23 2024 00:29:34.981 read: IOPS=1898, BW=14.8MiB/s (15.5MB/s)(74.2MiB/5004msec) 00:29:34.981 slat (nsec): min=3921, max=66558, avg=19463.11, stdev=8309.39 00:29:34.981 clat (usec): min=634, max=8472, avg=4147.39, stdev=501.46 00:29:34.981 lat (usec): min=646, max=8484, avg=4166.86, stdev=501.61 00:29:34.981 clat percentiles (usec): 00:29:34.981 | 1.00th=[ 2802], 5.00th=[ 3425], 10.00th=[ 3654], 20.00th=[ 3916], 00:29:34.981 | 30.00th=[ 4015], 40.00th=[ 4080], 50.00th=[ 4146], 60.00th=[ 4228], 00:29:34.981 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 4752], 00:29:34.981 | 99.00th=[ 5997], 99.50th=[ 6259], 99.90th=[ 7242], 99.95th=[ 8225], 00:29:34.981 | 99.99th=[ 8455] 00:29:34.981 bw ( KiB/s): min=14736, max=15728, per=25.30%, avg=15187.00, stdev=286.14, samples=10 00:29:34.981 iops : min= 1842, max= 1966, avg=1898.30, stdev=35.75, samples=10 00:29:34.981 lat (usec) : 750=0.01%, 1000=0.03% 00:29:34.981 lat (msec) : 2=0.35%, 4=28.76%, 10=70.85% 00:29:34.981 cpu : usr=95.82%, sys=3.66%, ctx=9, majf=0, minf=37 00:29:34.981 IO depths : 1=0.3%, 2=15.1%, 4=57.6%, 8=27.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:34.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.981 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.981 issued rwts: total=9498,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.981 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:34.981 filename1: (groupid=0, jobs=1): err= 0: pid=3581653: Tue Nov 19 02:05:23 2024 00:29:34.981 read: IOPS=1894, BW=14.8MiB/s (15.5MB/s)(74.0MiB/5004msec) 00:29:34.981 slat (nsec): min=3890, max=68329, avg=17198.19, stdev=10223.42 00:29:34.981 clat (usec): min=721, max=9182, avg=4163.15, stdev=578.08 00:29:34.981 lat (usec): min=737, max=9207, avg=4180.35, stdev=578.20 00:29:34.981 clat percentiles (usec): 00:29:34.981 | 1.00th=[ 2638], 5.00th=[ 3326], 10.00th=[ 3621], 20.00th=[ 3884], 00:29:34.981 | 30.00th=[ 4015], 40.00th=[ 4080], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:34.981 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 4948], 00:29:34.981 | 99.00th=[ 6194], 99.50th=[ 6980], 99.90th=[ 7832], 99.95th=[ 8979], 00:29:34.981 | 99.99th=[ 9241] 00:29:34.981 bw ( KiB/s): min=14704, max=15984, per=25.24%, avg=15153.60, stdev=398.71, samples=10 00:29:34.981 iops : min= 1838, max= 1998, avg=1894.20, stdev=49.84, samples=10 00:29:34.981 lat (usec) : 750=0.01%, 1000=0.02% 00:29:34.981 lat (msec) : 2=0.38%, 4=29.01%, 10=70.57% 00:29:34.981 cpu : usr=94.40%, sys=5.06%, ctx=16, majf=0, minf=84 00:29:34.981 IO depths : 1=0.2%, 2=13.4%, 4=58.7%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:34.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.982 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.982 issued rwts: total=9478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.982 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:34.982 filename1: (groupid=0, jobs=1): err= 0: pid=3581654: Tue Nov 19 02:05:23 2024 00:29:34.982 read: IOPS=1870, BW=14.6MiB/s (15.3MB/s)(73.1MiB/5003msec) 00:29:34.982 slat (nsec): min=4396, max=71311, avg=18746.71, stdev=9967.03 00:29:34.982 clat (usec): min=652, max=7718, avg=4206.58, stdev=571.91 00:29:34.982 lat (usec): min=665, max=7736, avg=4225.33, stdev=571.55 00:29:34.982 clat percentiles (usec): 00:29:34.982 | 1.00th=[ 2409], 5.00th=[ 3490], 10.00th=[ 3785], 20.00th=[ 3949], 00:29:34.982 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:34.982 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4621], 95.00th=[ 5080], 00:29:34.982 | 99.00th=[ 6390], 99.50th=[ 6849], 99.90th=[ 7504], 99.95th=[ 7570], 00:29:34.982 | 99.99th=[ 7701] 00:29:34.982 bw ( KiB/s): min=14541, max=15824, per=24.93%, avg=14966.10, stdev=391.71, samples=10 00:29:34.982 iops : min= 1817, max= 1978, avg=1870.70, stdev=49.04, samples=10 00:29:34.982 lat (usec) : 750=0.02%, 1000=0.13% 00:29:34.982 lat (msec) : 2=0.43%, 4=24.34%, 10=75.09% 00:29:34.982 cpu : usr=94.46%, sys=4.98%, ctx=12, majf=0, minf=37 00:29:34.982 IO depths : 1=0.1%, 2=16.0%, 4=56.9%, 8=27.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:34.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.982 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.982 issued rwts: total=9360,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.982 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:34.982 00:29:34.982 Run status group 0 (all jobs): 00:29:34.982 READ: bw=58.6MiB/s (61.5MB/s), 14.4MiB/s-14.8MiB/s (15.1MB/s-15.5MB/s), io=293MiB (308MB), run=5002-5004msec 00:29:34.982 02:05:23 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:34.982 02:05:23 -- target/dif.sh@43 -- # local sub 00:29:34.982 02:05:23 -- target/dif.sh@45 -- # for sub in "$@" 00:29:34.982 02:05:23 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:34.982 02:05:23 -- target/dif.sh@36 -- # local sub_id=0 00:29:34.982 02:05:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:34.982 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.982 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:34.982 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.982 02:05:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:34.982 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.982 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:34.982 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.982 02:05:23 -- target/dif.sh@45 -- # for sub in "$@" 00:29:34.982 02:05:23 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:34.982 02:05:23 -- target/dif.sh@36 -- # local sub_id=1 00:29:34.982 02:05:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:34.982 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.982 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:34.982 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.982 02:05:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:34.982 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.982 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:35.240 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.240 00:29:35.240 real 0m24.407s 00:29:35.240 user 4m32.957s 00:29:35.240 sys 0m5.958s 00:29:35.240 02:05:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:35.240 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:35.240 ************************************ 00:29:35.240 END TEST fio_dif_rand_params 00:29:35.240 ************************************ 00:29:35.240 02:05:23 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:35.240 02:05:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:35.240 02:05:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:35.240 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:35.240 ************************************ 00:29:35.240 START TEST fio_dif_digest 00:29:35.240 ************************************ 00:29:35.240 02:05:23 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:35.240 02:05:23 -- target/dif.sh@123 -- # local NULL_DIF 00:29:35.240 02:05:23 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:35.240 02:05:23 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:35.240 02:05:23 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:35.240 02:05:23 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:35.240 02:05:23 -- target/dif.sh@127 -- # numjobs=3 00:29:35.240 02:05:23 -- target/dif.sh@127 -- # iodepth=3 00:29:35.240 02:05:23 -- target/dif.sh@127 -- # runtime=10 00:29:35.240 02:05:23 -- target/dif.sh@128 -- # hdgst=true 00:29:35.240 02:05:23 -- target/dif.sh@128 -- # ddgst=true 00:29:35.240 02:05:23 -- target/dif.sh@130 -- # create_subsystems 0 00:29:35.240 02:05:23 -- target/dif.sh@28 -- # local sub 00:29:35.240 02:05:23 -- target/dif.sh@30 -- # for sub in "$@" 00:29:35.240 02:05:23 -- target/dif.sh@31 -- # create_subsystem 0 00:29:35.240 02:05:23 -- target/dif.sh@18 -- # local sub_id=0 00:29:35.240 02:05:23 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:35.240 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.240 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:35.240 bdev_null0 00:29:35.240 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.240 02:05:23 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:35.240 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.240 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:35.240 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.240 02:05:23 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:35.240 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.240 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:35.240 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.240 02:05:23 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:35.240 02:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.240 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:29:35.240 [2024-11-19 02:05:23.585477] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:35.240 02:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.240 02:05:23 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:35.240 02:05:23 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:35.240 02:05:23 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:35.240 02:05:23 -- nvmf/common.sh@520 -- # config=() 00:29:35.240 02:05:23 -- nvmf/common.sh@520 -- # local subsystem config 00:29:35.240 02:05:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:35.240 02:05:23 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:35.240 02:05:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:35.240 { 00:29:35.240 "params": { 00:29:35.240 "name": "Nvme$subsystem", 00:29:35.240 "trtype": "$TEST_TRANSPORT", 00:29:35.240 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:35.240 "adrfam": "ipv4", 00:29:35.240 "trsvcid": "$NVMF_PORT", 00:29:35.240 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:35.240 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:35.240 "hdgst": ${hdgst:-false}, 00:29:35.240 "ddgst": ${ddgst:-false} 00:29:35.240 }, 00:29:35.240 "method": "bdev_nvme_attach_controller" 00:29:35.240 } 00:29:35.240 EOF 00:29:35.240 )") 00:29:35.240 02:05:23 -- target/dif.sh@82 -- # gen_fio_conf 00:29:35.240 02:05:23 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:35.240 02:05:23 -- target/dif.sh@54 -- # local file 00:29:35.240 02:05:23 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:35.240 02:05:23 -- target/dif.sh@56 -- # cat 00:29:35.240 02:05:23 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:35.240 02:05:23 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:35.240 02:05:23 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:35.240 02:05:23 -- common/autotest_common.sh@1330 -- # shift 00:29:35.240 02:05:23 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:35.240 02:05:23 -- nvmf/common.sh@542 -- # cat 00:29:35.240 02:05:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:35.240 02:05:23 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:35.240 02:05:23 -- target/dif.sh@72 -- # (( file <= files )) 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:35.240 02:05:23 -- nvmf/common.sh@544 -- # jq . 00:29:35.240 02:05:23 -- nvmf/common.sh@545 -- # IFS=, 00:29:35.240 02:05:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:35.240 "params": { 00:29:35.240 "name": "Nvme0", 00:29:35.240 "trtype": "tcp", 00:29:35.240 "traddr": "10.0.0.2", 00:29:35.240 "adrfam": "ipv4", 00:29:35.240 "trsvcid": "4420", 00:29:35.240 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:35.240 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:35.240 "hdgst": true, 00:29:35.240 "ddgst": true 00:29:35.240 }, 00:29:35.240 "method": "bdev_nvme_attach_controller" 00:29:35.240 }' 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:35.240 02:05:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:35.240 02:05:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:35.240 02:05:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:35.240 02:05:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:35.240 02:05:23 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:35.240 02:05:23 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:35.498 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:35.498 ... 00:29:35.498 fio-3.35 00:29:35.498 Starting 3 threads 00:29:35.498 EAL: No free 2048 kB hugepages reported on node 1 00:29:36.064 [2024-11-19 02:05:24.329277] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:36.064 [2024-11-19 02:05:24.329348] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:46.035 00:29:46.035 filename0: (groupid=0, jobs=1): err= 0: pid=3582543: Tue Nov 19 02:05:34 2024 00:29:46.035 read: IOPS=217, BW=27.2MiB/s (28.5MB/s)(272MiB/10008msec) 00:29:46.035 slat (nsec): min=4546, max=58663, avg=15117.19, stdev=4350.54 00:29:46.035 clat (usec): min=7913, max=18733, avg=13785.37, stdev=1008.54 00:29:46.035 lat (usec): min=7926, max=18761, avg=13800.48, stdev=1008.35 00:29:46.035 clat percentiles (usec): 00:29:46.035 | 1.00th=[11469], 5.00th=[12125], 10.00th=[12518], 20.00th=[13042], 00:29:46.035 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[13960], 00:29:46.035 | 70.00th=[14222], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:29:46.035 | 99.00th=[16319], 99.50th=[16581], 99.90th=[18482], 99.95th=[18744], 00:29:46.035 | 99.99th=[18744] 00:29:46.035 bw ( KiB/s): min=26112, max=28672, per=34.62%, avg=27801.60, stdev=629.27, samples=20 00:29:46.035 iops : min= 204, max= 224, avg=217.20, stdev= 4.92, samples=20 00:29:46.035 lat (msec) : 10=0.05%, 20=99.95% 00:29:46.035 cpu : usr=93.69%, sys=5.81%, ctx=17, majf=0, minf=145 00:29:46.035 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:46.035 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.035 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.035 issued rwts: total=2175,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:46.035 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:46.035 filename0: (groupid=0, jobs=1): err= 0: pid=3582544: Tue Nov 19 02:05:34 2024 00:29:46.035 read: IOPS=204, BW=25.6MiB/s (26.9MB/s)(257MiB/10044msec) 00:29:46.035 slat (nsec): min=4541, max=63011, avg=17808.35, stdev=4857.98 00:29:46.035 clat (usec): min=11603, max=52868, avg=14592.93, stdev=1544.75 00:29:46.035 lat (usec): min=11621, max=52888, avg=14610.74, stdev=1544.03 00:29:46.035 clat percentiles (usec): 00:29:46.035 | 1.00th=[12256], 5.00th=[12911], 10.00th=[13304], 20.00th=[13698], 00:29:46.035 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:29:46.035 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:29:46.035 | 99.00th=[17171], 99.50th=[17695], 99.90th=[20841], 99.95th=[49546], 00:29:46.035 | 99.99th=[52691] 00:29:46.035 bw ( KiB/s): min=24832, max=27648, per=32.79%, avg=26329.60, stdev=844.06, samples=20 00:29:46.035 iops : min= 194, max= 216, avg=205.70, stdev= 6.59, samples=20 00:29:46.035 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:29:46.035 cpu : usr=91.94%, sys=6.38%, ctx=124, majf=0, minf=208 00:29:46.035 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:46.035 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.035 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.035 issued rwts: total=2059,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:46.035 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:46.035 filename0: (groupid=0, jobs=1): err= 0: pid=3582545: Tue Nov 19 02:05:34 2024 00:29:46.035 read: IOPS=205, BW=25.7MiB/s (27.0MB/s)(259MiB/10047msec) 00:29:46.035 slat (nsec): min=4739, max=49717, avg=14946.07, stdev=4596.12 00:29:46.035 clat (usec): min=11208, max=51624, avg=14528.40, stdev=1527.98 00:29:46.035 lat (usec): min=11228, max=51641, avg=14543.34, stdev=1527.78 00:29:46.035 clat percentiles (usec): 00:29:46.035 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13173], 20.00th=[13566], 00:29:46.035 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:29:46.035 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:29:46.035 | 99.00th=[17171], 99.50th=[17433], 99.90th=[19792], 99.95th=[47973], 00:29:46.035 | 99.99th=[51643] 00:29:46.035 bw ( KiB/s): min=24368, max=27648, per=32.95%, avg=26460.00, stdev=799.80, samples=20 00:29:46.035 iops : min= 190, max= 216, avg=206.70, stdev= 6.30, samples=20 00:29:46.035 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:29:46.035 cpu : usr=93.93%, sys=5.58%, ctx=18, majf=0, minf=148 00:29:46.035 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:46.035 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.035 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.035 issued rwts: total=2069,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:46.035 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:46.035 00:29:46.035 Run status group 0 (all jobs): 00:29:46.035 READ: bw=78.4MiB/s (82.2MB/s), 25.6MiB/s-27.2MiB/s (26.9MB/s-28.5MB/s), io=788MiB (826MB), run=10008-10047msec 00:29:46.292 02:05:34 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:46.292 02:05:34 -- target/dif.sh@43 -- # local sub 00:29:46.292 02:05:34 -- target/dif.sh@45 -- # for sub in "$@" 00:29:46.292 02:05:34 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:46.292 02:05:34 -- target/dif.sh@36 -- # local sub_id=0 00:29:46.292 02:05:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:46.292 02:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.292 02:05:34 -- common/autotest_common.sh@10 -- # set +x 00:29:46.292 02:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.292 02:05:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:46.292 02:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.292 02:05:34 -- common/autotest_common.sh@10 -- # set +x 00:29:46.292 02:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.292 00:29:46.292 real 0m11.253s 00:29:46.292 user 0m29.389s 00:29:46.292 sys 0m2.036s 00:29:46.292 02:05:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:46.292 02:05:34 -- common/autotest_common.sh@10 -- # set +x 00:29:46.292 ************************************ 00:29:46.292 END TEST fio_dif_digest 00:29:46.292 ************************************ 00:29:46.292 02:05:34 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:46.292 02:05:34 -- target/dif.sh@147 -- # nvmftestfini 00:29:46.292 02:05:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:46.292 02:05:34 -- nvmf/common.sh@116 -- # sync 00:29:46.292 02:05:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:46.292 02:05:34 -- nvmf/common.sh@119 -- # set +e 00:29:46.292 02:05:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:46.292 02:05:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:46.550 rmmod nvme_tcp 00:29:46.550 rmmod nvme_fabrics 00:29:46.550 rmmod nvme_keyring 00:29:46.550 02:05:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:46.550 02:05:34 -- nvmf/common.sh@123 -- # set -e 00:29:46.550 02:05:34 -- nvmf/common.sh@124 -- # return 0 00:29:46.550 02:05:34 -- nvmf/common.sh@477 -- # '[' -n 3576175 ']' 00:29:46.550 02:05:34 -- nvmf/common.sh@478 -- # killprocess 3576175 00:29:46.550 02:05:34 -- common/autotest_common.sh@936 -- # '[' -z 3576175 ']' 00:29:46.550 02:05:34 -- common/autotest_common.sh@940 -- # kill -0 3576175 00:29:46.550 02:05:34 -- common/autotest_common.sh@941 -- # uname 00:29:46.550 02:05:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:46.550 02:05:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3576175 00:29:46.550 02:05:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:46.550 02:05:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:46.550 02:05:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3576175' 00:29:46.550 killing process with pid 3576175 00:29:46.550 02:05:34 -- common/autotest_common.sh@955 -- # kill 3576175 00:29:46.550 02:05:34 -- common/autotest_common.sh@960 -- # wait 3576175 00:29:46.808 02:05:35 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:46.808 02:05:35 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:48.183 Waiting for block devices as requested 00:29:48.183 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:48.183 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:48.183 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:48.183 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:48.442 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:48.442 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:48.442 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:48.442 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:48.701 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:48.701 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:48.701 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:48.701 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:48.960 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:48.960 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:48.960 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:48.960 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:49.218 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:49.218 02:05:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:49.218 02:05:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:49.218 02:05:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:49.218 02:05:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:49.218 02:05:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:49.218 02:05:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:49.218 02:05:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:51.122 02:05:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:51.122 00:29:51.122 real 1m7.622s 00:29:51.122 user 6m31.145s 00:29:51.122 sys 0m16.904s 00:29:51.122 02:05:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:51.122 02:05:39 -- common/autotest_common.sh@10 -- # set +x 00:29:51.122 ************************************ 00:29:51.122 END TEST nvmf_dif 00:29:51.123 ************************************ 00:29:51.381 02:05:39 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:51.381 02:05:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:51.381 02:05:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:51.381 02:05:39 -- common/autotest_common.sh@10 -- # set +x 00:29:51.381 ************************************ 00:29:51.381 START TEST nvmf_abort_qd_sizes 00:29:51.381 ************************************ 00:29:51.381 02:05:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:51.381 * Looking for test storage... 00:29:51.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:51.381 02:05:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:51.381 02:05:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:51.381 02:05:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:51.381 02:05:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:51.381 02:05:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:51.381 02:05:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:51.381 02:05:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:51.381 02:05:39 -- scripts/common.sh@335 -- # IFS=.-: 00:29:51.381 02:05:39 -- scripts/common.sh@335 -- # read -ra ver1 00:29:51.381 02:05:39 -- scripts/common.sh@336 -- # IFS=.-: 00:29:51.381 02:05:39 -- scripts/common.sh@336 -- # read -ra ver2 00:29:51.381 02:05:39 -- scripts/common.sh@337 -- # local 'op=<' 00:29:51.381 02:05:39 -- scripts/common.sh@339 -- # ver1_l=2 00:29:51.381 02:05:39 -- scripts/common.sh@340 -- # ver2_l=1 00:29:51.381 02:05:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:51.381 02:05:39 -- scripts/common.sh@343 -- # case "$op" in 00:29:51.381 02:05:39 -- scripts/common.sh@344 -- # : 1 00:29:51.381 02:05:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:51.381 02:05:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:51.381 02:05:39 -- scripts/common.sh@364 -- # decimal 1 00:29:51.381 02:05:39 -- scripts/common.sh@352 -- # local d=1 00:29:51.381 02:05:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:51.381 02:05:39 -- scripts/common.sh@354 -- # echo 1 00:29:51.381 02:05:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:51.381 02:05:39 -- scripts/common.sh@365 -- # decimal 2 00:29:51.381 02:05:39 -- scripts/common.sh@352 -- # local d=2 00:29:51.381 02:05:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:51.381 02:05:39 -- scripts/common.sh@354 -- # echo 2 00:29:51.381 02:05:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:51.381 02:05:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:51.381 02:05:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:51.381 02:05:39 -- scripts/common.sh@367 -- # return 0 00:29:51.381 02:05:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:51.381 02:05:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:51.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:51.381 --rc genhtml_branch_coverage=1 00:29:51.381 --rc genhtml_function_coverage=1 00:29:51.381 --rc genhtml_legend=1 00:29:51.381 --rc geninfo_all_blocks=1 00:29:51.381 --rc geninfo_unexecuted_blocks=1 00:29:51.381 00:29:51.381 ' 00:29:51.381 02:05:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:51.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:51.381 --rc genhtml_branch_coverage=1 00:29:51.381 --rc genhtml_function_coverage=1 00:29:51.381 --rc genhtml_legend=1 00:29:51.381 --rc geninfo_all_blocks=1 00:29:51.381 --rc geninfo_unexecuted_blocks=1 00:29:51.381 00:29:51.381 ' 00:29:51.381 02:05:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:51.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:51.381 --rc genhtml_branch_coverage=1 00:29:51.381 --rc genhtml_function_coverage=1 00:29:51.381 --rc genhtml_legend=1 00:29:51.381 --rc geninfo_all_blocks=1 00:29:51.381 --rc geninfo_unexecuted_blocks=1 00:29:51.381 00:29:51.381 ' 00:29:51.381 02:05:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:51.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:51.381 --rc genhtml_branch_coverage=1 00:29:51.381 --rc genhtml_function_coverage=1 00:29:51.381 --rc genhtml_legend=1 00:29:51.381 --rc geninfo_all_blocks=1 00:29:51.381 --rc geninfo_unexecuted_blocks=1 00:29:51.381 00:29:51.381 ' 00:29:51.382 02:05:39 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:51.382 02:05:39 -- nvmf/common.sh@7 -- # uname -s 00:29:51.382 02:05:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:51.382 02:05:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:51.382 02:05:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:51.382 02:05:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:51.382 02:05:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:51.382 02:05:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:51.382 02:05:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:51.382 02:05:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:51.382 02:05:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:51.382 02:05:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:51.382 02:05:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:51.382 02:05:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:51.382 02:05:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:51.382 02:05:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:51.382 02:05:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:51.382 02:05:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:51.382 02:05:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:51.382 02:05:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:51.382 02:05:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:51.382 02:05:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.382 02:05:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.382 02:05:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.382 02:05:39 -- paths/export.sh@5 -- # export PATH 00:29:51.382 02:05:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.382 02:05:39 -- nvmf/common.sh@46 -- # : 0 00:29:51.382 02:05:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:51.382 02:05:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:51.382 02:05:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:51.382 02:05:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:51.382 02:05:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:51.382 02:05:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:51.382 02:05:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:51.382 02:05:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:51.382 02:05:39 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:51.382 02:05:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:51.382 02:05:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:51.382 02:05:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:51.382 02:05:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:51.382 02:05:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:51.382 02:05:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:51.382 02:05:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:51.382 02:05:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:51.382 02:05:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:51.382 02:05:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:51.382 02:05:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:51.382 02:05:39 -- common/autotest_common.sh@10 -- # set +x 00:29:53.286 02:05:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:53.286 02:05:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:53.286 02:05:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:53.286 02:05:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:53.286 02:05:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:53.286 02:05:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:53.286 02:05:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:53.286 02:05:41 -- nvmf/common.sh@294 -- # net_devs=() 00:29:53.286 02:05:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:53.286 02:05:41 -- nvmf/common.sh@295 -- # e810=() 00:29:53.286 02:05:41 -- nvmf/common.sh@295 -- # local -ga e810 00:29:53.286 02:05:41 -- nvmf/common.sh@296 -- # x722=() 00:29:53.286 02:05:41 -- nvmf/common.sh@296 -- # local -ga x722 00:29:53.286 02:05:41 -- nvmf/common.sh@297 -- # mlx=() 00:29:53.286 02:05:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:53.286 02:05:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:53.286 02:05:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:53.286 02:05:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:53.286 02:05:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:53.286 02:05:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:53.286 02:05:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:53.286 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:53.286 02:05:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:53.286 02:05:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:53.286 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:53.286 02:05:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:53.286 02:05:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:53.286 02:05:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:53.286 02:05:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:53.286 02:05:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:53.286 02:05:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:53.286 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:53.286 02:05:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:53.286 02:05:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:53.286 02:05:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:53.286 02:05:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:53.286 02:05:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:53.286 02:05:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:53.286 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:53.286 02:05:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:53.286 02:05:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:53.286 02:05:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:53.286 02:05:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:53.286 02:05:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:53.286 02:05:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:53.286 02:05:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:53.286 02:05:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:53.286 02:05:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:53.286 02:05:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:53.286 02:05:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:53.286 02:05:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:53.286 02:05:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:53.286 02:05:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:53.286 02:05:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:53.286 02:05:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:53.286 02:05:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:53.286 02:05:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:53.286 02:05:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:53.286 02:05:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:53.286 02:05:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:53.286 02:05:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:53.579 02:05:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:53.579 02:05:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:53.579 02:05:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:53.579 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:53.579 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.169 ms 00:29:53.579 00:29:53.579 --- 10.0.0.2 ping statistics --- 00:29:53.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:53.579 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:29:53.579 02:05:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:53.579 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:53.579 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:29:53.579 00:29:53.579 --- 10.0.0.1 ping statistics --- 00:29:53.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:53.579 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:29:53.579 02:05:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:53.580 02:05:41 -- nvmf/common.sh@410 -- # return 0 00:29:53.580 02:05:41 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:53.580 02:05:41 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:54.513 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:54.513 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:54.513 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:54.513 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:54.513 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:54.771 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:54.771 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:54.771 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:54.771 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:55.704 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:55.704 02:05:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:55.704 02:05:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:55.704 02:05:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:55.705 02:05:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:55.705 02:05:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:55.705 02:05:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:55.705 02:05:44 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:55.705 02:05:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:55.705 02:05:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:55.705 02:05:44 -- common/autotest_common.sh@10 -- # set +x 00:29:55.705 02:05:44 -- nvmf/common.sh@469 -- # nvmfpid=3587448 00:29:55.705 02:05:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:55.705 02:05:44 -- nvmf/common.sh@470 -- # waitforlisten 3587448 00:29:55.705 02:05:44 -- common/autotest_common.sh@829 -- # '[' -z 3587448 ']' 00:29:55.705 02:05:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:55.705 02:05:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:55.705 02:05:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:55.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:55.705 02:05:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:55.705 02:05:44 -- common/autotest_common.sh@10 -- # set +x 00:29:55.705 [2024-11-19 02:05:44.236845] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:55.705 [2024-11-19 02:05:44.236928] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:55.963 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.963 [2024-11-19 02:05:44.303747] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:55.963 [2024-11-19 02:05:44.419879] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:55.963 [2024-11-19 02:05:44.420038] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:55.963 [2024-11-19 02:05:44.420058] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:55.963 [2024-11-19 02:05:44.420072] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:55.963 [2024-11-19 02:05:44.420129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:55.963 [2024-11-19 02:05:44.420198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:55.963 [2024-11-19 02:05:44.420290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:55.963 [2024-11-19 02:05:44.420288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:56.896 02:05:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:56.896 02:05:45 -- common/autotest_common.sh@862 -- # return 0 00:29:56.896 02:05:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:56.896 02:05:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:56.896 02:05:45 -- common/autotest_common.sh@10 -- # set +x 00:29:56.896 02:05:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:56.896 02:05:45 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:56.896 02:05:45 -- scripts/common.sh@312 -- # local nvmes 00:29:56.896 02:05:45 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:56.896 02:05:45 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:56.896 02:05:45 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:56.896 02:05:45 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:56.896 02:05:45 -- scripts/common.sh@322 -- # uname -s 00:29:56.896 02:05:45 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:56.896 02:05:45 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:56.896 02:05:45 -- scripts/common.sh@327 -- # (( 1 )) 00:29:56.896 02:05:45 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:56.896 02:05:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:56.896 02:05:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:56.896 02:05:45 -- common/autotest_common.sh@10 -- # set +x 00:29:56.896 ************************************ 00:29:56.896 START TEST spdk_target_abort 00:29:56.896 ************************************ 00:29:56.896 02:05:45 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:56.896 02:05:45 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:56.896 02:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.896 02:05:45 -- common/autotest_common.sh@10 -- # set +x 00:30:00.177 spdk_targetn1 00:30:00.177 02:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:00.177 02:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.177 02:05:48 -- common/autotest_common.sh@10 -- # set +x 00:30:00.177 [2024-11-19 02:05:48.054760] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:00.177 02:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:30:00.177 02:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.177 02:05:48 -- common/autotest_common.sh@10 -- # set +x 00:30:00.177 02:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:30:00.177 02:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.177 02:05:48 -- common/autotest_common.sh@10 -- # set +x 00:30:00.177 02:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:30:00.177 02:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.177 02:05:48 -- common/autotest_common.sh@10 -- # set +x 00:30:00.177 [2024-11-19 02:05:48.087078] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:00.177 02:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:00.177 02:05:48 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:00.177 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.458 Initializing NVMe Controllers 00:30:03.459 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:03.459 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:03.459 Initialization complete. Launching workers. 00:30:03.459 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12372, failed: 0 00:30:03.459 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1227, failed to submit 11145 00:30:03.459 success 704, unsuccess 523, failed 0 00:30:03.459 02:05:51 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:03.459 02:05:51 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:03.459 EAL: No free 2048 kB hugepages reported on node 1 00:30:06.738 Initializing NVMe Controllers 00:30:06.738 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:06.738 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:06.738 Initialization complete. Launching workers. 00:30:06.738 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8675, failed: 0 00:30:06.738 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1212, failed to submit 7463 00:30:06.738 success 357, unsuccess 855, failed 0 00:30:06.738 02:05:54 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:06.738 02:05:54 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:06.738 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.018 Initializing NVMe Controllers 00:30:10.018 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:10.018 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:10.018 Initialization complete. Launching workers. 00:30:10.018 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32741, failed: 0 00:30:10.018 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2643, failed to submit 30098 00:30:10.018 success 526, unsuccess 2117, failed 0 00:30:10.018 02:05:57 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:10.018 02:05:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.018 02:05:57 -- common/autotest_common.sh@10 -- # set +x 00:30:10.018 02:05:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:10.018 02:05:57 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:10.018 02:05:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.018 02:05:57 -- common/autotest_common.sh@10 -- # set +x 00:30:10.947 02:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:10.947 02:05:59 -- target/abort_qd_sizes.sh@62 -- # killprocess 3587448 00:30:10.947 02:05:59 -- common/autotest_common.sh@936 -- # '[' -z 3587448 ']' 00:30:10.947 02:05:59 -- common/autotest_common.sh@940 -- # kill -0 3587448 00:30:10.947 02:05:59 -- common/autotest_common.sh@941 -- # uname 00:30:10.947 02:05:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:10.947 02:05:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3587448 00:30:10.947 02:05:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:10.948 02:05:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:10.948 02:05:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3587448' 00:30:10.948 killing process with pid 3587448 00:30:10.948 02:05:59 -- common/autotest_common.sh@955 -- # kill 3587448 00:30:10.948 02:05:59 -- common/autotest_common.sh@960 -- # wait 3587448 00:30:11.205 00:30:11.205 real 0m14.422s 00:30:11.205 user 0m56.778s 00:30:11.205 sys 0m2.708s 00:30:11.205 02:05:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.205 02:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:11.205 ************************************ 00:30:11.205 END TEST spdk_target_abort 00:30:11.205 ************************************ 00:30:11.205 02:05:59 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:11.205 02:05:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:11.205 02:05:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:11.205 02:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:11.205 ************************************ 00:30:11.205 START TEST kernel_target_abort 00:30:11.205 ************************************ 00:30:11.205 02:05:59 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:11.205 02:05:59 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:11.205 02:05:59 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:11.205 02:05:59 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:11.205 02:05:59 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:11.205 02:05:59 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:11.205 02:05:59 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:11.205 02:05:59 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:11.205 02:05:59 -- nvmf/common.sh@627 -- # local block nvme 00:30:11.205 02:05:59 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:11.205 02:05:59 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:11.205 02:05:59 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:11.205 02:05:59 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:12.579 Waiting for block devices as requested 00:30:12.580 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:12.580 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:12.580 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:12.580 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:12.580 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:12.838 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:12.838 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:12.838 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:12.838 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:13.096 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:13.096 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:13.096 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:13.096 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:13.355 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:13.355 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:13.355 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:13.355 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:13.613 02:06:01 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:13.613 02:06:01 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:13.613 02:06:01 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:13.613 02:06:01 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:13.613 02:06:01 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:13.613 No valid GPT data, bailing 00:30:13.613 02:06:01 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:13.613 02:06:02 -- scripts/common.sh@393 -- # pt= 00:30:13.613 02:06:02 -- scripts/common.sh@394 -- # return 1 00:30:13.613 02:06:02 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:13.613 02:06:02 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:13.613 02:06:02 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:13.613 02:06:02 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:13.613 02:06:02 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:13.613 02:06:02 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:13.613 02:06:02 -- nvmf/common.sh@654 -- # echo 1 00:30:13.613 02:06:02 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:13.613 02:06:02 -- nvmf/common.sh@656 -- # echo 1 00:30:13.613 02:06:02 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:13.613 02:06:02 -- nvmf/common.sh@663 -- # echo tcp 00:30:13.613 02:06:02 -- nvmf/common.sh@664 -- # echo 4420 00:30:13.613 02:06:02 -- nvmf/common.sh@665 -- # echo ipv4 00:30:13.613 02:06:02 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:13.613 02:06:02 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:13.613 00:30:13.613 Discovery Log Number of Records 2, Generation counter 2 00:30:13.613 =====Discovery Log Entry 0====== 00:30:13.613 trtype: tcp 00:30:13.613 adrfam: ipv4 00:30:13.613 subtype: current discovery subsystem 00:30:13.613 treq: not specified, sq flow control disable supported 00:30:13.613 portid: 1 00:30:13.613 trsvcid: 4420 00:30:13.613 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:13.613 traddr: 10.0.0.1 00:30:13.613 eflags: none 00:30:13.613 sectype: none 00:30:13.613 =====Discovery Log Entry 1====== 00:30:13.613 trtype: tcp 00:30:13.613 adrfam: ipv4 00:30:13.613 subtype: nvme subsystem 00:30:13.613 treq: not specified, sq flow control disable supported 00:30:13.613 portid: 1 00:30:13.613 trsvcid: 4420 00:30:13.613 subnqn: kernel_target 00:30:13.613 traddr: 10.0.0.1 00:30:13.613 eflags: none 00:30:13.613 sectype: none 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:13.613 02:06:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:13.613 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.895 Initializing NVMe Controllers 00:30:16.895 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:16.895 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:16.895 Initialization complete. Launching workers. 00:30:16.895 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 47476, failed: 0 00:30:16.895 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 47476, failed to submit 0 00:30:16.896 success 0, unsuccess 47476, failed 0 00:30:16.896 02:06:05 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:16.896 02:06:05 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:16.896 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.177 Initializing NVMe Controllers 00:30:20.177 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:20.177 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:20.177 Initialization complete. Launching workers. 00:30:20.177 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81623, failed: 0 00:30:20.177 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20574, failed to submit 61049 00:30:20.177 success 0, unsuccess 20574, failed 0 00:30:20.177 02:06:08 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:20.177 02:06:08 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:20.177 EAL: No free 2048 kB hugepages reported on node 1 00:30:23.458 Initializing NVMe Controllers 00:30:23.458 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:23.458 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:23.458 Initialization complete. Launching workers. 00:30:23.458 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 78378, failed: 0 00:30:23.458 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19578, failed to submit 58800 00:30:23.458 success 0, unsuccess 19578, failed 0 00:30:23.458 02:06:11 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:23.458 02:06:11 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:23.458 02:06:11 -- nvmf/common.sh@677 -- # echo 0 00:30:23.458 02:06:11 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:23.458 02:06:11 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:23.458 02:06:11 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:23.458 02:06:11 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:23.458 02:06:11 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:23.458 02:06:11 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:23.458 00:30:23.458 real 0m11.835s 00:30:23.458 user 0m5.899s 00:30:23.458 sys 0m2.250s 00:30:23.458 02:06:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:23.458 02:06:11 -- common/autotest_common.sh@10 -- # set +x 00:30:23.458 ************************************ 00:30:23.458 END TEST kernel_target_abort 00:30:23.458 ************************************ 00:30:23.459 02:06:11 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:23.459 02:06:11 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:23.459 02:06:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:23.459 02:06:11 -- nvmf/common.sh@116 -- # sync 00:30:23.459 02:06:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:23.459 02:06:11 -- nvmf/common.sh@119 -- # set +e 00:30:23.459 02:06:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:23.459 02:06:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:23.459 rmmod nvme_tcp 00:30:23.459 rmmod nvme_fabrics 00:30:23.459 rmmod nvme_keyring 00:30:23.459 02:06:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:23.459 02:06:11 -- nvmf/common.sh@123 -- # set -e 00:30:23.459 02:06:11 -- nvmf/common.sh@124 -- # return 0 00:30:23.459 02:06:11 -- nvmf/common.sh@477 -- # '[' -n 3587448 ']' 00:30:23.459 02:06:11 -- nvmf/common.sh@478 -- # killprocess 3587448 00:30:23.459 02:06:11 -- common/autotest_common.sh@936 -- # '[' -z 3587448 ']' 00:30:23.459 02:06:11 -- common/autotest_common.sh@940 -- # kill -0 3587448 00:30:23.459 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3587448) - No such process 00:30:23.459 02:06:11 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3587448 is not found' 00:30:23.459 Process with pid 3587448 is not found 00:30:23.459 02:06:11 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:23.459 02:06:11 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:24.393 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:24.393 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:24.393 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:24.393 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:24.393 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:24.393 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:24.393 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:24.393 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:24.393 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:24.393 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:24.393 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:24.393 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:24.393 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:24.393 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:24.393 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:24.393 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:24.393 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:24.652 02:06:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:24.652 02:06:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:24.652 02:06:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:24.652 02:06:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:24.652 02:06:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:24.652 02:06:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:24.652 02:06:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:26.554 02:06:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:26.554 00:30:26.554 real 0m35.359s 00:30:26.554 user 1m4.997s 00:30:26.554 sys 0m8.363s 00:30:26.554 02:06:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:26.554 02:06:15 -- common/autotest_common.sh@10 -- # set +x 00:30:26.554 ************************************ 00:30:26.554 END TEST nvmf_abort_qd_sizes 00:30:26.554 ************************************ 00:30:26.554 02:06:15 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:26.554 02:06:15 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:26.554 02:06:15 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:26.554 02:06:15 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:26.554 02:06:15 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:26.554 02:06:15 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:26.554 02:06:15 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:26.554 02:06:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:26.554 02:06:15 -- common/autotest_common.sh@10 -- # set +x 00:30:26.554 02:06:15 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:26.554 02:06:15 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:26.554 02:06:15 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:26.554 02:06:15 -- common/autotest_common.sh@10 -- # set +x 00:30:28.458 INFO: APP EXITING 00:30:28.458 INFO: killing all VMs 00:30:28.458 INFO: killing vhost app 00:30:28.458 INFO: EXIT DONE 00:30:29.393 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:29.393 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:29.393 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:29.393 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:29.393 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:29.393 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:29.393 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:29.651 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:29.651 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:29.651 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:29.651 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:29.651 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:29.651 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:29.651 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:29.651 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:29.651 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:29.651 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:31.061 Cleaning 00:30:31.061 Removing: /var/run/dpdk/spdk0/config 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:31.061 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:31.061 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:31.061 Removing: /var/run/dpdk/spdk1/config 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:31.062 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:31.062 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:31.062 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:31.062 Removing: /var/run/dpdk/spdk2/config 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:31.062 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:31.062 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:31.062 Removing: /var/run/dpdk/spdk3/config 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:31.062 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:31.062 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:31.062 Removing: /var/run/dpdk/spdk4/config 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:31.062 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:31.062 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:31.062 Removing: /dev/shm/bdev_svc_trace.1 00:30:31.062 Removing: /dev/shm/nvmf_trace.0 00:30:31.062 Removing: /dev/shm/spdk_tgt_trace.pid3318440 00:30:31.062 Removing: /var/run/dpdk/spdk0 00:30:31.062 Removing: /var/run/dpdk/spdk1 00:30:31.062 Removing: /var/run/dpdk/spdk2 00:30:31.062 Removing: /var/run/dpdk/spdk3 00:30:31.062 Removing: /var/run/dpdk/spdk4 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3316702 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3317505 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3318440 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3318977 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3320286 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3321236 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3321552 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3321771 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3322108 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3322440 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3322597 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3322768 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3323031 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3323548 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3326099 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3326400 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3326679 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3326714 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3327159 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3327298 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3327701 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3327751 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3328046 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3328187 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3328360 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3328501 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3328876 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3329036 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3329361 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3329543 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3329683 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3329752 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3329890 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3330172 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3330318 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3330479 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3330736 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3330900 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3331045 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3331322 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3331476 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3331632 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3331845 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3332054 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3332204 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3332385 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3332622 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3332787 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3332931 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3333205 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3333358 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3333514 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3333777 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3333936 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3334085 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3334416 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3334611 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3334778 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3335033 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3335200 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3335725 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3336133 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3336272 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3336438 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3336703 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3336872 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3337013 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3337301 00:30:31.062 Removing: /var/run/dpdk/spdk_pid3337443 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3337605 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3337867 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3338029 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3338230 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3338493 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3340798 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3398295 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3401038 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3408157 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3411516 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3414007 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3414426 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3419548 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3419832 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3422644 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3426424 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3428692 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3435913 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3441450 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3442684 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3443371 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3454004 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3456274 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3459221 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3460443 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3461816 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3462084 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3462241 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3462476 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3463104 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3464478 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3465608 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3466570 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3470194 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3473649 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3477315 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3501885 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3504734 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3508566 00:30:31.345 Removing: /var/run/dpdk/spdk_pid3509663 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3510792 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3513500 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3516036 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3520512 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3520566 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3523507 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3523650 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3523793 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3524064 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3524108 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3525297 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3526526 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3527809 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3529591 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3530808 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3532026 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3536040 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3536380 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3537709 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3538465 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3542376 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3544429 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3548048 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3551807 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3555333 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3555759 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3556175 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3556597 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3557187 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3557812 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3558409 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3559463 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3562148 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3562413 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3566282 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3566463 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3568118 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3573370 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3573407 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3576358 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3577798 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3579234 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3580142 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3581584 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3582362 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3587890 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3588294 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3588697 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3590286 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3590695 00:30:31.346 Removing: /var/run/dpdk/spdk_pid3591567 00:30:31.346 Clean 00:30:31.346 killing process with pid 3288167 00:30:39.460 killing process with pid 3288164 00:30:39.460 killing process with pid 3288166 00:30:39.460 killing process with pid 3288165 00:30:39.460 02:06:27 -- common/autotest_common.sh@1446 -- # return 0 00:30:39.460 02:06:27 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:39.460 02:06:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:39.460 02:06:27 -- common/autotest_common.sh@10 -- # set +x 00:30:39.460 02:06:27 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:39.460 02:06:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:39.460 02:06:27 -- common/autotest_common.sh@10 -- # set +x 00:30:39.460 02:06:27 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:39.460 02:06:27 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:39.460 02:06:27 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:39.460 02:06:27 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:39.460 02:06:27 -- spdk/autotest.sh@383 -- # hostname 00:30:39.460 02:06:27 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:39.460 geninfo: WARNING: invalid characters removed from testname! 00:31:06.001 02:06:53 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:09.281 02:06:57 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:11.812 02:07:00 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:14.342 02:07:02 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:16.871 02:07:05 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:20.155 02:07:07 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:22.059 02:07:10 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:22.318 02:07:10 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:22.318 02:07:10 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:22.318 02:07:10 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:22.318 02:07:10 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:22.318 02:07:10 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:22.318 02:07:10 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:22.318 02:07:10 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:22.318 02:07:10 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:22.318 02:07:10 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:22.318 02:07:10 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:22.318 02:07:10 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:22.318 02:07:10 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:22.318 02:07:10 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:22.318 02:07:10 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:22.318 02:07:10 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:22.318 02:07:10 -- scripts/common.sh@343 -- $ case "$op" in 00:31:22.318 02:07:10 -- scripts/common.sh@344 -- $ : 1 00:31:22.318 02:07:10 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:22.318 02:07:10 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:22.318 02:07:10 -- scripts/common.sh@364 -- $ decimal 1 00:31:22.318 02:07:10 -- scripts/common.sh@352 -- $ local d=1 00:31:22.318 02:07:10 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:22.318 02:07:10 -- scripts/common.sh@354 -- $ echo 1 00:31:22.318 02:07:10 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:22.318 02:07:10 -- scripts/common.sh@365 -- $ decimal 2 00:31:22.318 02:07:10 -- scripts/common.sh@352 -- $ local d=2 00:31:22.318 02:07:10 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:22.319 02:07:10 -- scripts/common.sh@354 -- $ echo 2 00:31:22.319 02:07:10 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:22.319 02:07:10 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:22.319 02:07:10 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:22.319 02:07:10 -- scripts/common.sh@367 -- $ return 0 00:31:22.319 02:07:10 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:22.319 02:07:10 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:22.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:22.319 --rc genhtml_branch_coverage=1 00:31:22.319 --rc genhtml_function_coverage=1 00:31:22.319 --rc genhtml_legend=1 00:31:22.319 --rc geninfo_all_blocks=1 00:31:22.319 --rc geninfo_unexecuted_blocks=1 00:31:22.319 00:31:22.319 ' 00:31:22.319 02:07:10 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:22.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:22.319 --rc genhtml_branch_coverage=1 00:31:22.319 --rc genhtml_function_coverage=1 00:31:22.319 --rc genhtml_legend=1 00:31:22.319 --rc geninfo_all_blocks=1 00:31:22.319 --rc geninfo_unexecuted_blocks=1 00:31:22.319 00:31:22.319 ' 00:31:22.319 02:07:10 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:22.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:22.319 --rc genhtml_branch_coverage=1 00:31:22.319 --rc genhtml_function_coverage=1 00:31:22.319 --rc genhtml_legend=1 00:31:22.319 --rc geninfo_all_blocks=1 00:31:22.319 --rc geninfo_unexecuted_blocks=1 00:31:22.319 00:31:22.319 ' 00:31:22.319 02:07:10 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:22.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:22.319 --rc genhtml_branch_coverage=1 00:31:22.319 --rc genhtml_function_coverage=1 00:31:22.319 --rc genhtml_legend=1 00:31:22.319 --rc geninfo_all_blocks=1 00:31:22.319 --rc geninfo_unexecuted_blocks=1 00:31:22.319 00:31:22.319 ' 00:31:22.319 02:07:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:22.319 02:07:10 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:22.319 02:07:10 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:22.319 02:07:10 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:22.319 02:07:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:22.319 02:07:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:22.319 02:07:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:22.319 02:07:10 -- paths/export.sh@5 -- $ export PATH 00:31:22.319 02:07:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:22.319 02:07:10 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:22.319 02:07:10 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:22.319 02:07:10 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731978430.XXXXXX 00:31:22.319 02:07:10 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731978430.whx1PM 00:31:22.319 02:07:10 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:22.319 02:07:10 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:22.319 02:07:10 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:22.319 02:07:10 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:22.319 02:07:10 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:22.319 02:07:10 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:22.319 02:07:10 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:22.319 02:07:10 -- common/autotest_common.sh@10 -- $ set +x 00:31:22.319 02:07:10 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:22.319 02:07:10 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:22.319 02:07:10 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:22.319 02:07:10 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:22.319 02:07:10 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:22.319 02:07:10 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:22.319 02:07:10 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:22.319 02:07:10 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:22.319 02:07:10 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:22.319 02:07:10 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:22.319 02:07:10 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:22.319 + [[ -n 3245861 ]] 00:31:22.319 + sudo kill 3245861 00:31:22.328 [Pipeline] } 00:31:22.343 [Pipeline] // stage 00:31:22.348 [Pipeline] } 00:31:22.366 [Pipeline] // timeout 00:31:22.371 [Pipeline] } 00:31:22.385 [Pipeline] // catchError 00:31:22.390 [Pipeline] } 00:31:22.405 [Pipeline] // wrap 00:31:22.411 [Pipeline] } 00:31:22.424 [Pipeline] // catchError 00:31:22.433 [Pipeline] stage 00:31:22.435 [Pipeline] { (Epilogue) 00:31:22.448 [Pipeline] catchError 00:31:22.450 [Pipeline] { 00:31:22.463 [Pipeline] echo 00:31:22.465 Cleanup processes 00:31:22.471 [Pipeline] sh 00:31:22.757 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:22.758 3603576 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:22.772 [Pipeline] sh 00:31:23.056 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:23.056 ++ grep -v 'sudo pgrep' 00:31:23.056 ++ awk '{print $1}' 00:31:23.056 + sudo kill -9 00:31:23.056 + true 00:31:23.068 [Pipeline] sh 00:31:23.352 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:35.619 [Pipeline] sh 00:31:35.904 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:35.905 Artifacts sizes are good 00:31:35.920 [Pipeline] archiveArtifacts 00:31:35.927 Archiving artifacts 00:31:36.074 [Pipeline] sh 00:31:36.358 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:36.374 [Pipeline] cleanWs 00:31:36.384 [WS-CLEANUP] Deleting project workspace... 00:31:36.384 [WS-CLEANUP] Deferred wipeout is used... 00:31:36.391 [WS-CLEANUP] done 00:31:36.393 [Pipeline] } 00:31:36.410 [Pipeline] // catchError 00:31:36.422 [Pipeline] sh 00:31:36.700 + logger -p user.info -t JENKINS-CI 00:31:36.709 [Pipeline] } 00:31:36.722 [Pipeline] // stage 00:31:36.727 [Pipeline] } 00:31:36.741 [Pipeline] // node 00:31:36.747 [Pipeline] End of Pipeline 00:31:36.787 Finished: SUCCESS